2023-12-22T08:22:00.762 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T08:22:00.763 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --archive /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264 --verbose --name rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/orig.config.yaml 2023-12-22T08:22:00.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:22:00.890 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264 branch: rishabh-mdscap-reef description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: null first_in_suite: false job_id: '7499264' kernel: client: branch: testing flavor: default kdb: true sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mdscap-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mdscap-reef sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 9974 sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c sleep_before_teardown: 0 subset: 301/512 suite: fs suite_branch: rishabh-mdscap-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB23JivX3NN0kJikQtmzVqu4rvaSH8xkeY/nxCbPif/BHykgD6P54hx0/ntSHiaNnM1xvcQbPT1AgynzyFQZM2g= smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDAGJtlX1Wvr3Kk+bOb1TYcJrJLgT/Na2DrTcmUsGZS0WPS8rezYiW4P3EiEfDoftsSYKciV8cbqlGUemwH6lMY= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmDN9xvpP3Iefh6BILfTx8zURGBu3p8av5TiH2xj2l+f7+ahFpQEltHPDJtBjzBJ2aXLXJZyGgu9vvzKxJ5Eg0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9680d2aba1e76f64ade295c81599c97907457848 timestamp: 2023-12-22_08:10:43 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-22T08:22:00.890 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa; will attempt to use it 2023-12-22T08:22:00.891 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks 2023-12-22T08:22:00.891 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-22T08:22:00.893 INFO:teuthology.task.internal:Checking packages... 2023-12-22T08:22:00.917 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '24e2e32ab893c11f7e31ee84381b2f961d1b317c' 2023-12-22T08:22:00.917 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-22T08:22:00.917 INFO:teuthology.packaging:ref: None 2023-12-22T08:22:00.917 INFO:teuthology.packaging:tag: None 2023-12-22T08:22:00.918 INFO:teuthology.packaging:branch: rishabh-mdscap-reef 2023-12-22T08:22:00.918 INFO:teuthology.packaging:sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:22:00.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mdscap-reef 2023-12-22T08:22:01.064 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1377.g24e2e32a 2023-12-22T08:22:01.066 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-22T08:22:01.072 INFO:teuthology.task.internal:no buildpackages task found 2023-12-22T08:22:01.072 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-22T08:22:01.145 INFO:teuthology.task.internal:Saving configuration 2023-12-22T08:22:01.162 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-22T08:22:01.166 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:22:01.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:11:51.811663', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB23JivX3NN0kJikQtmzVqu4rvaSH8xkeY/nxCbPif/BHykgD6P54hx0/ntSHiaNnM1xvcQbPT1AgynzyFQZM2g='} 2023-12-22T08:22:01.211 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:11:51.812826', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDAGJtlX1Wvr3Kk+bOb1TYcJrJLgT/Na2DrTcmUsGZS0WPS8rezYiW4P3EiEfDoftsSYKciV8cbqlGUemwH6lMY='} 2023-12-22T08:22:01.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:11:51.813780', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmDN9xvpP3Iefh6BILfTx8zURGBu3p8av5TiH2xj2l+f7+ahFpQEltHPDJtBjzBJ2aXLXJZyGgu9vvzKxJ5Eg0='} 2023-12-22T08:22:01.234 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-22T08:22:01.239 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-12-22T08:22:01.239 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-22T08:22:01.239 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['client.0'] 2023-12-22T08:22:01.239 INFO:teuthology.run_tasks:Running task console_log... 2023-12-22T08:22:01.340 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7bbf2dcdc0>, signals=[15]) 2023-12-22T08:22:01.340 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-22T08:22:01.346 INFO:teuthology.task.internal:Opening connections... 2023-12-22T08:22:01.346 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:22:01.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:22:01.449 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:22:01.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:22:01.532 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-12-22T08:22:01.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:22:01.616 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-22T08:22:01.622 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-12-22T08:22:01.641 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-12-22T08:22:01.641 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-12-22T08:22:01.699 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-12-22T08:22:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2023-12-22T08:22:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-12-22T08:22:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:22:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2023-12-22T08:22:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2023-12-22T08:22:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T08:22:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-12-22T08:22:01.700 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2023-12-22T08:22:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T08:22:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:22:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:22:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T08:22:01.701 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:22:01.701 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-12-22T08:22:01.724 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-12-22T08:22:01.742 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-12-22T08:22:01.742 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-12-22T08:22:01.800 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-12-22T08:22:01.801 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T08:22:01.801 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:22:01.801 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:22:01.801 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T08:22:01.801 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:22:01.801 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-12-22T08:22:01.823 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-12-22T08:22:01.841 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-12-22T08:22:01.841 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-12-22T08:22:01.899 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-12-22T08:22:01.899 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2023-12-22T08:22:01.899 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-12-22T08:22:01.899 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-12-22T08:22:01.899 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2023-12-22T08:22:01.899 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2023-12-22T08:22:01.899 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-22T08:22:01.900 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-12-22T08:22:01.900 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2023-12-22T08:22:01.900 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-22T08:22:01.900 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-12-22T08:22:01.900 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T08:22:01.900 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-22T08:22:01.900 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-22T08:22:01.900 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-12-22T08:22:01.923 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-22T08:22:01.933 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-22T08:22:01.975 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-22T08:22:01.975 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2023-12-22T08:22:01.977 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2023-12-22T08:22:01.979 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-12-22T08:22:01.995 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-22T08:22:02.001 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-22T08:22:02.001 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2023-12-22T08:22:02.035 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2023-12-22T08:22:02.037 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-12-22T08:22:02.063 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-22T08:22:02.137 INFO:teuthology.run_tasks:Running task kernel... 2023-12-22T08:22:02.150 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'} 2023-12-22T08:22:02.151 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-12-22T08:22:02.151 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-12-22T08:22:02.151 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T08:22:02.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:22:02.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-22T08:22:02.356 DEBUG:teuthology.task.kernel:sha1 for client.0 is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:22:02.356 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-22T08:22:02.356 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-12-22T08:22:02.373 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-361.el9.x86_64 2023-12-22T08:22:02.373 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:22:02.374 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-22T08:22:02.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum upgrade -y linux-firmware 2023-12-22T08:22:04.435 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-22T08:22:06.027 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2023-12-22T08:22:07.176 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-12-22T08:22:10.029 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-12-22T08:22:14.011 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 5.8 MB 00:00 2023-12-22T08:22:15.545 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2023-12-22T08:22:16.363 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 29 MB/s | 20 MB 00:00 2023-12-22T08:22:21.180 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-12-22T08:22:23.545 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-12-22T08:22:23.553 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-22T08:22:23.553 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-12-22T08:22:23.553 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-22T08:22:23.553 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-12-22T08:22:23.553 INFO:teuthology.orchestra.run.smithi081.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-22T08:22:23.553 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:22:23.554 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-12-22T08:22:23.554 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-22T08:22:23.554 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 1 Package 2023-12-22T08:22:23.554 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:22:23.554 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 328 M 2023-12-22T08:22:23.554 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-12-22T08:22:38.680 INFO:teuthology.orchestra.run.smithi081.stdout:linux-firmware-20231030-141.el9.noarch.rpm 22 MB/s | 328 MB 00:15 2023-12-22T08:22:38.681 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:22:38.681 INFO:teuthology.orchestra.run.smithi081.stdout:Total 22 MB/s | 328 MB 00:15 2023-12-22T08:22:38.682 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-12-22T08:22:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-12-22T08:22:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-12-22T08:22:41.037 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-12-22T08:22:41.037 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-12-22T08:22:46.937 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-12-22T08:22:47.316 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:22:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:22:48.229 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:22:48.229 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-22T08:22:48.634 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-22T08:22:48.635 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:22:48.635 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-12-22T08:22:48.635 INFO:teuthology.orchestra.run.smithi081.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-22T08:22:48.635 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:22:48.635 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-12-22T08:22:48.928 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.0... 2023-12-22T08:22:48.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T08:22:49.070 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ 2023-12-22T08:22:49.071 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g623393c9d50c-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-22T08:22:49.073 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi081.front.sepia.ceph.com to complete... 2023-12-22T08:23:36.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-22 08:23:36 URL:https://2.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/centos/9/flavors/default/x86_64/kernel-6.6.0_g623393c9d50c-1.x86_64.rpm [320178570/320178570] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-22T08:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:FINISHED --2023-12-22 08:23:36-- 2023-12-22T08:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:Total wall clock time: 47s 2023-12-22T08:23:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:Downloaded: 1 files, 305M in 47s (6.52 MB/s) 2023-12-22T08:23:36.404 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on client.0... 2023-12-22T08:23:36.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-22T08:23:38.288 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying... ######################################## 2023-12-22T08:23:38.345 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing... ######################################## 2023-12-22T08:23:38.423 INFO:teuthology.orchestra.run.smithi081.stdout:Updating / installing... 2023-12-22T08:23:45.506 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-6.6.0_g623393c9d50c-1 ######################################## 2023-12-22T08:23:59.959 INFO:teuthology.orchestra.run.smithi081.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-22T08:24:21.111 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-22T08:24:21.112 DEBUG:teuthology.orchestra.run.smithi081:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/config-6.6.0-g623393c9d50c 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-22T08:24:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-22T08:24:21.183 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-22T08:24:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-22T08:24:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-22T08:24:21.186 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi 2023-12-22T08:24:21.187 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/custom_method.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ata_generic.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-22T08:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-22T08:24:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-22T08:24:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sis.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-22T08:24:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-22T08:24:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/brd.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/loop.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/virtio_blk.ko 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback 2023-12-22T08:24:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkfront.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-22T08:24:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/uv_mmtimer.ko 2023-12-22T08:24:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/virtio_console.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-22T08:24:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac 2023-12-22T08:24:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/edd.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-22T08:24:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-22T08:24:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-22T08:24:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-22T08:24:21.201 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-22T08:24:21.202 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-22T08:24:21.203 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-22T08:24:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-22T08:24:21.205 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-22T08:24:21.206 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-22T08:24:21.207 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-22T08:24:21.208 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-22T08:24:21.209 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-22T08:24:21.210 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-22T08:24:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos 2023-12-22T08:24:21.212 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-22T08:24:21.213 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-dev.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core 2023-12-22T08:24:21.214 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-22T08:24:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-22T08:24:21.216 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-22T08:24:21.217 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-22T08:24:21.218 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-22T08:24:21.219 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-22T08:24:21.220 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mfd-core.ko 2023-12-22T08:24:21.221 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-22T08:24:21.222 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-22T08:24:21.223 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53 2023-12-22T08:24:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390 2023-12-22T08:24:21.225 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-22T08:24:21.226 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-22T08:24:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-22T08:24:21.228 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-22T08:24:21.229 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k 2023-12-22T08:24:21.230 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-22T08:24:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-22T08:24:21.232 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc 2023-12-22T08:24:21.233 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-22T08:24:21.234 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-22T08:24:21.235 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-22T08:24:21.236 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/net_failover.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-22T08:24:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/dp83640.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-22T08:24:21.238 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-22T08:24:21.239 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slhc.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-22T08:24:21.240 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tun.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/virtio_net.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netfront.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-22T08:24:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-22T08:24:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-22T08:24:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-22T08:24:21.244 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-22T08:24:21.245 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-22T08:24:21.246 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid 2023-12-22T08:24:21.247 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i 2023-12-22T08:24:21.248 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-22T08:24:21.249 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-22T08:24:21.250 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-22T08:24:21.251 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-22T08:24:21.252 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target 2023-12-22T08:24:21.253 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-22T08:24:21.254 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-22T08:24:21.255 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-22T08:24:21.256 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-22T08:24:21.257 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-22T08:24:21.258 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-22T08:24:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-22T08:24:21.260 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-22T08:24:21.261 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-22T08:24:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost 2023-12-22T08:24:21.263 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_balloon.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_mmio.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/virtio/virtio_ring.ko 2023-12-22T08:24:21.264 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-22T08:24:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-22T08:24:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-22T08:24:21.267 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-22T08:24:21.268 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/fat.ko 2023-12-22T08:24:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/vfat.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/fuse.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-22T08:24:21.270 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-22T08:24:21.271 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-22T08:24:21.272 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-22T08:24:21.273 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-22T08:24:21.274 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-22T08:24:21.275 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-22T08:24:21.276 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/rcu/rcutorture.ko 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace 2023-12-22T08:24:21.277 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/asn1_encoder.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-22T08:24:21.278 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/lib/zstd/zstd_compress.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-22T08:24:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q 2023-12-22T08:24:21.280 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-22T08:24:21.281 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-22T08:24:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/failover.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-22T08:24:21.283 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dns_resolver/dns_resolver.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-22T08:24:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-22T08:24:21.285 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-22T08:24:21.286 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-22T08:24:21.287 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-22T08:24:21.288 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-22T08:24:21.289 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-22T08:24:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-22T08:24:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-22T08:24:21.292 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-22T08:24:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-22T08:24:21.294 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-22T08:24:21.295 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_quota.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tunnel.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-22T08:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-22T08:24:21.297 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-22T08:24:21.298 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-22T08:24:21.299 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-22T08:24:21.300 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch 2023-12-22T08:24:21.301 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-22T08:24:21.302 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-22T08:24:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-22T08:24:21.304 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp 2023-12-22T08:24:21.305 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-22T08:24:21.306 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/security/keys/trusted-keys/trusted.ko 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt 2023-12-22T08:24:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-22T08:24:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-22T08:24:21.309 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-22T08:24:21.309 DEBUG:teuthology.orchestra.run.smithi081:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:postinstall scriptlet (using /bin/sh): 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g623393c9d50c -a -r /boot/System.map-6.6.0-g623393c9d50c ]; then 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:cp /boot/vmlinuz-6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:cp /boot/System.map-6.6.0-g623393c9d50c /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:rm -f /boot/vmlinuz-6.6.0-g623393c9d50c /boot/System.map-6.6.0-g623393c9d50c 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/installkernel 6.6.0-g623393c9d50c /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:rm -f /boot/.vmlinuz-6.6.0-g623393c9d50c-rpm /boot/.System.map-6.6.0-g623393c9d50c-rpm 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-22T08:24:21.332 INFO:teuthology.orchestra.run.smithi081.stdout:new-kernel-pkg --remove 6.6.0-g623393c9d50c --rminitrd --initrdfile=/boot/initramfs-6.6.0-g623393c9d50c.img 2023-12-22T08:24:21.333 INFO:teuthology.orchestra.run.smithi081.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-22T08:24:21.333 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-install remove 6.6.0-g623393c9d50c 2023-12-22T08:24:21.333 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-12-22T08:24:21.333 INFO:teuthology.orchestra.run.smithi081.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-22T08:24:21.333 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-22T08:24:21.333 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/update-bootloader --remove 6.6.0-g623393c9d50c 2023-12-22T08:24:21.333 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-12-22T08:24:21.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 68.el9 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8264254 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2023-12-22T08:24:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:24:21.414 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2023-12-22T08:24:21.415 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-22T08:24:21.415 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 6.6.0-g623393c9d50c 2023-12-22T08:24:21.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-22T08:24:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2023-12-22T08:24:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-22T08:24:23.403 INFO:teuthology.orchestra.run.smithi081.stderr:done 2023-12-22T08:24:23.405 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-12-22T08:24:23.420 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.P1lO0BMOaK 2023-12-22T08:24:23.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.P1lO0BMOaK 2023-12-22T08:24:23.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.P1lO0BMOaK 2023-12-22T08:24:23.650 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.P1lO0BMOaK is 6KB 2023-12-22T08:24:23.702 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.P1lO0BMOaK 2023-12-22T08:24:23.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2023-12-22T08:24:23.781 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-22T08:24:23.781 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-22T08:24:23.782 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-22T08:24:23.782 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c.conf 2023-12-22T08:24:23.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g623393c9d50c 2023-12-22T08:24:23.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2023-12-22T08:24:53.930 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-22T08:24:53.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T08:24:53.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:25:28.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T08:25:37.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T08:25:37.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:25:55.986 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T08:26:07.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T08:26:07.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:26:11.058 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-22T08:26:26.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T08:26:26.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:26:26.532 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-12-22T08:26:27.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T08:26:27.142 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g623393c9d50c"... 2023-12-22T08:26:27.142 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-12-22T08:26:27.186 INFO:teuthology.orchestra.run.smithi081.stdout:6.6.0-g623393c9d50c 2023-12-22T08:26:27.189 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-22T08:26:27.189 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-22T08:26:27.189 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-22T08:26:28.190 DEBUG:teuthology.parallel:result is None 2023-12-22T08:26:28.191 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-22T08:26:28.198 INFO:teuthology.task.internal:Creating test directory... 2023-12-22T08:26:28.198 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T08:26:28.201 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T08:26:28.204 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T08:26:28.247 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-22T08:26:28.276 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-22T08:26:28.287 INFO:teuthology.task.internal:Creating archive directory... 2023-12-22T08:26:28.288 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T08:26:28.290 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T08:26:28.292 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T08:26:28.410 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-22T08:26:28.419 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-22T08:26:28.419 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T08:26:28.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:26:28.437 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T08:26:28.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:26:28.454 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T08:26:28.480 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T08:26:28.497 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T08:26:28.521 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:28.536 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:28.543 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:28.560 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:28.703 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:28.782 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T08:26:28.790 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-22T08:26:28.798 INFO:teuthology.task.internal:Configuring sudo... 2023-12-22T08:26:28.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T08:26:28.801 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T08:26:28.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T08:26:28.952 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-22T08:26:28.963 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-22T08:26:28.964 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T08:26:28.966 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T08:26:28.969 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T08:26:29.054 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:29.098 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:29.160 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:29.204 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:29.253 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:26:29.253 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T08:26:29.325 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:29.370 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:29.427 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:29.509 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:29.556 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:26:29.556 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T08:26:29.625 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:29.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T08:26:29.887 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:29.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T08:26:30.046 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:26:30.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T08:26:30.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2023-12-22T08:26:30.124 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2023-12-22T08:26:30.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-12-22T08:26:30.168 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:26:30.169 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:26:30.280 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:26:30.569 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-22T08:26:30.581 INFO:teuthology.task.internal:Starting timer... 2023-12-22T08:26:30.582 INFO:teuthology.run_tasks:Running task pcp... 2023-12-22T08:26:30.606 INFO:teuthology.run_tasks:Running task selinux... 2023-12-22T08:26:30.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2023-12-22T08:26:30.706 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2023-12-22T08:26:30.708 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2023-12-22T08:26:30.765 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2023-12-22T08:26:30.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2023-12-22T08:26:30.881 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2023-12-22T08:26:30.885 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-22T08:26:30.889 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2023-12-22T08:26:30.913 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2023-12-22T08:26:30.913 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2023-12-22T08:26:30.945 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2023-12-22T08:26:30.945 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2023-12-22T08:26:30.998 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2023-12-22T08:26:30.999 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi081.front.sepia.ceph.com': 'permissive'} 2023-12-22T08:26:30.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:26:31.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:26:31.032 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:26:31.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:26:31.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:26:31.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:26:31.148 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-22T08:26:31.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2023-12-22T08:26:31.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2023-12-22T08:26:31.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2023-12-22T08:26:31.327 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-22T08:26:31.337 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-22T08:26:31.358 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-22T08:26:31.359 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi069.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-22T08:36:37.402 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com')] 2023-12-22T08:36:37.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-12-22T08:36:37.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:37.506 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-12-22T08:36:37.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-12-22T08:36:37.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-22T08:36:37.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:37.663 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-12-22T08:36:37.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-22T08:36:37.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T08:36:37.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T08:36:37.870 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-12-22T08:36:38.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-22T08:36:38.026 INFO:teuthology.run_tasks:Running task clock... 2023-12-22T08:36:38.037 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-22T08:36:38.037 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T08:36:38.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:36:38.040 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T08:36:38.040 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:36:38.043 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T08:36:38.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:36:38.076 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-22T08:36:38.077 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-22T08:36:38.094 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-22T08:36:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-22T08:36:38.125 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2023-12-22T08:36:38.137 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2023-12-22T08:36:38.139 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2023-12-22T08:36:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-22T08:36:38.154 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2023-12-22T08:36:38.156 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-22T08:36:38.173 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-22T08:36:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-22T08:36:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-22T08:36:38.201 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-22T08:36:38.217 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:36:38.220 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:36:38.220 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-12-22T08:36:38.220 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.220 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.221 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.221 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.244 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:36:38.247 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:36:38.247 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2023-12-22T08:36:38.247 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.247 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.248 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.248 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.294 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2023-12-22T08:36:38.333 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2023-12-22T08:36:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-22T08:36:38.438 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-22T08:36:38.566 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:36:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:36:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-12-22T08:36:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:36:38.576 INFO:teuthology.run_tasks:Running task install... 2023-12-22T08:36:38.584 DEBUG:teuthology.task.install:project ceph 2023-12-22T08:36:38.584 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}} 2023-12-22T08:36:38.585 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'} 2023-12-22T08:36:38.585 INFO:teuthology.task.install:Using flavor: default 2023-12-22T08:36:38.591 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-22T08:36:38.591 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-22T08:36:38.591 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-22T08:36:38.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:36:38.594 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-22T08:36:38.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:36:38.595 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-22T08:36:38.595 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:36:38.734 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-22T08:36:38.734 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-22T08:36:38.811 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-22T08:36:38.811 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-22T08:36:38.816 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-22T08:36:38.816 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-22T08:36:39.141 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-22T08:36:39.145 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:36:39.145 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-22T08:36:39.149 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-22T08:36:39.149 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:36:39.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-22T08:36:39.174 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-22T08:36:39.174 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-22T08:36:39.208 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-22T08:36:39.208 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:36:39.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-22T08:36:39.242 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-22T08:36:39.246 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-22T08:36:39.246 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-22T08:36:39.253 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-22T08:36:39.253 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-22T08:36:39.322 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-22T08:36:39.323 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-22T08:36:39.390 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2023-12-22T08:36:39.392 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2023-12-22T08:36:39.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-22T08:36:39.418 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-22T08:36:39.450 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2023-12-22T08:36:39.452 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2023-12-22T08:36:39.523 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-22T08:36:39.617 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2023-12-22T08:36:39.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2023-12-22T08:36:39.627 INFO:teuthology.orchestra.run.smithi069.stdout:73 files removed 2023-12-22T08:36:39.654 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-22T08:36:39.701 INFO:teuthology.orchestra.run.smithi031.stdout:73 files removed 2023-12-22T08:36:39.728 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-22T08:36:39.995 INFO:teuthology.orchestra.run.smithi081.stdout:73 files removed 2023-12-22T08:36:40.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-22T08:36:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 98 kB/s | 77 kB 00:00 2023-12-22T08:36:40.859 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 84 kB/s | 77 kB 00:00 2023-12-22T08:36:41.467 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 84 kB/s | 77 kB 00:00 2023-12-22T08:36:41.552 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 14 kB/s | 9.5 kB 00:00 2023-12-22T08:36:41.626 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 13 kB/s | 9.5 kB 00:00 2023-12-22T08:36:42.286 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2023-12-22T08:36:42.335 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2023-12-22T08:36:42.367 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 12 kB/s | 9.5 kB 00:00 2023-12-22T08:36:42.705 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-12-22T08:36:42.762 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-22T08:36:43.319 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2023-12-22T08:36:43.905 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-22T08:36:44.080 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - BaseOS 7.6 MB/s | 2.0 MB 00:00 2023-12-22T08:36:44.179 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2023-12-22T08:36:45.564 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2023-12-22T08:36:45.638 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 7.9 MB 00:01 2023-12-22T08:36:47.327 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 7.9 MB 00:01 2023-12-22T08:36:49.352 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-12-22T08:36:49.369 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 7.9 MB 00:04 2023-12-22T08:36:54.437 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 5.8 MB 00:01 2023-12-22T08:36:56.271 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2023-12-22T08:36:56.795 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 18 MB 00:06 2023-12-22T08:36:58.095 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-22T08:37:02.137 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 5.8 MB 00:01 2023-12-22T08:37:03.796 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2023-12-22T08:37:03.798 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2023-12-22T08:37:04.931 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:00 2023-12-22T08:37:06.656 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:37:06.657 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:37:06.681 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-22T08:37:06.682 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-22T08:37:06.683 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-22T08:37:06.685 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-22T08:37:06.687 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T08:37:06.691 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-22T08:37:06.693 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-22T08:37:06.774 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================================ 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================================ 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-22T08:37:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-22T08:37:06.794 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-22T08:37:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.45.9-1.el9 CentOS-BaseOS 2.2 M 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.45.9-1.el9 CentOS-BaseOS 1.8 M 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.45.9-1.el9 CentOS-BaseOS 42 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.45.9-1.el9 CentOS-BaseOS 246 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-22T08:37:06.796 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-22T08:37:06.797 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-22T08:37:06.798 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-22T08:37:06.799 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-22T08:37:06.800 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.25.2-1.el9 epel 199 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-22T08:37:06.801 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-22T08:37:06.802 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-22T08:37:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2023-12-22T08:37:06.804 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-22T08:37:06.805 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:37:06.805 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-12-22T08:37:06.805 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================================ 2023-12-22T08:37:06.805 INFO:teuthology.orchestra.run.smithi081.stdout:Install 139 Packages 2023-12-22T08:37:06.805 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 16 Packages 2023-12-22T08:37:06.805 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:37:06.806 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 200 M 2023-12-22T08:37:06.806 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-12-22T08:37:07.211 INFO:teuthology.orchestra.run.smithi081.stdout:(1/155): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 22 kB/s | 6.5 kB 00:00 2023-12-22T08:37:08.038 INFO:teuthology.orchestra.run.smithi081.stdout:(2/155): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.0 MB/s | 839 kB 00:00 2023-12-22T08:37:08.178 INFO:teuthology.orchestra.run.smithi081.stdout:(3/155): ceph-immutable-object-cache-18.2.0-137 1.0 MB/s | 142 kB 00:00 2023-12-22T08:37:08.603 INFO:teuthology.orchestra.run.smithi081.stdout:(4/155): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 3.1 MB/s | 5.2 MB 00:01 2023-12-22T08:37:08.954 INFO:teuthology.orchestra.run.smithi081.stdout:(5/155): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 4.1 MB/s | 1.4 MB 00:00 2023-12-22T08:37:09.104 INFO:teuthology.orchestra.run.smithi081.stdout:(6/155): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 2.3 MB/s | 2.1 MB 00:00 2023-12-22T08:37:09.822 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-12-22T08:37:10.021 INFO:teuthology.orchestra.run.smithi081.stdout:(7/155): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 4.1 MB/s | 4.4 MB 00:01 2023-12-22T08:37:11.646 INFO:teuthology.orchestra.run.smithi081.stdout:(8/155): ceph-common-18.2.0-1377.g24e2e32a.el9. 3.9 MB/s | 18 MB 00:04 2023-12-22T08:37:11.738 INFO:teuthology.orchestra.run.smithi081.stdout:(9/155): ceph-selinux-18.2.0-1377.g24e2e32a.el9 266 kB/s | 24 kB 00:00 2023-12-22T08:37:12.391 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:37:12.392 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:37:12.404 INFO:teuthology.orchestra.run.smithi069.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-22T08:37:12.404 INFO:teuthology.orchestra.run.smithi069.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-22T08:37:12.405 INFO:teuthology.orchestra.run.smithi069.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-22T08:37:12.406 INFO:teuthology.orchestra.run.smithi069.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-22T08:37:12.408 INFO:teuthology.orchestra.run.smithi069.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T08:37:12.410 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-22T08:37:12.411 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-22T08:37:12.485 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-22T08:37:12.505 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2023-12-22T08:37:12.505 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-22T08:37:12.506 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-22T08:37:12.507 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2023-12-22T08:37:12.508 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager x86_64 1:1.45.9-1.el9 CentOS-BaseOS 2.2 M 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-libnm x86_64 1:1.45.9-1.el9 CentOS-BaseOS 1.8 M 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-team x86_64 1:1.45.9-1.el9 CentOS-BaseOS 42 k 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-tui x86_64 1:1.45.9-1.el9 CentOS-BaseOS 246 k 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:37:12.509 INFO:teuthology.orchestra.run.smithi069.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:37:12.510 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-22T08:37:12.511 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2023-12-22T08:37:12.512 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-22T08:37:12.513 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:2.25.2-1.el9 epel 199 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-22T08:37:12.514 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-22T08:37:12.515 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2023-12-22T08:37:12.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout:Installing weak dependencies: 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-22T08:37:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:37:12.518 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-12-22T08:37:12.518 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2023-12-22T08:37:12.518 INFO:teuthology.orchestra.run.smithi069.stdout:Install 139 Packages 2023-12-22T08:37:12.518 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 16 Packages 2023-12-22T08:37:12.518 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:37:12.518 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 200 M 2023-12-22T08:37:12.519 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-12-22T08:37:12.555 INFO:teuthology.orchestra.run.smithi081.stdout:(10/155): ceph-radosgw-18.2.0-1377.g24e2e32a.el 3.0 MB/s | 7.7 MB 00:02 2023-12-22T08:37:12.789 INFO:teuthology.orchestra.run.smithi081.stdout:(11/155): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 4.8 MB/s | 18 MB 00:03 2023-12-22T08:37:12.842 INFO:teuthology.orchestra.run.smithi081.stdout:(12/155): cephfs-mirror-18.2.0-1377.g24e2e32a.e 768 kB/s | 219 kB 00:00 2023-12-22T08:37:12.872 INFO:teuthology.orchestra.run.smithi081.stdout:(13/155): cephfs-shell-18.2.0-1377.g24e2e32a.el 328 kB/s | 27 kB 00:00 2023-12-22T08:37:12.922 INFO:teuthology.orchestra.run.smithi081.stdout:(14/155): libcephfs-devel-18.2.0-1377.g24e2e32a 389 kB/s | 31 kB 00:00 2023-12-22T08:37:13.015 INFO:teuthology.orchestra.run.smithi081.stdout:(15/155): libcephsqlite-18.2.0-1377.g24e2e32a.e 1.8 MB/s | 166 kB 00:00 2023-12-22T08:37:13.048 INFO:teuthology.orchestra.run.smithi069.stdout:(1/155): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 29 kB/s | 6.5 kB 00:00 2023-12-22T08:37:13.106 INFO:teuthology.orchestra.run.smithi081.stdout:(16/155): libcephfs2-18.2.0-1377.g24e2e32a.el9. 2.8 MB/s | 658 kB 00:00 2023-12-22T08:37:13.140 INFO:teuthology.orchestra.run.smithi081.stdout:(17/155): librados-devel-18.2.0-1377.g24e2e32a. 1.0 MB/s | 127 kB 00:00 2023-12-22T08:37:13.328 INFO:teuthology.orchestra.run.smithi081.stdout:(18/155): libradosstriper1-18.2.0-1377.g24e2e32 2.1 MB/s | 474 kB 00:00 2023-12-22T08:37:13.440 INFO:teuthology.orchestra.run.smithi081.stdout:(19/155): python3-ceph-argparse-18.2.0-1377.g24 405 kB/s | 45 kB 00:00 2023-12-22T08:37:13.549 INFO:teuthology.orchestra.run.smithi081.stdout:(20/155): python3-ceph-common-18.2.0-1377.g24e2 1.1 MB/s | 124 kB 00:00 2023-12-22T08:37:13.657 INFO:teuthology.orchestra.run.smithi081.stdout:(21/155): python3-cephfs-18.2.0-1377.g24e2e32a. 1.5 MB/s | 162 kB 00:00 2023-12-22T08:37:13.849 INFO:teuthology.orchestra.run.smithi069.stdout:(2/155): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.0 MB/s | 839 kB 00:00 2023-12-22T08:37:13.866 INFO:teuthology.orchestra.run.smithi081.stdout:(22/155): python3-rados-18.2.0-1377.g24e2e32a.e 1.5 MB/s | 319 kB 00:00 2023-12-22T08:37:14.007 INFO:teuthology.orchestra.run.smithi069.stdout:(3/155): ceph-immutable-object-cache-18.2.0-137 902 kB/s | 142 kB 00:00 2023-12-22T08:37:14.058 INFO:teuthology.orchestra.run.smithi081.stdout:(23/155): python3-rbd-18.2.0-1377.g24e2e32a.el9 1.5 MB/s | 297 kB 00:00 2023-12-22T08:37:14.175 INFO:teuthology.orchestra.run.smithi081.stdout:(24/155): python3-rgw-18.2.0-1377.g24e2e32a.el9 853 kB/s | 99 kB 00:00 2023-12-22T08:37:14.301 INFO:teuthology.orchestra.run.smithi081.stdout:(25/155): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 697 kB/s | 87 kB 00:00 2023-12-22T08:37:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:(26/155): librgw2-18.2.0-1377.g24e2e32a.el9.x86 2.6 MB/s | 4.5 MB 00:01 2023-12-22T08:37:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:(27/155): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.6 MB/s | 171 kB 00:00 2023-12-22T08:37:15.060 INFO:teuthology.orchestra.run.smithi081.stdout:(28/155): ceph-grafana-dashboards-18.2.0-1377.g 199 kB/s | 23 kB 00:00 2023-12-22T08:37:15.177 INFO:teuthology.orchestra.run.smithi081.stdout:(29/155): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.1 MB/s | 132 kB 00:00 2023-12-22T08:37:15.588 INFO:teuthology.orchestra.run.smithi081.stdout:(30/155): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 2.3 MB/s | 3.0 MB 00:01 2023-12-22T08:37:15.641 INFO:teuthology.orchestra.run.smithi069.stdout:(4/155): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 1.3 MB/s | 2.1 MB 00:01 2023-12-22T08:37:15.983 INFO:teuthology.orchestra.run.smithi069.stdout:(5/155): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 1.6 MB/s | 5.2 MB 00:03 2023-12-22T08:37:16.071 INFO:teuthology.orchestra.run.smithi081.stdout:(31/155): ceph-mgr-dashboard-18.2.0-1377.g24e2e 2.0 MB/s | 1.8 MB 00:00 2023-12-22T08:37:16.280 INFO:teuthology.orchestra.run.smithi081.stdout:(32/155): ceph-mgr-modules-core-18.2.0-1377.g24 1.1 MB/s | 242 kB 00:00 2023-12-22T08:37:16.397 INFO:teuthology.orchestra.run.smithi081.stdout:(33/155): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 433 kB/s | 50 kB 00:00 2023-12-22T08:37:16.505 INFO:teuthology.orchestra.run.smithi081.stdout:(34/155): ceph-prometheus-alerts-18.2.0-1377.g2 136 kB/s | 15 kB 00:00 2023-12-22T08:37:16.641 INFO:teuthology.orchestra.run.smithi069.stdout:(6/155): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 1.4 MB/s | 1.4 MB 00:00 2023-12-22T08:37:16.814 INFO:teuthology.orchestra.run.smithi081.stdout:(35/155): ceph-volume-18.2.0-1377.g24e2e32a.el9 854 kB/s | 262 kB 00:00 2023-12-22T08:37:17.023 INFO:teuthology.orchestra.run.smithi081.stdout:(36/155): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.0 MB/s | 221 kB 00:00 2023-12-22T08:37:17.173 INFO:teuthology.orchestra.run.smithi081.stdout:(37/155): cephfs-top-18.2.0-1377.g24e2e32a.el9. 121 kB/s | 18 kB 00:00 2023-12-22T08:37:17.398 INFO:teuthology.orchestra.run.smithi081.stdout:(38/155): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 662 kB 00:00 2023-12-22T08:37:17.490 INFO:teuthology.orchestra.run.smithi081.stdout:(39/155): bison-3.7.4-5.el9.x86_64.rpm 9.9 MB/s | 920 kB 00:00 2023-12-22T08:37:17.532 INFO:teuthology.orchestra.run.smithi081.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-12-22T08:37:17.566 INFO:teuthology.orchestra.run.smithi081.stdout:(41/155): elfutils-libelf-devel-0.190-2.el9.x86 622 kB/s | 20 kB 00:00 2023-12-22T08:37:17.641 INFO:teuthology.orchestra.run.smithi081.stdout:(42/155): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 307 kB 00:00 2023-12-22T08:37:17.675 INFO:teuthology.orchestra.run.smithi081.stdout:(43/155): flexiblas-3.0.4-8.el9.x86_64.rpm 966 kB/s | 32 kB 00:00 2023-12-22T08:37:17.783 INFO:teuthology.orchestra.run.smithi081.stdout:(44/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-12-22T08:37:17.808 INFO:teuthology.orchestra.run.smithi081.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 711 kB/s | 17 kB 00:00 2023-12-22T08:37:17.834 INFO:teuthology.orchestra.run.smithi081.stdout:(46/155): libaio-devel-0.3.111-13.el9.x86_64.rp 413 kB/s | 10 kB 00:00 2023-12-22T08:37:17.876 INFO:teuthology.orchestra.run.smithi081.stdout:(47/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-12-22T08:37:17.909 INFO:teuthology.orchestra.run.smithi081.stdout:(48/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-22T08:37:17.959 INFO:teuthology.orchestra.run.smithi081.stdout:(49/155): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-22T08:37:18.010 INFO:teuthology.orchestra.run.smithi081.stdout:(50/155): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-12-22T08:37:18.043 INFO:teuthology.orchestra.run.smithi081.stdout:(51/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 747 kB/s | 24 kB 00:00 2023-12-22T08:37:18.077 INFO:teuthology.orchestra.run.smithi081.stdout:(52/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-22T08:37:18.136 INFO:teuthology.orchestra.run.smithi081.stdout:(53/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-22T08:37:18.170 INFO:teuthology.orchestra.run.smithi081.stdout:(54/155): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-22T08:37:18.299 INFO:teuthology.orchestra.run.smithi069.stdout:(7/155): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 1.9 MB/s | 4.4 MB 00:02 2023-12-22T08:37:18.312 INFO:teuthology.orchestra.run.smithi081.stdout:(55/155): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2023-12-22T08:37:18.412 INFO:teuthology.orchestra.run.smithi081.stdout:(56/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2023-12-22T08:37:18.487 INFO:teuthology.orchestra.run.smithi081.stdout:(57/155): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2023-12-22T08:37:18.546 INFO:teuthology.orchestra.run.smithi081.stdout:(58/155): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2023-12-22T08:37:18.605 INFO:teuthology.orchestra.run.smithi081.stdout:(59/155): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-12-22T08:37:18.863 INFO:teuthology.orchestra.run.smithi081.stdout:(60/155): postgresql-server-13.11-1.el9.x86_64. 22 MB/s | 5.7 MB 00:00 2023-12-22T08:37:18.905 INFO:teuthology.orchestra.run.smithi081.stdout:(61/155): python3-attrs-20.3.0-7.el9.noarch.rpm 1.9 MB/s | 78 kB 00:00 2023-12-22T08:37:19.106 INFO:teuthology.orchestra.run.smithi081.stdout:(62/155): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2023-12-22T08:37:19.147 INFO:teuthology.orchestra.run.smithi081.stdout:(63/155): python3-jinja2-2.11.3-4.el9.noarch.rp 5.5 MB/s | 228 kB 00:00 2023-12-22T08:37:19.181 INFO:teuthology.orchestra.run.smithi081.stdout:(64/155): python3-jsonpatch-1.21-16.el9.noarch. 749 kB/s | 24 kB 00:00 2023-12-22T08:37:19.215 INFO:teuthology.orchestra.run.smithi081.stdout:(65/155): python3-jsonpointer-2.0-4.el9.noarch. 554 kB/s | 18 kB 00:00 2023-12-22T08:37:19.257 INFO:teuthology.orchestra.run.smithi081.stdout:(66/155): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-12-22T08:37:19.290 INFO:teuthology.orchestra.run.smithi081.stdout:(67/155): python3-markupsafe-1.1.1-12.el9.x86_6 972 kB/s | 32 kB 00:00 2023-12-22T08:37:19.441 INFO:teuthology.orchestra.run.smithi081.stdout:(68/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-12-22T08:37:19.599 INFO:teuthology.orchestra.run.smithi081.stdout:(69/155): ceph-mgr-diskprediction-local-18.2.0- 1.8 MB/s | 7.4 MB 00:04 2023-12-22T08:37:19.633 INFO:teuthology.orchestra.run.smithi081.stdout:(70/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-12-22T08:37:19.658 INFO:teuthology.orchestra.run.smithi081.stdout:(71/155): python3-oauthlib-3.1.1-5.el9.noarch.r 3.1 MB/s | 174 kB 00:00 2023-12-22T08:37:19.683 INFO:teuthology.orchestra.run.smithi081.stdout:(72/155): python3-prettytable-0.7.2-27.el9.noar 853 kB/s | 41 kB 00:00 2023-12-22T08:37:19.709 INFO:teuthology.orchestra.run.smithi081.stdout:(73/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-22T08:37:19.742 INFO:teuthology.orchestra.run.smithi081.stdout:(74/155): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2023-12-22T08:37:19.767 INFO:teuthology.orchestra.run.smithi081.stdout:(75/155): python3-pytz-2021.1-5.el9.noarch.rpm 848 kB/s | 47 kB 00:00 2023-12-22T08:37:19.793 INFO:teuthology.orchestra.run.smithi081.stdout:(76/155): python3-requests-oauthlib-1.3.0-12.el 875 kB/s | 43 kB 00:00 2023-12-22T08:37:20.143 INFO:teuthology.orchestra.run.smithi081.stdout:(77/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2023-12-22T08:37:20.168 INFO:teuthology.orchestra.run.smithi081.stdout:(78/155): python3-toml-0.10.2-6.el9.noarch.rpm 108 kB/s | 39 kB 00:00 2023-12-22T08:37:20.210 INFO:teuthology.orchestra.run.smithi081.stdout:(79/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 41 kB 00:00 2023-12-22T08:37:20.235 INFO:teuthology.orchestra.run.smithi081.stdout:(80/155): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 300 kB 00:00 2023-12-22T08:37:20.269 INFO:teuthology.orchestra.run.smithi081.stdout:(81/155): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2023-12-22T08:37:20.294 INFO:teuthology.orchestra.run.smithi081.stdout:(82/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-12-22T08:37:20.328 INFO:teuthology.orchestra.run.smithi081.stdout:(83/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2023-12-22T08:37:20.486 INFO:teuthology.orchestra.run.smithi081.stdout:(84/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 231 kB/s | 44 kB 00:00 2023-12-22T08:37:20.528 INFO:teuthology.orchestra.run.smithi081.stdout:(85/155): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2023-12-22T08:37:20.554 INFO:teuthology.orchestra.run.smithi081.stdout:(86/155): jq-1.6-16.el9.x86_64.rpm 2.8 MB/s | 186 kB 00:00 2023-12-22T08:37:20.621 INFO:teuthology.orchestra.run.smithi081.stdout:(87/155): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-12-22T08:37:20.663 INFO:teuthology.orchestra.run.smithi081.stdout:(88/155): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.3 MB/s | 803 kB 00:00 2023-12-22T08:37:20.696 INFO:teuthology.orchestra.run.smithi081.stdout:(89/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.1 MB/s | 217 kB 00:00 2023-12-22T08:37:20.730 INFO:teuthology.orchestra.run.smithi081.stdout:(90/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-12-22T08:37:20.780 INFO:teuthology.orchestra.run.smithi081.stdout:(91/155): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-22T08:37:20.805 INFO:teuthology.orchestra.run.smithi081.stdout:(92/155): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-12-22T08:37:20.831 INFO:teuthology.orchestra.run.smithi081.stdout:(93/155): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-12-22T08:37:20.856 INFO:teuthology.orchestra.run.smithi081.stdout:(94/155): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-12-22T08:37:20.881 INFO:teuthology.orchestra.run.smithi081.stdout:(95/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.8 MB/s | 187 kB 00:00 2023-12-22T08:37:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:(96/155): fmt-8.1.1-5.el9.x86_64.rpm 277 kB/s | 111 kB 00:00 2023-12-22T08:37:21.490 INFO:teuthology.orchestra.run.smithi081.stdout:(97/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.5 MB/s | 309 kB 00:00 2023-12-22T08:37:21.516 INFO:teuthology.orchestra.run.smithi081.stdout:(98/155): python3-devel-3.9.17-2.el9.x86_64.rpm 374 kB/s | 245 kB 00:00 2023-12-22T08:37:21.866 INFO:teuthology.orchestra.run.smithi081.stdout:(99/155): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2023-12-22T08:37:21.891 INFO:teuthology.orchestra.run.smithi081.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 69 kB/s | 26 kB 00:00 2023-12-22T08:37:21.950 INFO:teuthology.orchestra.run.smithi081.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 587 kB/s | 49 kB 00:00 2023-12-22T08:37:22.050 INFO:teuthology.orchestra.run.smithi081.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 427 kB/s | 67 kB 00:00 2023-12-22T08:37:22.100 INFO:teuthology.orchestra.run.smithi081.stdout:(103/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.5 MB/s | 838 kB 00:00 2023-12-22T08:37:22.184 INFO:teuthology.orchestra.run.smithi081.stdout:(104/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 526 kB/s | 43 kB 00:00 2023-12-22T08:37:22.268 INFO:teuthology.orchestra.run.smithi081.stdout:(105/155): python3-cachetools-4.2.4-1.el9.noarc 390 kB/s | 32 kB 00:00 2023-12-22T08:37:22.310 INFO:teuthology.orchestra.run.smithi081.stdout:(106/155): python3-asyncssh-2.13.2-3.el9.noarch 2.1 MB/s | 548 kB 00:00 2023-12-22T08:37:22.351 INFO:teuthology.orchestra.run.smithi081.stdout:(107/155): python3-certifi-2021.10.8-2.el9.noar 181 kB/s | 15 kB 00:00 2023-12-22T08:37:22.391 INFO:teuthology.orchestra.run.smithi069.stdout:(8/155): ceph-radosgw-18.2.0-1377.g24e2e32a.el9 1.9 MB/s | 7.7 MB 00:04 2023-12-22T08:37:22.401 INFO:teuthology.orchestra.run.smithi081.stdout:(108/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2023-12-22T08:37:22.435 INFO:teuthology.orchestra.run.smithi081.stdout:(109/155): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2023-12-22T08:37:22.483 INFO:teuthology.orchestra.run.smithi069.stdout:(9/155): ceph-selinux-18.2.0-1377.g24e2e32a.el9 264 kB/s | 24 kB 00:00 2023-12-22T08:37:22.544 INFO:teuthology.orchestra.run.smithi081.stdout:(110/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2023-12-22T08:37:22.569 INFO:teuthology.orchestra.run.smithi081.stdout:(111/155): python3-colorama-0.4.4-12.el9.noarch 265 kB/s | 35 kB 00:00 2023-12-22T08:37:22.645 INFO:teuthology.orchestra.run.smithi081.stdout:(112/155): python3-google-auth-2.25.2-1.el9.noa 2.0 MB/s | 199 kB 00:00 2023-12-22T08:37:22.670 INFO:teuthology.orchestra.run.smithi081.stdout:(113/155): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-12-22T08:37:22.720 INFO:teuthology.orchestra.run.smithi081.stdout:(114/155): python3-jaraco-classes-3.2.1-5.el9.n 238 kB/s | 18 kB 00:00 2023-12-22T08:37:22.745 INFO:teuthology.orchestra.run.smithi081.stdout:(115/155): python3-jaraco-collections-3.0.0-8.e 310 kB/s | 23 kB 00:00 2023-12-22T08:37:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:(116/155): python3-jaraco-functools-3.5.0-2.el9 260 kB/s | 19 kB 00:00 2023-12-22T08:37:22.813 INFO:teuthology.orchestra.run.smithi081.stdout:(117/155): python3-jaraco-text-3.2.0-6.el9.noar 296 kB/s | 20 kB 00:00 2023-12-22T08:37:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:(118/155): python3-jwt+crypto-2.4.0-1.el9.noarc 137 kB/s | 9.0 kB 00:00 2023-12-22T08:37:22.880 INFO:teuthology.orchestra.run.smithi081.stdout:(119/155): python3-jwt-2.4.0-1.el9.noarch.rpm 619 kB/s | 41 kB 00:00 2023-12-22T08:37:22.993 INFO:teuthology.orchestra.run.smithi081.stdout:(120/155): python3-kubernetes-26.1.0-2.el9.noar 7.9 MB/s | 1.0 MB 00:00 2023-12-22T08:37:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 327 kB/s | 46 kB 00:00 2023-12-22T08:37:23.081 INFO:teuthology.orchestra.run.smithi081.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 912 kB/s | 79 kB 00:00 2023-12-22T08:37:23.106 INFO:teuthology.orchestra.run.smithi081.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 696 kB/s | 58 kB 00:00 2023-12-22T08:37:23.165 INFO:teuthology.orchestra.run.smithi081.stdout:(124/155): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-12-22T08:37:23.190 INFO:teuthology.orchestra.run.smithi081.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2023-12-22T08:37:23.249 INFO:teuthology.orchestra.run.smithi081.stdout:(126/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2023-12-22T08:37:23.274 INFO:teuthology.orchestra.run.smithi081.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 340 kB/s | 28 kB 00:00 2023-12-22T08:37:23.324 INFO:teuthology.orchestra.run.smithi081.stdout:(128/155): python3-repoze-lru-0.7-16.el9.noarch 413 kB/s | 31 kB 00:00 2023-12-22T08:37:23.358 INFO:teuthology.orchestra.run.smithi081.stdout:(129/155): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-12-22T08:37:23.408 INFO:teuthology.orchestra.run.smithi081.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 715 kB/s | 59 kB 00:00 2023-12-22T08:37:23.480 INFO:teuthology.orchestra.run.smithi081.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 296 kB/s | 36 kB 00:00 2023-12-22T08:37:23.509 INFO:teuthology.orchestra.run.smithi081.stdout:(132/155): python3-typing-extensions-4.4.0-2.el 513 kB/s | 51 kB 00:00 2023-12-22T08:37:23.576 INFO:teuthology.orchestra.run.smithi081.stdout:(133/155): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-12-22T08:37:23.601 INFO:teuthology.orchestra.run.smithi081.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 980 kB/s | 90 kB 00:00 2023-12-22T08:37:23.685 INFO:teuthology.orchestra.run.smithi081.stdout:(135/155): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2023-12-22T08:37:23.710 INFO:teuthology.orchestra.run.smithi081.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2023-12-22T08:37:23.785 INFO:teuthology.orchestra.run.smithi081.stdout:(137/155): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-12-22T08:37:23.852 INFO:teuthology.orchestra.run.smithi081.stdout:(138/155): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-22T08:37:26.367 INFO:teuthology.orchestra.run.smithi081.stdout:(139/155): librbd1-18.2.0-1377.g24e2e32a.el9.x8 1.2 MB/s | 3.0 MB 00:02 2023-12-22T08:37:26.411 INFO:teuthology.orchestra.run.smithi081.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 68 kB 00:00 2023-12-22T08:37:26.503 INFO:teuthology.orchestra.run.smithi081.stdout:(141/155): NetworkManager-1.45.9-1.el9.x86_64.r 25 MB/s | 2.2 MB 00:00 2023-12-22T08:37:26.562 INFO:teuthology.orchestra.run.smithi081.stdout:(142/155): librados2-18.2.0-1377.g24e2e32a.el9. 1.2 MB/s | 3.3 MB 00:02 2023-12-22T08:37:26.629 INFO:teuthology.orchestra.run.smithi081.stdout:(143/155): NetworkManager-libnm-1.45.9-1.el9.x8 14 MB/s | 1.8 MB 00:00 2023-12-22T08:37:26.654 INFO:teuthology.orchestra.run.smithi081.stdout:(144/155): NetworkManager-team-1.45.9-1.el9.x86 541 kB/s | 42 kB 00:00 2023-12-22T08:37:26.688 INFO:teuthology.orchestra.run.smithi081.stdout:(145/155): NetworkManager-tui-1.45.9-1.el9.x86_ 4.2 MB/s | 246 kB 00:00 2023-12-22T08:37:26.713 INFO:teuthology.orchestra.run.smithi081.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-12-22T08:37:26.739 INFO:teuthology.orchestra.run.smithi081.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 724 kB/s | 35 kB 00:00 2023-12-22T08:37:26.772 INFO:teuthology.orchestra.run.smithi081.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 3.3 MB/s | 191 kB 00:00 2023-12-22T08:37:26.805 INFO:teuthology.orchestra.run.smithi081.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 3.9 MB/s | 254 kB 00:00 2023-12-22T08:37:26.853 INFO:teuthology.orchestra.run.smithi081.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 282 kB/s | 22 kB 00:00 2023-12-22T08:37:26.907 INFO:teuthology.orchestra.run.smithi081.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2023-12-22T08:37:26.998 INFO:teuthology.orchestra.run.smithi081.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 16 MB/s | 2.1 MB 00:00 2023-12-22T08:37:27.023 INFO:teuthology.orchestra.run.smithi081.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 2.9 MB/s | 321 kB 00:00 2023-12-22T08:37:27.090 INFO:teuthology.orchestra.run.smithi081.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2023-12-22T08:37:27.741 INFO:teuthology.orchestra.run.smithi069.stdout:(10/155): ceph-common-18.2.0-1377.g24e2e32a.el9 1.2 MB/s | 18 MB 00:14 2023-12-22T08:37:28.016 INFO:teuthology.orchestra.run.smithi069.stdout:(11/155): cephfs-mirror-18.2.0-1377.g24e2e32a.e 799 kB/s | 219 kB 00:00 2023-12-22T08:37:28.116 INFO:teuthology.orchestra.run.smithi069.stdout:(12/155): cephfs-shell-18.2.0-1377.g24e2e32a.el 271 kB/s | 27 kB 00:00 2023-12-22T08:37:28.242 INFO:teuthology.orchestra.run.smithi069.stdout:(13/155): libcephfs-devel-18.2.0-1377.g24e2e32a 248 kB/s | 31 kB 00:00 2023-12-22T08:37:28.884 INFO:teuthology.orchestra.run.smithi069.stdout:(14/155): libcephfs2-18.2.0-1377.g24e2e32a.el9. 1.0 MB/s | 658 kB 00:00 2023-12-22T08:37:29.092 INFO:teuthology.orchestra.run.smithi069.stdout:(15/155): libcephsqlite-18.2.0-1377.g24e2e32a.e 796 kB/s | 166 kB 00:00 2023-12-22T08:37:29.284 INFO:teuthology.orchestra.run.smithi069.stdout:(16/155): librados-devel-18.2.0-1377.g24e2e32a. 661 kB/s | 127 kB 00:00 2023-12-22T08:37:29.584 INFO:teuthology.orchestra.run.smithi069.stdout:(17/155): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 1.4 MB/s | 18 MB 00:12 2023-12-22T08:37:29.826 INFO:teuthology.orchestra.run.smithi069.stdout:(18/155): libradosstriper1-18.2.0-1377.g24e2e32 875 kB/s | 474 kB 00:00 2023-12-22T08:37:29.943 INFO:teuthology.orchestra.run.smithi069.stdout:(19/155): python3-ceph-argparse-18.2.0-1377.g24 386 kB/s | 45 kB 00:00 2023-12-22T08:37:30.152 INFO:teuthology.orchestra.run.smithi069.stdout:(20/155): python3-ceph-common-18.2.0-1377.g24e2 598 kB/s | 124 kB 00:00 2023-12-22T08:37:30.344 INFO:teuthology.orchestra.run.smithi069.stdout:(21/155): python3-cephfs-18.2.0-1377.g24e2e32a. 843 kB/s | 162 kB 00:00 2023-12-22T08:37:30.637 INFO:teuthology.orchestra.run.smithi069.stdout:(22/155): python3-rados-18.2.0-1377.g24e2e32a.e 1.1 MB/s | 319 kB 00:00 2023-12-22T08:37:30.936 INFO:teuthology.orchestra.run.smithi069.stdout:(23/155): python3-rbd-18.2.0-1377.g24e2e32a.el9 992 kB/s | 297 kB 00:00 2023-12-22T08:37:31.045 INFO:teuthology.orchestra.run.smithi069.stdout:(24/155): python3-rgw-18.2.0-1377.g24e2e32a.el9 918 kB/s | 99 kB 00:00 2023-12-22T08:37:31.161 INFO:teuthology.orchestra.run.smithi069.stdout:(25/155): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 742 kB/s | 87 kB 00:00 2023-12-22T08:37:32.128 INFO:teuthology.orchestra.run.smithi069.stdout:(26/155): librgw2-18.2.0-1377.g24e2e32a.el9.x86 1.8 MB/s | 4.5 MB 00:02 2023-12-22T08:37:32.287 INFO:teuthology.orchestra.run.smithi069.stdout:(27/155): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.1 MB/s | 171 kB 00:00 2023-12-22T08:37:32.378 INFO:teuthology.orchestra.run.smithi069.stdout:(28/155): ceph-grafana-dashboards-18.2.0-1377.g 253 kB/s | 23 kB 00:00 2023-12-22T08:37:32.470 INFO:teuthology.orchestra.run.smithi069.stdout:(29/155): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.4 MB/s | 132 kB 00:00 2023-12-22T08:37:33.321 INFO:teuthology.orchestra.run.smithi069.stdout:(30/155): ceph-mgr-dashboard-18.2.0-1377.g24e2e 2.1 MB/s | 1.8 MB 00:00 2023-12-22T08:37:33.929 INFO:teuthology.orchestra.run.smithi069.stdout:(31/155): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 1.1 MB/s | 3.0 MB 00:02 2023-12-22T08:37:34.165 INFO:teuthology.orchestra.run.smithi081.stdout:(155/155): ceph-test-18.2.0-1377.g24e2e32a.el9. 1.8 MB/s | 40 MB 00:22 2023-12-22T08:37:34.175 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:37:34.175 INFO:teuthology.orchestra.run.smithi081.stdout:Total 7.3 MB/s | 200 MB 00:27 2023-12-22T08:37:34.196 INFO:teuthology.orchestra.run.smithi069.stdout:(32/155): ceph-mgr-modules-core-18.2.0-1377.g24 908 kB/s | 242 kB 00:00 2023-12-22T08:37:34.234 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-12-22T08:37:34.313 INFO:teuthology.orchestra.run.smithi069.stdout:(33/155): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 431 kB/s | 50 kB 00:00 2023-12-22T08:37:34.430 INFO:teuthology.orchestra.run.smithi069.stdout:(34/155): ceph-prometheus-alerts-18.2.0-1377.g2 126 kB/s | 15 kB 00:00 2023-12-22T08:37:34.574 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-12-22T08:37:34.574 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-12-22T08:37:34.822 INFO:teuthology.orchestra.run.smithi069.stdout:(35/155): ceph-volume-18.2.0-1377.g24e2e32a.el9 670 kB/s | 262 kB 00:00 2023-12-22T08:37:35.122 INFO:teuthology.orchestra.run.smithi069.stdout:(36/155): cephadm-18.2.0-1377.g24e2e32a.el9.noa 738 kB/s | 221 kB 00:00 2023-12-22T08:37:35.241 INFO:teuthology.orchestra.run.smithi069.stdout:(37/155): cephfs-top-18.2.0-1377.g24e2e32a.el9. 152 kB/s | 18 kB 00:00 2023-12-22T08:37:35.375 INFO:teuthology.orchestra.run.smithi069.stdout:(38/155): automake-1.16.2-8.el9.noarch.rpm 4.9 MB/s | 662 kB 00:00 2023-12-22T08:37:35.433 INFO:teuthology.orchestra.run.smithi069.stdout:(39/155): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2023-12-22T08:37:35.459 INFO:teuthology.orchestra.run.smithi069.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 4.1 MB/s | 106 kB 00:00 2023-12-22T08:37:35.484 INFO:teuthology.orchestra.run.smithi069.stdout:(41/155): elfutils-libelf-devel-0.190-2.el9.x86 821 kB/s | 20 kB 00:00 2023-12-22T08:37:35.526 INFO:teuthology.orchestra.run.smithi069.stdout:(42/155): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-12-22T08:37:35.551 INFO:teuthology.orchestra.run.smithi069.stdout:(43/155): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2023-12-22T08:37:35.643 INFO:teuthology.orchestra.run.smithi069.stdout:(44/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-12-22T08:37:35.669 INFO:teuthology.orchestra.run.smithi069.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 685 kB/s | 17 kB 00:00 2023-12-22T08:37:35.694 INFO:teuthology.orchestra.run.smithi069.stdout:(46/155): libaio-devel-0.3.111-13.el9.x86_64.rp 404 kB/s | 10 kB 00:00 2023-12-22T08:37:35.727 INFO:teuthology.orchestra.run.smithi069.stdout:(47/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-12-22T08:37:35.753 INFO:teuthology.orchestra.run.smithi069.stdout:(48/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2023-12-22T08:37:35.803 INFO:teuthology.orchestra.run.smithi069.stdout:(49/155): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-22T08:37:35.845 INFO:teuthology.orchestra.run.smithi069.stdout:(50/155): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-12-22T08:37:35.870 INFO:teuthology.orchestra.run.smithi069.stdout:(51/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 987 kB/s | 24 kB 00:00 2023-12-22T08:37:35.895 INFO:teuthology.orchestra.run.smithi069.stdout:(52/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2023-12-22T08:37:35.946 INFO:teuthology.orchestra.run.smithi069.stdout:(53/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-12-22T08:37:35.979 INFO:teuthology.orchestra.run.smithi069.stdout:(54/155): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-22T08:37:36.105 INFO:teuthology.orchestra.run.smithi069.stdout:(55/155): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2023-12-22T08:37:36.197 INFO:teuthology.orchestra.run.smithi069.stdout:(56/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 33 MB/s | 3.0 MB 00:00 2023-12-22T08:37:36.264 INFO:teuthology.orchestra.run.smithi069.stdout:(57/155): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2023-12-22T08:37:36.306 INFO:teuthology.orchestra.run.smithi069.stdout:(58/155): postgresql-contrib-13.11-1.el9.x86_64 19 MB/s | 811 kB 00:00 2023-12-22T08:37:36.339 INFO:teuthology.orchestra.run.smithi069.stdout:(59/155): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2023-12-22T08:37:36.473 INFO:teuthology.orchestra.run.smithi069.stdout:(60/155): postgresql-server-13.11-1.el9.x86_64. 43 MB/s | 5.7 MB 00:00 2023-12-22T08:37:36.506 INFO:teuthology.orchestra.run.smithi069.stdout:(61/155): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2023-12-22T08:37:36.657 INFO:teuthology.orchestra.run.smithi069.stdout:(62/155): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 5.8 MB 00:00 2023-12-22T08:37:36.690 INFO:teuthology.orchestra.run.smithi069.stdout:(63/155): python3-jinja2-2.11.3-4.el9.noarch.rp 6.7 MB/s | 228 kB 00:00 2023-12-22T08:37:36.724 INFO:teuthology.orchestra.run.smithi069.stdout:(64/155): python3-jsonpatch-1.21-16.el9.noarch. 734 kB/s | 24 kB 00:00 2023-12-22T08:37:36.751 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-12-22T08:37:36.751 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-12-22T08:37:36.766 INFO:teuthology.orchestra.run.smithi069.stdout:(65/155): python3-jsonpointer-2.0-4.el9.noarch. 432 kB/s | 18 kB 00:00 2023-12-22T08:37:36.800 INFO:teuthology.orchestra.run.smithi069.stdout:(66/155): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-12-22T08:37:36.825 INFO:teuthology.orchestra.run.smithi069.stdout:(67/155): python3-markupsafe-1.1.1-12.el9.x86_6 1.2 MB/s | 32 kB 00:00 2023-12-22T08:37:36.950 INFO:teuthology.orchestra.run.smithi069.stdout:(68/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2023-12-22T08:37:36.984 INFO:teuthology.orchestra.run.smithi069.stdout:(69/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.4 MB/s | 217 kB 00:00 2023-12-22T08:37:37.018 INFO:teuthology.orchestra.run.smithi069.stdout:(70/155): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2023-12-22T08:37:37.043 INFO:teuthology.orchestra.run.smithi069.stdout:(71/155): python3-prettytable-0.7.2-27.el9.noar 1.6 MB/s | 41 kB 00:00 2023-12-22T08:37:37.077 INFO:teuthology.orchestra.run.smithi069.stdout:(72/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2023-12-22T08:37:37.168 INFO:teuthology.orchestra.run.smithi069.stdout:(73/155): ceph-mgr-diskprediction-local-18.2.0- 1.9 MB/s | 7.4 MB 00:03 2023-12-22T08:37:37.228 INFO:teuthology.orchestra.run.smithi069.stdout:(74/155): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 211 kB 00:00 2023-12-22T08:37:37.253 INFO:teuthology.orchestra.run.smithi069.stdout:(75/155): python3-pytz-2021.1-5.el9.noarch.rpm 575 kB/s | 47 kB 00:00 2023-12-22T08:37:37.303 INFO:teuthology.orchestra.run.smithi069.stdout:(76/155): python3-requests-oauthlib-1.3.0-12.el 571 kB/s | 43 kB 00:00 2023-12-22T08:37:38.220 INFO:teuthology.orchestra.run.smithi069.stdout:(77/155): python3-toml-0.10.2-6.el9.noarch.rpm 42 kB/s | 39 kB 00:00 2023-12-22T08:37:38.537 INFO:teuthology.orchestra.run.smithi069.stdout:(78/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2023-12-22T08:37:38.554 INFO:teuthology.orchestra.run.smithi069.stdout:(79/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 123 kB/s | 41 kB 00:00 2023-12-22T08:37:38.579 INFO:teuthology.orchestra.run.smithi069.stdout:(80/155): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2023-12-22T08:37:38.596 INFO:teuthology.orchestra.run.smithi069.stdout:(81/155): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2023-12-22T08:37:38.621 INFO:teuthology.orchestra.run.smithi069.stdout:(82/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-12-22T08:37:38.647 INFO:teuthology.orchestra.run.smithi069.stdout:(83/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-22T08:37:38.672 INFO:teuthology.orchestra.run.smithi069.stdout:(84/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 877 kB/s | 44 kB 00:00 2023-12-22T08:37:38.697 INFO:teuthology.orchestra.run.smithi069.stdout:(85/155): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-22T08:37:38.722 INFO:teuthology.orchestra.run.smithi069.stdout:(86/155): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-22T08:37:38.764 INFO:teuthology.orchestra.run.smithi069.stdout:(87/155): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-22T08:37:38.790 INFO:teuthology.orchestra.run.smithi069.stdout:(88/155): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-12-22T08:37:38.832 INFO:teuthology.orchestra.run.smithi069.stdout:(89/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2023-12-22T08:37:38.857 INFO:teuthology.orchestra.run.smithi069.stdout:(90/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2023-12-22T08:37:38.899 INFO:teuthology.orchestra.run.smithi069.stdout:(91/155): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2023-12-22T08:37:38.924 INFO:teuthology.orchestra.run.smithi069.stdout:(92/155): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-12-22T08:37:38.958 INFO:teuthology.orchestra.run.smithi069.stdout:(93/155): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2023-12-22T08:37:38.983 INFO:teuthology.orchestra.run.smithi069.stdout:(94/155): python3-requests-2.25.1-7.el9.noarch. 1.9 MB/s | 113 kB 00:00 2023-12-22T08:37:39.009 INFO:teuthology.orchestra.run.smithi069.stdout:(95/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2023-12-22T08:37:39.101 INFO:teuthology.orchestra.run.smithi069.stdout:(96/155): fmt-8.1.1-5.el9.x86_64.rpm 1.2 MB/s | 111 kB 00:00 2023-12-22T08:37:39.168 INFO:teuthology.orchestra.run.smithi069.stdout:(97/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 4.5 MB/s | 309 kB 00:00 2023-12-22T08:37:39.193 INFO:teuthology.orchestra.run.smithi069.stdout:(98/155): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2023-12-22T08:37:39.285 INFO:teuthology.orchestra.run.smithi069.stdout:(99/155): libarrow-9.0.0-10.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2023-12-22T08:37:39.302 INFO:teuthology.orchestra.run.smithi069.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2023-12-22T08:37:39.318 INFO:teuthology.orchestra.run.smithi069.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2023-12-22T08:37:39.352 INFO:teuthology.orchestra.run.smithi069.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-12-22T08:37:39.394 INFO:teuthology.orchestra.run.smithi069.stdout:(103/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 11 MB/s | 838 kB 00:00 2023-12-22T08:37:39.428 INFO:teuthology.orchestra.run.smithi069.stdout:(104/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2023-12-22T08:37:39.453 INFO:teuthology.orchestra.run.smithi069.stdout:(105/155): python3-asyncssh-2.13.2-3.el9.noarch 5.3 MB/s | 548 kB 00:00 2023-12-22T08:37:39.470 INFO:teuthology.orchestra.run.smithi069.stdout:(106/155): python3-cachetools-4.2.4-1.el9.noarc 768 kB/s | 32 kB 00:00 2023-12-22T08:37:39.495 INFO:teuthology.orchestra.run.smithi069.stdout:(107/155): python3-certifi-2021.10.8-2.el9.noar 357 kB/s | 15 kB 00:00 2023-12-22T08:37:39.529 INFO:teuthology.orchestra.run.smithi069.stdout:(108/155): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-12-22T08:37:39.554 INFO:teuthology.orchestra.run.smithi069.stdout:(109/155): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2023-12-22T08:37:39.579 INFO:teuthology.orchestra.run.smithi069.stdout:(110/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2023-12-22T08:37:39.596 INFO:teuthology.orchestra.run.smithi069.stdout:(111/155): python3-colorama-0.4.4-12.el9.noarch 841 kB/s | 35 kB 00:00 2023-12-22T08:37:39.622 INFO:teuthology.orchestra.run.smithi069.stdout:(112/155): python3-google-auth-2.25.2-1.el9.noa 4.6 MB/s | 199 kB 00:00 2023-12-22T08:37:39.638 INFO:teuthology.orchestra.run.smithi069.stdout:(113/155): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2023-12-22T08:37:39.750 INFO:teuthology.orchestra.run.smithi069.stdout:(114/155): python3-jaraco-classes-3.2.1-5.el9.n 138 kB/s | 18 kB 00:00 2023-12-22T08:37:39.906 INFO:teuthology.orchestra.run.smithi069.stdout:(115/155): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2023-12-22T08:37:39.923 INFO:teuthology.orchestra.run.smithi069.stdout:(116/155): python3-jaraco-functools-3.5.0-2.el9 112 kB/s | 19 kB 00:00 2023-12-22T08:37:39.940 INFO:teuthology.orchestra.run.smithi069.stdout:(117/155): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2023-12-22T08:37:39.965 INFO:teuthology.orchestra.run.smithi069.stdout:(118/155): python3-jwt+crypto-2.4.0-1.el9.noarc 216 kB/s | 9.0 kB 00:00 2023-12-22T08:37:39.982 INFO:teuthology.orchestra.run.smithi069.stdout:(119/155): python3-jwt-2.4.0-1.el9.noarch.rpm 977 kB/s | 41 kB 00:00 2023-12-22T08:37:40.024 INFO:teuthology.orchestra.run.smithi069.stdout:(120/155): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2023-12-22T08:37:40.049 INFO:teuthology.orchestra.run.smithi069.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 689 kB/s | 46 kB 00:00 2023-12-22T08:37:40.075 INFO:teuthology.orchestra.run.smithi069.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2023-12-22T08:37:40.100 INFO:teuthology.orchestra.run.smithi069.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-12-22T08:37:40.125 INFO:teuthology.orchestra.run.smithi069.stdout:(124/155): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2023-12-22T08:37:40.151 INFO:teuthology.orchestra.run.smithi069.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2023-12-22T08:37:40.192 INFO:teuthology.orchestra.run.smithi069.stdout:(126/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2023-12-22T08:37:40.218 INFO:teuthology.orchestra.run.smithi069.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2023-12-22T08:37:40.243 INFO:teuthology.orchestra.run.smithi069.stdout:(128/155): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2023-12-22T08:37:40.268 INFO:teuthology.orchestra.run.smithi069.stdout:(129/155): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2023-12-22T08:37:40.294 INFO:teuthology.orchestra.run.smithi069.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2023-12-22T08:37:40.319 INFO:teuthology.orchestra.run.smithi069.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2023-12-22T08:37:40.344 INFO:teuthology.orchestra.run.smithi069.stdout:(132/155): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-12-22T08:37:40.369 INFO:teuthology.orchestra.run.smithi069.stdout:(133/155): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2023-12-22T08:37:40.395 INFO:teuthology.orchestra.run.smithi069.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2023-12-22T08:37:40.420 INFO:teuthology.orchestra.run.smithi069.stdout:(135/155): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2023-12-22T08:37:40.445 INFO:teuthology.orchestra.run.smithi069.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2023-12-22T08:37:40.471 INFO:teuthology.orchestra.run.smithi069.stdout:(137/155): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2023-12-22T08:37:40.521 INFO:teuthology.orchestra.run.smithi069.stdout:(138/155): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2023-12-22T08:37:41.596 INFO:teuthology.orchestra.run.smithi069.stdout:(139/155): ceph-test-18.2.0-1377.g24e2e32a.el9. 2.1 MB/s | 40 MB 00:19 2023-12-22T08:37:41.630 INFO:teuthology.orchestra.run.smithi069.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-22T08:37:41.738 INFO:teuthology.orchestra.run.smithi069.stdout:(141/155): NetworkManager-1.45.9-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-12-22T08:37:41.814 INFO:teuthology.orchestra.run.smithi069.stdout:(142/155): NetworkManager-libnm-1.45.9-1.el9.x8 24 MB/s | 1.8 MB 00:00 2023-12-22T08:37:41.839 INFO:teuthology.orchestra.run.smithi069.stdout:(143/155): NetworkManager-team-1.45.9-1.el9.x86 1.7 MB/s | 42 kB 00:00 2023-12-22T08:37:41.881 INFO:teuthology.orchestra.run.smithi069.stdout:(144/155): NetworkManager-tui-1.45.9-1.el9.x86_ 5.8 MB/s | 246 kB 00:00 2023-12-22T08:37:41.914 INFO:teuthology.orchestra.run.smithi069.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-22T08:37:41.941 INFO:teuthology.orchestra.run.smithi069.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 1.4 MB/s | 35 kB 00:00 2023-12-22T08:37:41.981 INFO:teuthology.orchestra.run.smithi069.stdout:(147/155): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2023-12-22T08:37:42.023 INFO:teuthology.orchestra.run.smithi069.stdout:(148/155): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 254 kB 00:00 2023-12-22T08:37:42.049 INFO:teuthology.orchestra.run.smithi069.stdout:(149/155): libacl-2.3.1-4.el9.x86_64.rpm 884 kB/s | 22 kB 00:00 2023-12-22T08:37:42.107 INFO:teuthology.orchestra.run.smithi069.stdout:(150/155): openssl-3.0.7-25.el9.x86_64.rpm 20 MB/s | 1.2 MB 00:00 2023-12-22T08:37:42.191 INFO:teuthology.orchestra.run.smithi069.stdout:(151/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 26 MB/s | 2.1 MB 00:00 2023-12-22T08:37:42.242 INFO:teuthology.orchestra.run.smithi069.stdout:(152/155): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-22T08:37:42.292 INFO:teuthology.orchestra.run.smithi069.stdout:(153/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 21 MB/s | 1.1 MB 00:00 2023-12-22T08:37:42.792 INFO:teuthology.orchestra.run.smithi069.stdout:(154/155): librados2-18.2.0-1377.g24e2e32a.el9. 1.4 MB/s | 3.3 MB 00:02 2023-12-22T08:37:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-12-22T08:37:43.459 INFO:teuthology.orchestra.run.smithi069.stdout:(155/155): librbd1-18.2.0-1377.g24e2e32a.el9.x8 1.0 MB/s | 3.0 MB 00:02 2023-12-22T08:37:43.463 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:37:43.463 INFO:teuthology.orchestra.run.smithi069.stdout:Total 6.5 MB/s | 200 MB 00:30 2023-12-22T08:37:43.484 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-12-22T08:37:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2023-12-22T08:37:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/171 2023-12-22T08:37:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/171 2023-12-22T08:37:43.668 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/171 2023-12-22T08:37:43.698 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2023-12-22T08:37:43.738 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-12-22T08:37:43.738 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-12-22T08:37:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2023-12-22T08:37:44.221 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2023-12-22T08:37:44.280 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:37:44.416 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:37:44.439 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:37:44.569 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:37:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:37:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2023-12-22T08:37:44.886 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2023-12-22T08:37:45.223 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2023-12-22T08:37:45.227 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-12-22T08:37:45.227 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-12-22T08:37:45.280 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2023-12-22T08:37:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:37:45.433 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:37:45.464 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:37:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:37:45.877 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2023-12-22T08:37:46.052 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:37:46.123 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:37:46.309 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:46.372 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2023-12-22T08:37:46.953 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2023-12-22T08:37:47.018 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2023-12-22T08:37:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2023-12-22T08:37:47.115 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/171 2023-12-22T08:37:47.177 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/171 2023-12-22T08:37:47.279 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2023-12-22T08:37:47.325 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2023-12-22T08:37:47.359 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2023-12-22T08:37:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/171 2023-12-22T08:37:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 30/171 2023-12-22T08:37:47.534 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 31/171 2023-12-22T08:37:47.627 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 32/171 2023-12-22T08:37:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/171 2023-12-22T08:37:47.865 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/171 2023-12-22T08:37:48.562 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/171 2023-12-22T08:37:48.652 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/171 2023-12-22T08:37:48.687 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/171 2023-12-22T08:37:48.728 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 38/171 2023-12-22T08:37:48.769 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 39/171 2023-12-22T08:37:48.835 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/171 2023-12-22T08:37:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/171 2023-12-22T08:37:49.100 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/171 2023-12-22T08:37:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/171 2023-12-22T08:37:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/171 2023-12-22T08:37:49.350 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/171 2023-12-22T08:37:49.434 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/171 2023-12-22T08:37:49.469 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/171 2023-12-22T08:37:49.540 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/171 2023-12-22T08:37:49.611 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/171 2023-12-22T08:37:49.653 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/171 2023-12-22T08:37:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/171 2023-12-22T08:37:49.772 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/171 2023-12-22T08:37:49.958 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/171 2023-12-22T08:37:50.050 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/171 2023-12-22T08:37:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/171 2023-12-22T08:37:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/171 2023-12-22T08:37:50.264 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/171 2023-12-22T08:37:50.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.25.2-1.el9.noarch 58/171 2023-12-22T08:37:50.352 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/171 2023-12-22T08:37:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/171 2023-12-22T08:37:50.415 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/171 2023-12-22T08:37:50.576 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fmt-8.1.1-5.el9.x86_64 62/171 2023-12-22T08:37:50.624 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/171 2023-12-22T08:37:50.692 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/171 2023-12-22T08:37:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/171 2023-12-22T08:37:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/171 2023-12-22T08:37:51.078 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/171 2023-12-22T08:37:51.192 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-12-22T08:37:51.250 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/171 2023-12-22T08:37:51.306 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/171 2023-12-22T08:37:51.336 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2023-12-22T08:37:51.338 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/171 2023-12-22T08:37:51.363 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/171 2023-12-22T08:37:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/171 2023-12-22T08:37:51.401 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/171 2023-12-22T08:37:51.438 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/171 2023-12-22T08:37:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2023-12-22T08:37:51.464 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2023-12-22T08:37:51.506 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2023-12-22T08:37:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2023-12-22T08:37:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2023-12-22T08:37:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2023-12-22T08:37:51.664 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2023-12-22T08:37:51.720 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2023-12-22T08:37:51.792 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2023-12-22T08:37:51.817 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2023-12-22T08:37:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2023-12-22T08:37:51.881 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:37:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2023-12-22T08:37:51.979 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:37:52.007 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:37:52.041 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2023-12-22T08:37:52.079 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2023-12-22T08:37:52.082 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:37:52.112 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:37:52.115 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2023-12-22T08:37:52.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2023-12-22T08:37:52.202 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2023-12-22T08:37:52.227 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2023-12-22T08:37:52.279 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2023-12-22T08:37:52.370 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2023-12-22T08:37:52.415 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2023-12-22T08:37:52.453 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2023-12-22T08:37:52.495 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2023-12-22T08:37:52.523 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:37:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2023-12-22T08:37:52.607 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:37:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2023-12-22T08:37:52.632 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:37:52.676 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:37:52.778 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2023-12-22T08:37:52.878 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:37:52.938 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:37:53.006 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:53.064 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:53.337 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:37:53.368 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2023-12-22T08:37:53.437 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2023-12-22T08:37:53.490 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2023-12-22T08:37:53.522 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2023-12-22T08:37:53.557 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/171 2023-12-22T08:37:53.597 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/171 2023-12-22T08:37:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2023-12-22T08:37:53.654 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2023-12-22T08:37:53.660 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2023-12-22T08:37:53.688 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2023-12-22T08:37:53.696 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2023-12-22T08:37:53.723 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2023-12-22T08:37:53.743 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2023-12-22T08:37:53.792 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/171 2023-12-22T08:37:53.829 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 30/171 2023-12-22T08:37:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2023-12-22T08:37:53.871 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 31/171 2023-12-22T08:37:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2023-12-22T08:37:53.944 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 32/171 2023-12-22T08:37:54.078 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/171 2023-12-22T08:37:54.131 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/171 2023-12-22T08:37:54.141 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2023-12-22T08:37:54.169 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2023-12-22T08:37:54.261 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2023-12-22T08:37:54.648 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/171 2023-12-22T08:37:54.726 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/171 2023-12-22T08:37:54.758 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/171 2023-12-22T08:37:54.808 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 38/171 2023-12-22T08:37:54.845 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 39/171 2023-12-22T08:37:54.887 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/171 2023-12-22T08:37:55.021 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/171 2023-12-22T08:37:55.071 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/171 2023-12-22T08:37:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2023-12-22T08:37:55.176 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/171 2023-12-22T08:37:55.207 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/171 2023-12-22T08:37:55.230 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2023-12-22T08:37:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/171 2023-12-22T08:37:55.334 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/171 2023-12-22T08:37:55.366 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/171 2023-12-22T08:37:55.403 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/171 2023-12-22T08:37:55.449 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/171 2023-12-22T08:37:55.486 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/171 2023-12-22T08:37:55.529 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/171 2023-12-22T08:37:55.571 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/171 2023-12-22T08:37:55.703 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/171 2023-12-22T08:37:55.751 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/171 2023-12-22T08:37:55.782 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/171 2023-12-22T08:37:55.823 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/171 2023-12-22T08:37:55.924 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/171 2023-12-22T08:37:55.956 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:2.25.2-1.el9.noarch 58/171 2023-12-22T08:37:55.996 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/171 2023-12-22T08:37:56.022 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/171 2023-12-22T08:37:56.049 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/171 2023-12-22T08:37:56.148 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fmt-8.1.1-5.el9.x86_64 62/171 2023-12-22T08:37:56.192 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/171 2023-12-22T08:37:56.240 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/171 2023-12-22T08:37:56.295 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/171 2023-12-22T08:37:56.480 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/171 2023-12-22T08:37:56.529 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/171 2023-12-22T08:37:56.658 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/171 2023-12-22T08:37:56.698 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/171 2023-12-22T08:37:56.727 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/171 2023-12-22T08:37:56.761 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/171 2023-12-22T08:37:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2023-12-22T08:37:56.794 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2023-12-22T08:37:56.825 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2023-12-22T08:37:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2023-12-22T08:37:56.861 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2023-12-22T08:37:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2023-12-22T08:37:56.894 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2023-12-22T08:37:56.896 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 267 kB/s | 18 MB 01:10 2023-12-22T08:37:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2023-12-22T08:37:56.919 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2023-12-22T08:37:56.954 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2023-12-22T08:37:56.993 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2023-12-22T08:37:57.024 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2023-12-22T08:37:57.054 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2023-12-22T08:37:57.130 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2023-12-22T08:37:57.165 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2023-12-22T08:37:57.198 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2023-12-22T08:37:57.240 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2023-12-22T08:37:57.251 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2023-12-22T08:37:57.274 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2023-12-22T08:37:57.279 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:37:57.363 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2023-12-22T08:37:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:37:57.418 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2023-12-22T08:37:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 107/171 2023-12-22T08:37:57.482 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2023-12-22T08:37:57.519 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2023-12-22T08:37:57.577 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2023-12-22T08:37:57.927 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2023-12-22T08:37:57.966 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:37:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:37:58.084 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/171 2023-12-22T08:37:58.304 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2023-12-22T08:37:58.349 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2023-12-22T08:37:58.383 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2023-12-22T08:37:58.432 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2023-12-22T08:37:58.519 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2023-12-22T08:37:58.550 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2023-12-22T08:37:58.728 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2023-12-22T08:37:58.998 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2023-12-22T08:37:59.077 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2023-12-22T08:37:59.710 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2023-12-22T08:37:59.812 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2023-12-22T08:38:00.540 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:00.581 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:00.972 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.8 MB 00:00 2023-12-22T08:38:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2023-12-22T08:38:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2023-12-22T08:38:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2023-12-22T08:38:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2023-12-22T08:38:01.201 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:38:01.409 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:38:01.409 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-22T08:38:01.410 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-22T08:38:01.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2023-12-22T08:38:01.460 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:38:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:38:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:38:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 107/171 2023-12-22T08:38:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2023-12-22T08:38:02.032 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2023-12-22T08:38:02.062 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:38:02.116 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:38:02.138 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/171 2023-12-22T08:38:02.589 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2023-12-22T08:38:04.098 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:04.135 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:04.666 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:38:04.705 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:38:04.794 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:38:04.794 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-22T08:38:04.794 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-22T08:38:04.794 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:04.822 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:38:10.246 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 20 MB 00:07 2023-12-22T08:38:14.329 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:38:14.332 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2023-12-22T08:38:14.332 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2023-12-22T08:38:14.332 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2023-12-22T08:38:14.332 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2023-12-22T08:38:14.332 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2023-12-22T08:38:14.333 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2023-12-22T08:38:14.333 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2023-12-22T08:38:14.333 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:14.550 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:38:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:38:14.595 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:14.595 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-22T08:38:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:15.090 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /root 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2023-12-22T08:38:16.162 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:16.326 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:38:16.341 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:38:16.341 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:16.341 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-22T08:38:16.341 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:16.370 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:38:16.459 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:38:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-22T08:38:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:38:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:38:16.460 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:16.687 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:38:16.763 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:38:16.764 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:16.764 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-22T08:38:16.764 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:38:16.764 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:38:16.764 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:17.271 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:38:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:38:17.363 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:17.363 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-22T08:38:17.363 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:38:17.363 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:38:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:17.503 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2023-12-22T08:38:17.743 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:38:17.744 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-22T08:38:17.756 INFO:teuthology.orchestra.run.smithi031.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-22T08:38:17.757 INFO:teuthology.orchestra.run.smithi031.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-22T08:38:17.758 INFO:teuthology.orchestra.run.smithi031.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-22T08:38:17.759 INFO:teuthology.orchestra.run.smithi031.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-22T08:38:17.761 INFO:teuthology.orchestra.run.smithi031.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T08:38:17.764 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-22T08:38:17.764 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-22T08:38:17.844 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2023-12-22T08:38:17.863 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2023-12-22T08:38:17.863 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2023-12-22T08:38:17.863 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2023-12-22T08:38:17.863 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2023-12-22T08:38:17.863 INFO:teuthology.orchestra.run.smithi031.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-22T08:38:17.863 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-22T08:38:17.863 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-22T08:38:17.864 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-22T08:38:17.864 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-22T08:38:17.864 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-22T08:38:17.864 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-22T08:38:17.864 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-22T08:38:17.864 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-22T08:38:17.864 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-22T08:38:17.864 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-22T08:38:17.865 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-22T08:38:17.865 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-22T08:38:17.865 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-22T08:38:17.865 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-22T08:38:17.865 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-22T08:38:17.865 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-22T08:38:17.865 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2023-12-22T08:38:17.865 INFO:teuthology.orchestra.run.smithi031.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-22T08:38:17.866 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager x86_64 1:1.45.9-1.el9 CentOS-BaseOS 2.2 M 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm x86_64 1:1.45.9-1.el9 CentOS-BaseOS 1.8 M 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team x86_64 1:1.45.9-1.el9 CentOS-BaseOS 42 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui x86_64 1:1.45.9-1.el9 CentOS-BaseOS 246 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2023-12-22T08:38:17.867 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-22T08:38:17.868 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-22T08:38:17.869 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-22T08:38:17.870 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-22T08:38:17.871 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:2.25.2-1.el9 epel 199 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-22T08:38:17.872 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-22T08:38:17.873 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-22T08:38:17.874 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-22T08:38:17.875 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout:Install 139 Packages 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 16 Packages 2023-12-22T08:38:17.876 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:38:17.877 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 200 M 2023-12-22T08:38:17.877 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2023-12-22T08:38:17.896 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:38:17.921 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:38:17.921 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:17.921 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-22T08:38:17.921 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:38:17.921 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:38:17.922 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:38:18.130 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:38:18.151 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:38:18.152 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:18.152 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-22T08:38:18.152 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:38:18.152 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:38:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:38:18.214 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 121/171 2023-12-22T08:38:18.318 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 122/171 2023-12-22T08:38:18.353 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:38:18.557 INFO:teuthology.orchestra.run.smithi031.stdout:(1/155): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 14 kB/s | 6.5 kB 00:00 2023-12-22T08:38:18.597 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:38:18.619 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:38:18.619 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:18.619 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-22T08:38:18.619 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:38:18.619 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:38:18.619 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:18.675 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:38:18.707 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2023-12-22T08:38:18.720 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:38:19.086 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:38:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:38:19.142 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 121/171 2023-12-22T08:38:19.204 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 122/171 2023-12-22T08:38:19.228 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:38:19.449 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:38:19.479 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:38:19.641 INFO:teuthology.orchestra.run.smithi031.stdout:(2/155): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 775 kB/s | 839 kB 00:01 2023-12-22T08:38:19.830 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:38:19.858 INFO:teuthology.orchestra.run.smithi031.stdout:(3/155): ceph-immutable-object-cache-18.2.0-137 658 kB/s | 142 kB 00:00 2023-12-22T08:38:19.862 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:38:20.000 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:38:20.169 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 126/171 2023-12-22T08:38:20.206 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:38:20.276 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:38:20.276 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:20.276 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-22T08:38:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:38:20.277 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:38:20.277 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:20.332 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:38:20.370 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:38:20.439 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:38:20.466 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 129/171 2023-12-22T08:38:20.471 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:38:20.570 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:38:20.718 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 126/171 2023-12-22T08:38:20.740 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:38:20.763 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:38:20.763 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:20.763 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-22T08:38:20.763 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:38:20.763 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:38:20.763 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:20.807 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:38:20.817 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:38:20.863 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 129/171 2023-12-22T08:38:21.300 INFO:teuthology.orchestra.run.smithi031.stdout:(4/155): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 1.5 MB/s | 2.1 MB 00:01 2023-12-22T08:38:21.303 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2023-12-22T08:38:21.359 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:38:21.450 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:38:21.450 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:21.450 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-22T08:38:21.450 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:38:21.450 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:38:21.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:21.502 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:38:21.572 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2023-12-22T08:38:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:38:21.586 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:21.586 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-22T08:38:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:21.609 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:38:21.631 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:38:21.631 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:21.631 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-22T08:38:21.631 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:38:21.632 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:38:21.632 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:21.668 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:38:21.669 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:38:21.690 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:38:21.690 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:21.690 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-22T08:38:21.690 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:21.736 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:38:21.750 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:38:21.750 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:21.750 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-22T08:38:21.750 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:38:21.750 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:38:21.750 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:21.758 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:38:21.758 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:21.758 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-22T08:38:21.758 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:38:21.758 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:38:21.758 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:22.053 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:38:22.075 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:38:22.075 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:22.075 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-22T08:38:22.076 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:38:22.076 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:38:22.076 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:22.111 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:38:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:38:22.196 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:38:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-22T08:38:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:38:22.197 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:38:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:22.242 INFO:teuthology.orchestra.run.smithi031.stdout:(5/155): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 1.5 MB/s | 1.4 MB 00:00 2023-12-22T08:38:24.158 INFO:teuthology.orchestra.run.smithi031.stdout:(6/155): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 877 kB/s | 5.2 MB 00:06 2023-12-22T08:38:24.483 INFO:teuthology.orchestra.run.smithi031.stdout:(7/155): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 2.0 MB/s | 4.4 MB 00:02 2023-12-22T08:38:25.777 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/171 2023-12-22T08:38:25.822 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/171 2023-12-22T08:38:25.864 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 137/171 2023-12-22T08:38:25.898 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2023-12-22T08:38:25.925 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2023-12-22T08:38:26.106 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:38:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/171 2023-12-22T08:38:26.211 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2023-12-22T08:38:26.238 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:38:26.238 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/171 2023-12-22T08:38:26.279 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 143/171 2023-12-22T08:38:26.293 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 137/171 2023-12-22T08:38:26.319 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2023-12-22T08:38:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2023-12-22T08:38:26.349 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-team-1:1.45.9-1.el9.x86_64 145/171 2023-12-22T08:38:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2023-12-22T08:38:26.411 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-tui-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:38:26.455 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2023-12-22T08:38:26.489 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2023-12-22T08:38:26.675 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:38:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2023-12-22T08:38:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:38:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 143/171 2023-12-22T08:38:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2023-12-22T08:38:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.45.9-1.el9.x86_64 145/171 2023-12-22T08:38:27.081 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:38:27.110 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:27.146 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2023-12-22T08:38:27.172 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2023-12-22T08:38:27.230 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2023-12-22T08:38:28.025 INFO:teuthology.orchestra.run.smithi031.stdout:(8/155): ceph-radosgw-18.2.0-1377.g24e2e32a.el9 2.2 MB/s | 7.7 MB 00:03 2023-12-22T08:38:28.039 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 151/171 2023-12-22T08:38:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:28.110 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2023-12-22T08:38:28.133 INFO:teuthology.orchestra.run.smithi031.stdout:(9/155): ceph-selinux-18.2.0-1377.g24e2e32a.el9 223 kB/s | 24 kB 00:00 2023-12-22T08:38:28.137 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:28.149 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2023-12-22T08:38:28.229 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2023-12-22T08:38:28.232 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:38:28.272 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2023-12-22T08:38:28.296 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2023-12-22T08:38:28.298 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2023-12-22T08:38:28.322 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:38:28.348 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2023-12-22T08:38:28.349 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:38:28.416 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:38:28.444 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2023-12-22T08:38:28.483 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2023-12-22T08:38:28.508 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2023-12-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:38:28.534 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:38:28.610 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:38:28.634 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2023-12-22T08:38:28.640 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:28.641 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:28.821 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:38:28.913 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:38:28.938 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2023-12-22T08:38:28.964 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2023-12-22T08:38:28.997 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2023-12-22T08:38:29.061 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:38:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 151/171 2023-12-22T08:38:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2023-12-22T08:38:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2023-12-22T08:38:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2023-12-22T08:38:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2023-12-22T08:38:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2023-12-22T08:38:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:38:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2023-12-22T08:38:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:38:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:38:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2023-12-22T08:38:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2023-12-22T08:38:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2023-12-22T08:38:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:38:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:38:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:38:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2023-12-22T08:38:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:38:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:38:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:38:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2023-12-22T08:38:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2023-12-22T08:38:31.181 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2023-12-22T08:38:31.300 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:38:31.533 INFO:teuthology.orchestra.run.smithi031.stdout:(10/155): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 2.4 MB/s | 18 MB 00:07 2023-12-22T08:38:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:38:31.596 INFO:teuthology.orchestra.run.smithi081.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-22T08:38:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:31.624 INFO:teuthology.orchestra.run.smithi031.stdout:(11/155): cephfs-mirror-18.2.0-1377.g24e2e32a.e 2.3 MB/s | 219 kB 00:00 2023-12-22T08:38:31.716 INFO:teuthology.orchestra.run.smithi031.stdout:(12/155): cephfs-shell-18.2.0-1377.g24e2e32a.el 295 kB/s | 27 kB 00:00 2023-12-22T08:38:31.809 INFO:teuthology.orchestra.run.smithi031.stdout:(13/155): libcephfs-devel-18.2.0-1377.g24e2e32a 339 kB/s | 31 kB 00:00 2023-12-22T08:38:32.083 INFO:teuthology.orchestra.run.smithi031.stdout:(14/155): libcephfs2-18.2.0-1377.g24e2e32a.el9. 2.3 MB/s | 658 kB 00:00 2023-12-22T08:38:32.176 INFO:teuthology.orchestra.run.smithi031.stdout:(15/155): libcephsqlite-18.2.0-1377.g24e2e32a.e 1.8 MB/s | 166 kB 00:00 2023-12-22T08:38:32.259 INFO:teuthology.orchestra.run.smithi031.stdout:(16/155): librados-devel-18.2.0-1377.g24e2e32a. 1.5 MB/s | 127 kB 00:00 2023-12-22T08:38:32.401 INFO:teuthology.orchestra.run.smithi031.stdout:(17/155): libradosstriper1-18.2.0-1377.g24e2e32 3.3 MB/s | 474 kB 00:00 2023-12-22T08:38:33.260 INFO:teuthology.orchestra.run.smithi031.stdout:(18/155): librgw2-18.2.0-1377.g24e2e32a.el9.x86 5.2 MB/s | 4.5 MB 00:00 2023-12-22T08:38:33.335 INFO:teuthology.orchestra.run.smithi031.stdout:(19/155): python3-ceph-argparse-18.2.0-1377.g24 601 kB/s | 45 kB 00:00 2023-12-22T08:38:33.435 INFO:teuthology.orchestra.run.smithi031.stdout:(20/155): python3-ceph-common-18.2.0-1377.g24e2 1.2 MB/s | 124 kB 00:00 2023-12-22T08:38:33.519 INFO:teuthology.orchestra.run.smithi031.stdout:(21/155): python3-cephfs-18.2.0-1377.g24e2e32a. 1.9 MB/s | 162 kB 00:00 2023-12-22T08:38:33.608 INFO:teuthology.orchestra.run.smithi031.stdout:(22/155): python3-rados-18.2.0-1377.g24e2e32a.e 3.8 MB/s | 319 kB 00:00 2023-12-22T08:38:33.615 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:38:33.615 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/171 2023-12-22T08:38:33.615 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/171 2023-12-22T08:38:33.615 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/171 2023-12-22T08:38:33.616 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/171 2023-12-22T08:38:33.617 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2023-12-22T08:38:33.618 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/171 2023-12-22T08:38:33.619 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/171 2023-12-22T08:38:33.620 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 80/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 81/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 82/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 83/171 2023-12-22T08:38:33.621 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : jq-1.6-16.el9.x86_64 87/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 90/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 91/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 92/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ply-3.11-14.el9.noarch 93/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 94/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 95/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 96/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/171 2023-12-22T08:38:33.622 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/171 2023-12-22T08:38:33.623 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:2.25.2-1.el9.noarch 113/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2023-12-22T08:38:33.624 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2023-12-22T08:38:33.625 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 148/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-team-1:1.45.9-1.el9.x86_64 150/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-tui-1:1.45.9-1.el9.x86_64 152/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2023-12-22T08:38:33.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2023-12-22T08:38:33.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2023-12-22T08:38:33.628 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2023-12-22T08:38:33.686 INFO:teuthology.orchestra.run.smithi031.stdout:(23/155): python3-rbd-18.2.0-1377.g24e2e32a.el9 3.5 MB/s | 297 kB 00:00 2023-12-22T08:38:33.770 INFO:teuthology.orchestra.run.smithi031.stdout:(24/155): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.2 MB/s | 99 kB 00:00 2023-12-22T08:38:33.853 INFO:teuthology.orchestra.run.smithi031.stdout:(25/155): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.0 MB/s | 87 kB 00:00 2023-12-22T08:38:34.579 INFO:teuthology.orchestra.run.smithi031.stdout:(26/155): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 4.1 MB/s | 3.0 MB 00:00 2023-12-22T08:38:34.670 INFO:teuthology.orchestra.run.smithi031.stdout:(27/155): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.8 MB/s | 171 kB 00:00 2023-12-22T08:38:34.754 INFO:teuthology.orchestra.run.smithi031.stdout:(28/155): ceph-grafana-dashboards-18.2.0-1377.g 278 kB/s | 23 kB 00:00 2023-12-22T08:38:34.846 INFO:teuthology.orchestra.run.smithi031.stdout:(29/155): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.4 MB/s | 132 kB 00:00 2023-12-22T08:38:35.371 INFO:teuthology.orchestra.run.smithi031.stdout:(30/155): ceph-mgr-dashboard-18.2.0-1377.g24e2e 3.3 MB/s | 1.8 MB 00:00 2023-12-22T08:38:35.555 INFO:teuthology.orchestra.run.smithi031.stdout:(31/155): ceph-common-18.2.0-1377.g24e2e32a.el9 1.1 MB/s | 18 MB 00:17 2023-12-22T08:38:35.747 INFO:teuthology.orchestra.run.smithi031.stdout:(32/155): ceph-mgr-modules-core-18.2.0-1377.g24 1.2 MB/s | 242 kB 00:00 2023-12-22T08:38:35.855 INFO:teuthology.orchestra.run.smithi031.stdout:(33/155): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 464 kB/s | 50 kB 00:00 2023-12-22T08:38:35.972 INFO:teuthology.orchestra.run.smithi031.stdout:(34/155): ceph-prometheus-alerts-18.2.0-1377.g2 125 kB/s | 15 kB 00:00 2023-12-22T08:38:36.189 INFO:teuthology.orchestra.run.smithi031.stdout:(35/155): ceph-volume-18.2.0-1377.g24e2e32a.el9 1.2 MB/s | 262 kB 00:00 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-team-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-tui-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: acl-2.3.1-4.el9.x86_64 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-0.190-2.el9.x86_64 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs-0.190-2.el9.x86_64 2023-12-22T08:38:36.219 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-6.3.0-1.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.2-8.el9.noarch 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.7.4-5.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.220 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.221 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.4-9.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-22T08:38:36.222 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: jq-1.6-16.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-22T08:38:36.223 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-22T08:38:36.224 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-13.11-1.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.226 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-22T08:38:36.226 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-22T08:38:36.226 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-22T08:38:36.226 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-22T08:38:36.226 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:2.25.2-1.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-22T08:38:36.227 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply-3.11-14.el9.noarch 2023-12-22T08:38:36.228 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-22T08:38:36.229 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3-1.26.5-5.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.230 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.231 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:36.231 INFO:teuthology.orchestra.run.smithi069.stdout: re2-1:20211101-3.el9.x86_64 2023-12-22T08:38:36.231 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-22T08:38:36.231 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-22T08:38:36.231 INFO:teuthology.orchestra.run.smithi069.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-22T08:38:36.231 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2023-12-22T08:38:36.231 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-22T08:38:36.231 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-22T08:38:36.232 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:38:36.232 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:38:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/171 2023-12-22T08:38:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/171 2023-12-22T08:38:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/171 2023-12-22T08:38:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/171 2023-12-22T08:38:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/171 2023-12-22T08:38:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/171 2023-12-22T08:38:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/171 2023-12-22T08:38:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/171 2023-12-22T08:38:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/171 2023-12-22T08:38:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/171 2023-12-22T08:38:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/171 2023-12-22T08:38:36.261 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2023-12-22T08:38:36.262 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/171 2023-12-22T08:38:36.263 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/171 2023-12-22T08:38:36.264 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 80/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 81/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 82/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 83/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.6-16.el9.x86_64 87/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/171 2023-12-22T08:38:36.265 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 90/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 91/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 92/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 93/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 94/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 95/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 96/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/171 2023-12-22T08:38:36.266 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.25.2-1.el9.noarch 113/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/171 2023-12-22T08:38:36.267 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2023-12-22T08:38:36.268 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2023-12-22T08:38:36.269 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 148/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.45.9-1.el9.x86_64 150/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.45.9-1.el9.x86_64 152/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2023-12-22T08:38:36.270 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2023-12-22T08:38:36.271 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2023-12-22T08:38:36.390 INFO:teuthology.orchestra.run.smithi031.stdout:(36/155): cephadm-18.2.0-1377.g24e2e32a.el9.noa 1.1 MB/s | 221 kB 00:00 2023-12-22T08:38:36.498 INFO:teuthology.orchestra.run.smithi031.stdout:(37/155): cephfs-top-18.2.0-1377.g24e2e32a.el9. 167 kB/s | 18 kB 00:00 2023-12-22T08:38:36.648 INFO:teuthology.orchestra.run.smithi031.stdout:(38/155): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 662 kB 00:00 2023-12-22T08:38:36.707 INFO:teuthology.orchestra.run.smithi031.stdout:(39/155): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2023-12-22T08:38:36.734 DEBUG:teuthology.parallel:result is None 2023-12-22T08:38:36.740 INFO:teuthology.orchestra.run.smithi031.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-12-22T08:38:36.774 INFO:teuthology.orchestra.run.smithi031.stdout:(41/155): elfutils-libelf-devel-0.190-2.el9.x86 615 kB/s | 20 kB 00:00 2023-12-22T08:38:36.816 INFO:teuthology.orchestra.run.smithi031.stdout:(42/155): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-12-22T08:38:36.850 INFO:teuthology.orchestra.run.smithi031.stdout:(43/155): flexiblas-3.0.4-8.el9.x86_64.rpm 953 kB/s | 32 kB 00:00 2023-12-22T08:38:36.958 INFO:teuthology.orchestra.run.smithi031.stdout:(44/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-12-22T08:38:37.000 INFO:teuthology.orchestra.run.smithi031.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 411 kB/s | 17 kB 00:00 2023-12-22T08:38:37.034 INFO:teuthology.orchestra.run.smithi031.stdout:(46/155): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2023-12-22T08:38:37.067 INFO:teuthology.orchestra.run.smithi031.stdout:(47/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2023-12-22T08:38:37.109 INFO:teuthology.orchestra.run.smithi031.stdout:(48/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-22T08:38:37.160 INFO:teuthology.orchestra.run.smithi031.stdout:(49/155): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-22T08:38:37.202 INFO:teuthology.orchestra.run.smithi031.stdout:(50/155): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-12-22T08:38:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:(51/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 735 kB/s | 24 kB 00:00 2023-12-22T08:38:37.269 INFO:teuthology.orchestra.run.smithi031.stdout:(52/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-22T08:38:37.328 INFO:teuthology.orchestra.run.smithi031.stdout:(53/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2023-12-22T08:38:37.353 INFO:teuthology.orchestra.run.smithi031.stdout:(54/155): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2023-12-22T08:38:37.437 INFO:teuthology.orchestra.run.smithi031.stdout:(55/155): ceph-mgr-diskprediction-local-18.2.0- 3.6 MB/s | 7.4 MB 00:02 2023-12-22T08:38:37.520 INFO:teuthology.orchestra.run.smithi031.stdout:(56/155): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2023-12-22T08:38:37.579 INFO:teuthology.orchestra.run.smithi031.stdout:(57/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 21 MB/s | 3.0 MB 00:00 2023-12-22T08:38:37.621 INFO:teuthology.orchestra.run.smithi031.stdout:(58/155): postgresql-13.11-1.el9.x86_64.rpm 16 MB/s | 1.5 MB 00:00 2023-12-22T08:38:37.663 INFO:teuthology.orchestra.run.smithi031.stdout:(59/155): postgresql-contrib-13.11-1.el9.x86_64 9.8 MB/s | 811 kB 00:00 2023-12-22T08:38:37.689 INFO:teuthology.orchestra.run.smithi031.stdout:(60/155): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2023-12-22T08:38:37.822 INFO:teuthology.orchestra.run.smithi031.stdout:(61/155): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2023-12-22T08:38:37.847 INFO:teuthology.orchestra.run.smithi031.stdout:(62/155): python3-attrs-20.3.0-7.el9.noarch.rpm 503 kB/s | 78 kB 00:00 2023-12-22T08:38:37.964 INFO:teuthology.orchestra.run.smithi031.stdout:(63/155): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2023-12-22T08:38:37.989 INFO:teuthology.orchestra.run.smithi031.stdout:(64/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-12-22T08:38:38.014 INFO:teuthology.orchestra.run.smithi031.stdout:(65/155): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2023-12-22T08:38:38.039 INFO:teuthology.orchestra.run.smithi031.stdout:(66/155): python3-jsonpointer-2.0-4.el9.noarch. 362 kB/s | 18 kB 00:00 2023-12-22T08:38:38.065 INFO:teuthology.orchestra.run.smithi031.stdout:(67/155): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-12-22T08:38:38.090 INFO:teuthology.orchestra.run.smithi031.stdout:(68/155): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2023-12-22T08:38:38.132 INFO:teuthology.orchestra.run.smithi031.stdout:(69/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.5 MB/s | 217 kB 00:00 2023-12-22T08:38:38.207 INFO:teuthology.orchestra.run.smithi031.stdout:(70/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-12-22T08:38:38.232 INFO:teuthology.orchestra.run.smithi031.stdout:(71/155): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 174 kB 00:00 2023-12-22T08:38:38.258 INFO:teuthology.orchestra.run.smithi031.stdout:(72/155): python3-prettytable-0.7.2-27.el9.noar 830 kB/s | 41 kB 00:00 2023-12-22T08:38:38.291 INFO:teuthology.orchestra.run.smithi031.stdout:(73/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2023-12-22T08:38:38.317 INFO:teuthology.orchestra.run.smithi031.stdout:(74/155): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 211 kB 00:00 2023-12-22T08:38:38.342 INFO:teuthology.orchestra.run.smithi031.stdout:(75/155): python3-pytz-2021.1-5.el9.noarch.rpm 948 kB/s | 47 kB 00:00 2023-12-22T08:38:38.367 INFO:teuthology.orchestra.run.smithi031.stdout:(76/155): python3-requests-oauthlib-1.3.0-12.el 853 kB/s | 43 kB 00:00 2023-12-22T08:38:38.484 INFO:teuthology.orchestra.run.smithi031.stdout:(77/155): python3-toml-0.10.2-6.el9.noarch.rpm 339 kB/s | 39 kB 00:00 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.45.9-1.el9.x86_64 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: acl-2.3.1-4.el9.x86_64 2023-12-22T08:38:38.582 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-0.190-2.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs-0.190-2.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-6.3.0-1.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2023-12-22T08:38:38.583 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.584 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-22T08:38:38.585 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.6-16.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-22T08:38:38.586 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-22T08:38:38.587 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.11-1.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.588 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.25.2-1.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-22T08:38:38.589 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-22T08:38:38.590 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-5.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-22T08:38:38.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-3.el9.x86_64 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2023-12-22T08:38:38.593 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-22T08:38:38.594 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-22T08:38:38.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:38:38.594 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-12-22T08:38:38.668 INFO:teuthology.orchestra.run.smithi031.stdout:(78/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2023-12-22T08:38:38.685 INFO:teuthology.orchestra.run.smithi031.stdout:(79/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 207 kB/s | 41 kB 00:00 2023-12-22T08:38:38.710 INFO:teuthology.orchestra.run.smithi031.stdout:(80/155): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-12-22T08:38:38.727 INFO:teuthology.orchestra.run.smithi031.stdout:(81/155): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2023-12-22T08:38:38.744 INFO:teuthology.orchestra.run.smithi031.stdout:(82/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.5 MB/s | 87 kB 00:00 2023-12-22T08:38:38.761 INFO:teuthology.orchestra.run.smithi031.stdout:(83/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-22T08:38:38.778 INFO:teuthology.orchestra.run.smithi031.stdout:(84/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-22T08:38:38.795 INFO:teuthology.orchestra.run.smithi031.stdout:(85/155): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2023-12-22T08:38:38.812 INFO:teuthology.orchestra.run.smithi031.stdout:(86/155): jq-1.6-16.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-12-22T08:38:38.845 INFO:teuthology.orchestra.run.smithi031.stdout:(87/155): libgfortran-11.4.1-2.3.el9.x86_64.rpm 16 MB/s | 803 kB 00:00 2023-12-22T08:38:38.871 INFO:teuthology.orchestra.run.smithi031.stdout:(88/155): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-12-22T08:38:38.896 INFO:teuthology.orchestra.run.smithi031.stdout:(89/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-22T08:38:38.921 INFO:teuthology.orchestra.run.smithi031.stdout:(90/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-22T08:38:38.955 INFO:teuthology.orchestra.run.smithi031.stdout:(91/155): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2023-12-22T08:38:38.980 INFO:teuthology.orchestra.run.smithi031.stdout:(92/155): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-22T08:38:39.006 INFO:teuthology.orchestra.run.smithi031.stdout:(93/155): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-12-22T08:38:39.031 INFO:teuthology.orchestra.run.smithi031.stdout:(94/155): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-22T08:38:39.056 INFO:teuthology.orchestra.run.smithi031.stdout:(95/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-12-22T08:38:39.164 INFO:teuthology.orchestra.run.smithi031.stdout:(96/155): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2023-12-22T08:38:39.271 DEBUG:teuthology.parallel:result is None 2023-12-22T08:38:39.290 INFO:teuthology.orchestra.run.smithi031.stdout:(97/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.4 MB/s | 309 kB 00:00 2023-12-22T08:38:39.482 INFO:teuthology.orchestra.run.smithi031.stdout:(98/155): libarrow-9.0.0-10.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2023-12-22T08:38:39.540 INFO:teuthology.orchestra.run.smithi031.stdout:(99/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 446 kB/s | 26 kB 00:00 2023-12-22T08:38:39.599 INFO:teuthology.orchestra.run.smithi031.stdout:(100/155): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2023-12-22T08:38:39.641 INFO:teuthology.orchestra.run.smithi031.stdout:(101/155): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2023-12-22T08:38:39.733 INFO:teuthology.orchestra.run.smithi031.stdout:(102/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.9 MB/s | 838 kB 00:00 2023-12-22T08:38:39.866 INFO:teuthology.orchestra.run.smithi031.stdout:(103/155): python3-asyncssh-2.13.2-3.el9.noarch 4.0 MB/s | 548 kB 00:00 2023-12-22T08:38:39.925 INFO:teuthology.orchestra.run.smithi031.stdout:(104/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2023-12-22T08:38:39.967 INFO:teuthology.orchestra.run.smithi031.stdout:(105/155): python3-cachetools-4.2.4-1.el9.noarc 773 kB/s | 32 kB 00:00 2023-12-22T08:38:40.026 INFO:teuthology.orchestra.run.smithi031.stdout:(106/155): python3-certifi-2021.10.8-2.el9.noar 257 kB/s | 15 kB 00:00 2023-12-22T08:38:40.067 INFO:teuthology.orchestra.run.smithi031.stdout:(107/155): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2023-12-22T08:38:40.126 INFO:teuthology.orchestra.run.smithi031.stdout:(108/155): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2023-12-22T08:38:40.234 INFO:teuthology.orchestra.run.smithi031.stdout:(109/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2023-12-22T08:38:40.268 INFO:teuthology.orchestra.run.smithi031.stdout:(110/155): python3-colorama-0.4.4-12.el9.noarch 1.0 MB/s | 35 kB 00:00 2023-12-22T08:38:40.302 INFO:teuthology.orchestra.run.smithi031.stdout:(111/155): python3-google-auth-2.25.2-1.el9.noa 5.8 MB/s | 199 kB 00:00 2023-12-22T08:38:40.335 INFO:teuthology.orchestra.run.smithi031.stdout:(112/155): python3-jaraco-8.2.1-3.el9.noarch.rp 322 kB/s | 11 kB 00:00 2023-12-22T08:38:40.377 INFO:teuthology.orchestra.run.smithi031.stdout:(113/155): python3-jaraco-classes-3.2.1-5.el9.n 425 kB/s | 18 kB 00:00 2023-12-22T08:38:40.411 INFO:teuthology.orchestra.run.smithi031.stdout:(114/155): python3-jaraco-collections-3.0.0-8.e 689 kB/s | 23 kB 00:00 2023-12-22T08:38:40.445 INFO:teuthology.orchestra.run.smithi031.stdout:(115/155): python3-jaraco-functools-3.5.0-2.el9 586 kB/s | 19 kB 00:00 2023-12-22T08:38:40.478 INFO:teuthology.orchestra.run.smithi031.stdout:(116/155): python3-jaraco-text-3.2.0-6.el9.noar 590 kB/s | 20 kB 00:00 2023-12-22T08:38:40.529 INFO:teuthology.orchestra.run.smithi031.stdout:(117/155): python3-jwt+crypto-2.4.0-1.el9.noarc 181 kB/s | 9.0 kB 00:00 2023-12-22T08:38:40.687 INFO:teuthology.orchestra.run.smithi031.stdout:(118/155): python3-jwt-2.4.0-1.el9.noarch.rpm 258 kB/s | 41 kB 00:00 2023-12-22T08:38:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:(119/155): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2023-12-22T08:38:40.838 INFO:teuthology.orchestra.run.smithi031.stdout:(120/155): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2023-12-22T08:38:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:(121/155): python3-devel-3.9.17-2.el9.x86_64.rp 132 kB/s | 245 kB 00:01 2023-12-22T08:38:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2023-12-22T08:38:40.980 INFO:teuthology.orchestra.run.smithi031.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 630 kB/s | 58 kB 00:00 2023-12-22T08:38:41.006 INFO:teuthology.orchestra.run.smithi031.stdout:(124/155): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2023-12-22T08:38:41.022 INFO:teuthology.orchestra.run.smithi031.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 391 kB/s | 16 kB 00:00 2023-12-22T08:38:41.048 INFO:teuthology.orchestra.run.smithi031.stdout:(126/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2023-12-22T08:38:41.073 INFO:teuthology.orchestra.run.smithi031.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2023-12-22T08:38:41.090 INFO:teuthology.orchestra.run.smithi031.stdout:(128/155): python3-repoze-lru-0.7-16.el9.noarch 734 kB/s | 31 kB 00:00 2023-12-22T08:38:41.123 INFO:teuthology.orchestra.run.smithi031.stdout:(129/155): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2023-12-22T08:38:41.157 INFO:teuthology.orchestra.run.smithi031.stdout:(130/155): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2023-12-22T08:38:41.182 INFO:teuthology.orchestra.run.smithi031.stdout:(131/155): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-22T08:38:41.233 INFO:teuthology.orchestra.run.smithi031.stdout:(132/155): python3-typing-extensions-4.4.0-2.el 679 kB/s | 51 kB 00:00 2023-12-22T08:38:41.258 INFO:teuthology.orchestra.run.smithi031.stdout:(133/155): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2023-12-22T08:38:41.283 INFO:teuthology.orchestra.run.smithi031.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2023-12-22T08:38:41.333 INFO:teuthology.orchestra.run.smithi031.stdout:(135/155): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2023-12-22T08:38:41.359 INFO:teuthology.orchestra.run.smithi031.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2023-12-22T08:38:41.434 INFO:teuthology.orchestra.run.smithi031.stdout:(137/155): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-12-22T08:38:41.501 INFO:teuthology.orchestra.run.smithi031.stdout:(138/155): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-22T08:38:42.701 INFO:teuthology.orchestra.run.smithi031.stdout:(139/155): librados2-18.2.0-1377.g24e2e32a.el9. 2.6 MB/s | 3.3 MB 00:01 2023-12-22T08:38:42.734 INFO:teuthology.orchestra.run.smithi031.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-22T08:38:42.810 INFO:teuthology.orchestra.run.smithi031.stdout:(141/155): NetworkManager-1.45.9-1.el9.x86_64.r 30 MB/s | 2.2 MB 00:00 2023-12-22T08:38:42.877 INFO:teuthology.orchestra.run.smithi031.stdout:(142/155): NetworkManager-libnm-1.45.9-1.el9.x8 27 MB/s | 1.8 MB 00:00 2023-12-22T08:38:42.910 INFO:teuthology.orchestra.run.smithi031.stdout:(143/155): NetworkManager-team-1.45.9-1.el9.x86 1.2 MB/s | 42 kB 00:00 2023-12-22T08:38:42.944 INFO:teuthology.orchestra.run.smithi031.stdout:(144/155): NetworkManager-tui-1.45.9-1.el9.x86_ 7.2 MB/s | 246 kB 00:00 2023-12-22T08:38:42.986 INFO:teuthology.orchestra.run.smithi031.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-22T08:38:43.019 INFO:teuthology.orchestra.run.smithi031.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 35 kB 00:00 2023-12-22T08:38:43.053 INFO:teuthology.orchestra.run.smithi031.stdout:(147/155): elfutils-libelf-0.190-2.el9.x86_64.r 5.6 MB/s | 191 kB 00:00 2023-12-22T08:38:43.095 INFO:teuthology.orchestra.run.smithi031.stdout:(148/155): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 254 kB 00:00 2023-12-22T08:38:43.127 INFO:teuthology.orchestra.run.smithi031.stdout:(149/155): libacl-2.3.1-4.el9.x86_64.rpm 699 kB/s | 22 kB 00:00 2023-12-22T08:38:43.310 INFO:teuthology.orchestra.run.smithi031.stdout:(150/155): openssl-3.0.7-25.el9.x86_64.rpm 6.3 MB/s | 1.2 MB 00:00 2023-12-22T08:38:43.385 INFO:teuthology.orchestra.run.smithi031.stdout:(151/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 29 MB/s | 2.1 MB 00:00 2023-12-22T08:38:43.450 INFO:teuthology.orchestra.run.smithi031.stdout:(152/155): xfsdump-3.1.12-4.el9.x86_64.rpm 4.9 MB/s | 321 kB 00:00 2023-12-22T08:38:43.511 INFO:teuthology.orchestra.run.smithi031.stdout:(153/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 17 MB/s | 1.1 MB 00:00 2023-12-22T08:38:46.353 INFO:teuthology.orchestra.run.smithi031.stdout:(154/155): librbd1-18.2.0-1377.g24e2e32a.el9.x8 633 kB/s | 3.0 MB 00:04 2023-12-22T08:38:47.453 INFO:teuthology.orchestra.run.smithi031.stdout:(155/155): ceph-test-18.2.0-1377.g24e2e32a.el9. 2.1 MB/s | 40 MB 00:19 2023-12-22T08:38:47.458 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2023-12-22T08:38:47.458 INFO:teuthology.orchestra.run.smithi031.stdout:Total 6.8 MB/s | 200 MB 00:29 2023-12-22T08:38:47.482 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2023-12-22T08:38:47.761 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2023-12-22T08:38:47.761 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2023-12-22T08:38:49.350 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2023-12-22T08:38:49.351 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2023-12-22T08:38:55.581 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2023-12-22T08:38:55.707 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2023-12-22T08:38:55.740 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/171 2023-12-22T08:38:55.779 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/171 2023-12-22T08:38:55.816 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/171 2023-12-22T08:38:55.841 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2023-12-22T08:38:55.883 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2023-12-22T08:38:56.209 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2023-12-22T08:38:56.250 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:38:56.367 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:38:56.392 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:38:56.484 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:38:56.513 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:38:56.601 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2023-12-22T08:38:56.681 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2023-12-22T08:38:56.871 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2023-12-22T08:38:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2023-12-22T08:38:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:38:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 15/171 2023-12-22T08:38:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:38:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 16/171 2023-12-22T08:38:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2023-12-22T08:38:57.304 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:38:57.364 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 18/171 2023-12-22T08:38:57.430 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:38:57.482 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:38:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.45.9-1.el9.x86_64 19/171 2023-12-22T08:38:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2023-12-22T08:38:57.882 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2023-12-22T08:38:57.943 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2023-12-22T08:38:57.972 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2023-12-22T08:38:58.008 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/171 2023-12-22T08:38:58.048 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/171 2023-12-22T08:38:58.122 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2023-12-22T08:38:58.155 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2023-12-22T08:38:58.182 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2023-12-22T08:38:58.253 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/171 2023-12-22T08:38:58.287 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 30/171 2023-12-22T08:38:58.348 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 31/171 2023-12-22T08:38:58.423 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 32/171 2023-12-22T08:38:58.568 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 33/171 2023-12-22T08:38:58.626 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 34/171 2023-12-22T08:38:59.187 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 35/171 2023-12-22T08:38:59.296 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 36/171 2023-12-22T08:38:59.335 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 37/171 2023-12-22T08:38:59.385 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 38/171 2023-12-22T08:38:59.429 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 39/171 2023-12-22T08:38:59.485 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 40/171 2023-12-22T08:38:59.643 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 41/171 2023-12-22T08:38:59.680 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 42/171 2023-12-22T08:38:59.791 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : re2-1:20211101-3.el9.x86_64 43/171 2023-12-22T08:38:59.825 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 44/171 2023-12-22T08:38:59.881 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/171 2023-12-22T08:38:59.954 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/171 2023-12-22T08:38:59.984 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/171 2023-12-22T08:39:00.021 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 48/171 2023-12-22T08:39:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/171 2023-12-22T08:39:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/171 2023-12-22T08:39:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/171 2023-12-22T08:39:00.197 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/171 2023-12-22T08:39:00.335 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/171 2023-12-22T08:39:00.385 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/171 2023-12-22T08:39:00.415 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 55/171 2023-12-22T08:39:00.457 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/171 2023-12-22T08:39:00.552 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/171 2023-12-22T08:39:00.590 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:2.25.2-1.el9.noarch 58/171 2023-12-22T08:39:00.630 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/171 2023-12-22T08:39:00.656 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/171 2023-12-22T08:39:00.683 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 61/171 2023-12-22T08:39:00.786 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fmt-8.1.1-5.el9.x86_64 62/171 2023-12-22T08:39:00.834 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/171 2023-12-22T08:39:00.891 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/171 2023-12-22T08:39:00.947 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/171 2023-12-22T08:39:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/171 2023-12-22T08:39:01.187 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/171 2023-12-22T08:39:01.330 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/171 2023-12-22T08:39:01.374 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/171 2023-12-22T08:39:01.402 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/171 2023-12-22T08:39:01.436 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/171 2023-12-22T08:39:01.469 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2023-12-22T08:39:01.501 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2023-12-22T08:39:01.536 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2023-12-22T08:39:01.567 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2023-12-22T08:39:01.594 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2023-12-22T08:39:01.629 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2023-12-22T08:39:01.669 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2023-12-22T08:39:01.709 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2023-12-22T08:39:01.738 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2023-12-22T08:39:01.817 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2023-12-22T08:39:01.848 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2023-12-22T08:39:01.881 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2023-12-22T08:39:01.923 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2023-12-22T08:39:01.982 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2023-12-22T08:39:02.074 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2023-12-22T08:39:02.110 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2023-12-22T08:39:02.206 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2023-12-22T08:39:02.261 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2023-12-22T08:39:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2023-12-22T08:39:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2023-12-22T08:39:03.099 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2023-12-22T08:39:03.148 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2023-12-22T08:39:03.237 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2023-12-22T08:39:03.283 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2023-12-22T08:39:03.469 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2023-12-22T08:39:03.497 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2023-12-22T08:39:03.577 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2023-12-22T08:39:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2023-12-22T08:39:04.366 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2023-12-22T08:39:05.645 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2023-12-22T08:39:05.733 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2023-12-22T08:39:05.761 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2023-12-22T08:39:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2023-12-22T08:39:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2023-12-22T08:39:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:39:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/171 2023-12-22T08:39:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 107/171 2023-12-22T08:39:06.299 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2023-12-22T08:39:06.720 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2023-12-22T08:39:06.751 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:39:06.806 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/171 2023-12-22T08:39:06.836 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/171 2023-12-22T08:39:08.947 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:39:08.976 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:39:09.541 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/171 2023-12-22T08:39:09.579 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:39:09.669 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/171 2023-12-22T08:39:09.669 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-22T08:39:09.669 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-22T08:39:09.670 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:09.697 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:39:21.496 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 114/171 2023-12-22T08:39:21.497 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2023-12-22T08:39:21.497 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2023-12-22T08:39:21.497 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2023-12-22T08:39:21.497 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2023-12-22T08:39:21.497 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2023-12-22T08:39:21.497 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /root 2023-12-22T08:39:21.497 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2023-12-22T08:39:21.497 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:21.657 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:39:21.674 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 115/171 2023-12-22T08:39:21.674 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:21.674 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-22T08:39:21.674 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:23.277 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:39:23.303 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/171 2023-12-22T08:39:23.304 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:23.304 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-22T08:39:23.304 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:39:23.304 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-22T08:39:23.304 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:23.511 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:39:23.534 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/171 2023-12-22T08:39:23.534 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:23.534 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-22T08:39:23.535 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:39:23.535 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-22T08:39:23.535 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:24.011 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:39:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 118/171 2023-12-22T08:39:24.035 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:24.035 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-22T08:39:24.035 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:39:24.035 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-22T08:39:24.035 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:24.130 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2023-12-22T08:39:24.568 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:39:24.594 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 120/171 2023-12-22T08:39:24.623 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 121/171 2023-12-22T08:39:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 122/171 2023-12-22T08:39:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:39:24.943 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 123/171 2023-12-22T08:39:24.976 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:39:25.991 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 124/171 2023-12-22T08:39:26.018 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:39:26.123 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 125/171 2023-12-22T08:39:26.281 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 126/171 2023-12-22T08:39:26.305 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:39:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 127/171 2023-12-22T08:39:26.328 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:26.328 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-22T08:39:26.328 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:39:26.328 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-22T08:39:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:39:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 128/171 2023-12-22T08:39:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 129/171 2023-12-22T08:39:27.172 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2023-12-22T08:39:27.198 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:39:27.221 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 131/171 2023-12-22T08:39:27.222 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:27.222 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-22T08:39:27.222 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:39:27.222 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-22T08:39:27.222 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:27.265 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:39:27.288 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 132/171 2023-12-22T08:39:27.288 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:27.288 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-22T08:39:27.288 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:27.333 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:39:27.356 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/171 2023-12-22T08:39:27.356 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:27.356 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-22T08:39:27.356 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:39:27.357 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-22T08:39:27.357 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:27.667 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:39:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/171 2023-12-22T08:39:27.690 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-22T08:39:27.690 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-22T08:39:27.690 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:39:27.690 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-22T08:39:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/171 2023-12-22T08:39:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/171 2023-12-22T08:39:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 137/171 2023-12-22T08:39:31.709 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2023-12-22T08:39:31.736 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2023-12-22T08:39:31.928 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:39:32.036 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2023-12-22T08:39:32.066 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:39:32.098 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 143/171 2023-12-22T08:39:32.130 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2023-12-22T08:39:32.160 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-team-1:1.45.9-1.el9.x86_64 145/171 2023-12-22T08:39:32.232 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-tui-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:39:32.274 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2023-12-22T08:39:32.309 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2023-12-22T08:39:32.958 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:39:32.998 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:39:33.025 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2023-12-22T08:39:33.088 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2023-12-22T08:39:33.972 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 151/171 2023-12-22T08:39:34.028 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2023-12-22T08:39:34.069 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2023-12-22T08:39:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2023-12-22T08:39:34.190 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2023-12-22T08:39:34.215 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2023-12-22T08:39:34.240 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:39:34.267 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2023-12-22T08:39:34.267 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:39:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2023-12-22T08:39:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2023-12-22T08:39:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2023-12-22T08:39:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2023-12-22T08:39:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:39:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:39:34.528 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2023-12-22T08:39:34.553 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2023-12-22T08:39:34.559 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:39:34.559 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:39:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2023-12-22T08:39:34.747 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:39:34.822 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2023-12-22T08:39:34.847 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2023-12-22T08:39:34.865 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2023-12-22T08:39:34.898 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2023-12-22T08:39:34.964 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:39:39.203 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/171 2023-12-22T08:39:39.204 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/171 2023-12-22T08:39:39.205 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/171 2023-12-22T08:39:39.206 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/171 2023-12-22T08:39:39.206 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/171 2023-12-22T08:39:39.206 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/171 2023-12-22T08:39:39.218 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/171 2023-12-22T08:39:39.218 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2023-12-22T08:39:39.219 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2023-12-22T08:39:39.220 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 58/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/171 2023-12-22T08:39:39.221 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 80/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 81/171 2023-12-22T08:39:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 82/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 83/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.6-16.el9.x86_64 87/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 90/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 91/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 92/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 93/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 94/171 2023-12-22T08:39:39.223 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 95/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 96/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/171 2023-12-22T08:39:39.224 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:2.25.2-1.el9.noarch 113/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2023-12-22T08:39:39.225 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2023-12-22T08:39:39.226 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.45.9-1.el9.x86_64 146/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.45.9-1.el9.x86_64 148/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2023-12-22T08:39:39.227 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.45.9-1.el9.x86_64 150/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.45.9-1.el9.x86_64 152/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2023-12-22T08:39:39.228 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2023-12-22T08:39:39.229 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2023-12-22T08:39:39.229 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2023-12-22T08:39:39.229 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2023-12-22T08:39:39.229 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2023-12-22T08:39:39.229 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2023-12-22T08:39:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2023-12-22T08:39:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:41.774 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2023-12-22T08:39:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-1:1.45.9-1.el9.x86_64 2023-12-22T08:39:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm-1:1.45.9-1.el9.x86_64 2023-12-22T08:39:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team-1:1.45.9-1.el9.x86_64 2023-12-22T08:39:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui-1:1.45.9-1.el9.x86_64 2023-12-22T08:39:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: acl-2.3.1-4.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-0.190-2.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs-0.190-2.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-6.3.0-1.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: automake-1.16.2-8.el9.noarch 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: bison-3.7.4-5.el9.x86_64 2023-12-22T08:39:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: flex-2.6.4-9.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: jq-1.6-16.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-22T08:39:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-22T08:39:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-13.11-1.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:2.25.2-1.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-22T08:39:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-22T08:39:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-22T08:39:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply-3.11-14.el9.noarch 2023-12-22T08:39:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-22T08:39:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-22T08:39:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-22T08:39:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-22T08:39:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-22T08:39:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-22T08:39:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-22T08:39:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.26.5-5.el9.noarch 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: re2-1:20211101-3.el9.x86_64 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-22T08:39:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2023-12-22T08:39:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-22T08:39:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-22T08:39:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:41.787 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2023-12-22T08:39:42.295 DEBUG:teuthology.parallel:result is None 2023-12-22T08:39:42.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:39:42.438 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-22T08:39:42.463 INFO:teuthology.orchestra.run.smithi031.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:42.463 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:42.463 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-22T08:39:42.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:39:42.608 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-22T08:39:42.634 INFO:teuthology.orchestra.run.smithi069.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:42.634 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:42.634 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-22T08:39:42.636 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-22T08:39:42.773 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-22T08:39:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:42.848 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-22T08:39:42.848 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-22T08:39:42.850 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-22T08:39:42.850 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:42.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T08:39:42.890 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:39:42.890 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T08:39:42.925 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:39:42.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T08:39:43.030 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-22T08:39:43.030 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:43.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T08:39:43.067 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T08:39:43.141 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:39:43.142 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T08:39:43.170 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T08:39:43.237 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:39:43.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T08:39:43.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T08:39:43.424 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-22T08:39:43.424 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:43.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T08:39:43.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T08:39:43.535 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:39:43.535 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T08:39:43.563 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T08:39:43.629 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:39:43.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T08:39:43.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T08:39:43.846 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-22T08:39:43.847 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:43.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T08:39:43.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T08:39:43.957 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:39:43.957 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T08:39:43.984 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T08:39:44.050 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:39:44.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T08:39:44.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T08:39:44.266 INFO:teuthology.run_tasks:Running task ceph... 2023-12-22T08:39:44.335 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-22T08:39:44.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2023-12-22T08:39:44.338 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /var/log/ceph 2023-12-22T08:39:44.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-12-22T08:39:44.424 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-22T08:39:44.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T08:39:44.426 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T08:39:44.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T08:39:44.507 INFO:tasks.ceph:Creating extra log directories... 2023-12-22T08:39:44.508 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T08:39:44.510 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T08:39:44.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T08:39:44.601 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-22T08:39:44.601 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-22T08:39:44.601 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-22T08:39:44.601 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:44.601 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T08:39:44.619 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:44.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:44.784 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:39:44.784 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T08:39:44.799 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:44.917 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:44.944 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:39:44.945 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T08:39:45.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:45.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-22T08:39:45.380 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-22T08:39:45.380 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-22T08:39:45.381 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264', 'branch': 'rishabh-mdscap-reef', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': None, 'first_in_suite': False, 'job_id': '7499264', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mdscap-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mdscap-reef', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 9974, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'sleep_before_teardown': 0, 'subset': '301/512', 'suite': 'fs', 'suite_branch': 'rishabh-mdscap-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB23JivX3NN0kJikQtmzVqu4rvaSH8xkeY/nxCbPif/BHykgD6P54hx0/ntSHiaNnM1xvcQbPT1AgynzyFQZM2g=', 'smithi069.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDAGJtlX1Wvr3Kk+bOb1TYcJrJLgT/Na2DrTcmUsGZS0WPS8rezYiW4P3EiEfDoftsSYKciV8cbqlGUemwH6lMY=', 'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmDN9xvpP3Iefh6BILfTx8zURGBu3p8av5TiH2xj2l+f7+ahFpQEltHPDJtBjzBJ2aXLXJZyGgu9vvzKxJ5Eg0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9680d2aba1e76f64ade295c81599c97907457848', 'timestamp': '2023-12-22_08:10:43', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-22T08:39:45.381 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T08:39:45.384 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T08:39:45.386 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T08:39:45.444 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T08:39:45.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T08:39:45.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T08:39:45.545 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:45.545 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2023-12-22T08:39:45.564 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-22T08:39:45.564 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2023-12-22T08:39:45.622 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-22T08:39:45.622 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:45.622 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 661 Links: 1 2023-12-22T08:39:45.622 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:45.622 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:45.622 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-12-22 08:39:35.313460943 +0000 2023-12-22T08:39:45.622 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-12-22 08:32:28.277186705 +0000 2023-12-22T08:39:45.623 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-12-22 08:32:28.277186705 +0000 2023-12-22T08:39:45.623 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-12-22 08:32:28.277186705 +0000 2023-12-22T08:39:45.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-22T08:39:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-12-22T08:39:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-12-22T08:39:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000216967 s, 2.4 MB/s 2023-12-22T08:39:45.697 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-22T08:39:45.755 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2023-12-22T08:39:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-22T08:39:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:45.814 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-22T08:39:45.814 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:45.814 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:45.815 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-12-22 08:39:35.313460943 +0000 2023-12-22T08:39:45.815 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-12-22 08:32:28.806178018 +0000 2023-12-22T08:39:45.815 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-12-22 08:32:28.806178018 +0000 2023-12-22T08:39:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-12-22 08:32:28.806178018 +0000 2023-12-22T08:39:45.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-22T08:39:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-12-22T08:39:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-12-22T08:39:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000222809 s, 2.3 MB/s 2023-12-22T08:39:45.888 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-22T08:39:45.946 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2023-12-22T08:39:46.003 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-22T08:39:46.003 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:46.003 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 699 Links: 1 2023-12-22T08:39:46.003 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:46.003 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:46.003 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-12-22 08:39:35.314460926 +0000 2023-12-22T08:39:46.003 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-12-22 08:32:29.322169544 +0000 2023-12-22T08:39:46.004 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-12-22 08:32:29.322169544 +0000 2023-12-22T08:39:46.004 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-12-22 08:32:29.322169544 +0000 2023-12-22T08:39:46.004 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-22T08:39:46.074 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-12-22T08:39:46.074 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-12-22T08:39:46.074 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000180209 s, 2.8 MB/s 2023-12-22T08:39:46.076 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-22T08:39:46.133 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2023-12-22T08:39:46.189 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-22T08:39:46.190 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:46.190 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 718 Links: 1 2023-12-22T08:39:46.190 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:46.190 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:46.190 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-12-22 08:39:35.314460926 +0000 2023-12-22T08:39:46.190 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-12-22 08:32:29.851160856 +0000 2023-12-22T08:39:46.190 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-12-22 08:32:29.851160856 +0000 2023-12-22T08:39:46.190 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-12-22 08:32:29.851160856 +0000 2023-12-22T08:39:46.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-22T08:39:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-12-22T08:39:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-12-22T08:39:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000180728 s, 2.8 MB/s 2023-12-22T08:39:46.262 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-22T08:39:46.319 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:46.319 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:39:46.319 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2023-12-22T08:39:46.335 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-22T08:39:46.335 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2023-12-22T08:39:46.390 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-22T08:39:46.391 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:46.391 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-22T08:39:46.391 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:46.391 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:46.391 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-22 08:38:29.392384727 +0000 2023-12-22T08:39:46.391 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-22 08:32:15.709669252 +0000 2023-12-22T08:39:46.391 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-22 08:32:15.709669252 +0000 2023-12-22T08:39:46.392 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-22 08:32:15.709669252 +0000 2023-12-22T08:39:46.392 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-22T08:39:46.457 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-22T08:39:46.457 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-22T08:39:46.457 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000210543 s, 2.4 MB/s 2023-12-22T08:39:46.458 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-22T08:39:46.515 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 680 Links: 1 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-22 08:38:29.393384703 +0000 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-22 08:32:16.242656981 +0000 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-22 08:32:16.242656981 +0000 2023-12-22T08:39:46.571 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-22 08:32:16.242656981 +0000 2023-12-22T08:39:46.572 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-22T08:39:46.638 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-22T08:39:46.638 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-22T08:39:46.638 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000288252 s, 1.8 MB/s 2023-12-22T08:39:46.638 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-22T08:39:46.694 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-22 08:38:29.393384703 +0000 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-22 08:32:16.740645516 +0000 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-22 08:32:16.740645516 +0000 2023-12-22T08:39:46.749 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-22 08:32:16.740645516 +0000 2023-12-22T08:39:46.750 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-22T08:39:46.814 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-22T08:39:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-22T08:39:46.815 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000201799 s, 2.5 MB/s 2023-12-22T08:39:46.816 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-22T08:39:46.872 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-22 08:38:29.394384681 +0000 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-22 08:32:17.232634190 +0000 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-22 08:32:17.232634190 +0000 2023-12-22T08:39:46.927 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-22 08:32:17.232634190 +0000 2023-12-22T08:39:46.928 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-22T08:39:46.992 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-22T08:39:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-22T08:39:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000218757 s, 2.3 MB/s 2023-12-22T08:39:46.994 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-22T08:39:47.049 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:47.050 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-22T08:39:47.050 INFO:tasks.ceph:Generating config... 2023-12-22T08:39:47.051 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-22T08:39:47.051 INFO:tasks.ceph:[client] debug client = 20 2023-12-22T08:39:47.051 INFO:tasks.ceph:[client] debug ms = 1 2023-12-22T08:39:47.051 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-22T08:39:47.051 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-22T08:39:47.051 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-12-22T08:39:47.051 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-22T08:39:47.051 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-22T08:39:47.051 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-22T08:39:47.052 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-22T08:39:47.052 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-22T08:39:47.052 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-22T08:39:47.052 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-22T08:39:47.052 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-22T08:39:47.053 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-22T08:39:47.053 INFO:tasks.ceph:Setting up mon.a... 2023-12-22T08:39:47.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-22T08:39:47.122 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2023-12-22T08:39:47.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-22T08:39:47.176 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T08:39:47.208 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '172.21.15.69'), ('mon.c', '[v2:172.21.15.69:3301,v1:172.21.15.69:6790]')] 2023-12-22T08:39:47.208 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-22T08:39:47.209 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:47.209 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-22T08:39:47.263 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --add b 172.21.15.69 --addv c '[v2:172.21.15.69:3301,v1:172.21.15.69:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:47.349 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:47.349 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid e4a54bac-4042-4984-af5f-75635705de5c 2023-12-22T08:39:47.349 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = pacific 2023-12-22T08:39:47.349 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2023-12-22T08:39:47.349 INFO:teuthology.orchestra.run.smithi031.stdout:fsid e4a54bac-4042-4984-af5f-75635705de5c 2023-12-22T08:39:47.349 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2023-12-22T08:39:47.347720+0000 2023-12-22T08:39:47.349 INFO:teuthology.orchestra.run.smithi031.stdout:created 2023-12-22T08:39:47.347720+0000 2023-12-22T08:39:47.350 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 16 (pacific) 2023-12-22T08:39:47.350 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2023-12-22T08:39:47.350 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2023-12-22T08:39:47.350 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.b 2023-12-22T08:39:47.350 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] mon.c 2023-12-22T08:39:47.350 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-22T08:39:47.351 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-22T08:39:47.367 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e4a54bac-4042-4984-af5f-75635705de5c... 2023-12-22T08:39:47.367 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T08:39:47.410 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T08:39:47.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T08:39:47.461 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-12-22T08:39:47.461 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2023-12-22T08:39:47.461 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2023-12-22T08:39:47.462 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2023-12-22T08:39:47.463 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2023-12-22T08:39:47.464 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = "172.21.15.31,172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790]" 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn min per osd = 0 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = e4a54bac-4042-4984-af5f-75635705de5c 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2023-12-22T08:39:47.465 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2023-12-22T08:39:47.466 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: bdev async discard = True 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: bdev enable discard = True 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore allocator = bitmap 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 1/20 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 1/20 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 4/10 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T08:39:47.467 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.468 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T08:39:47.469 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: mon op complaint time = 120 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2023-12-22T08:39:47.470 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout: client mount timeout = 600 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout: debug client = 20 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.b] 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.c] 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-12-22T08:39:47.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mds] 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds = 20 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds balancer = 20 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug frag = True 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug scatterstat = True 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: mds op complaint time = 180 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: mds verify scatter = True 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-12-22T08:39:47.472 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2023-12-22T08:39:47.473 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2023-12-22T08:39:47.474 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2023-12-22T08:39:47.475 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790]" 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn min per osd = 0 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e4a54bac-4042-4984-af5f-75635705de5c 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.476 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2023-12-22T08:39:47.477 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2023-12-22T08:39:47.478 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2023-12-22T08:39:47.479 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T08:39:47.480 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T08:39:47.481 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2023-12-22T08:39:47.482 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2023-12-22T08:39:47.483 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2023-12-22T08:39:47.483 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2023-12-22T08:39:47.483 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-12-22T08:39:47.483 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-12-22T08:39:47.483 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-12-22T08:39:47.594 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.31,172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790]" 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn min per osd = 0 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = e4a54bac-4042-4984-af5f-75635705de5c 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.596 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-12-22T08:39:47.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-12-22T08:39:47.598 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-12-22T08:39:47.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-22T08:39:47.601 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-12-22T08:39:47.602 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-12-22T08:39:47.603 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-12-22T08:39:47.638 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-22T08:39:47.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-22T08:39:47.698 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-22T08:39:47.698 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:47.698 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-22T08:39:47.713 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:47.713 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-22T08:39:47.768 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:39:47.768 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:47.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T08:39:47.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T08:39:47.854 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:39:47.854 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:47.909 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:39:47.909 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:39:47.909 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T08:39:47.910 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T08:39:47.949 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:39:47.949 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:48.004 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-12-22T08:39:48.004 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:39:48.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T08:39:48.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T08:39:48.165 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:39:48.165 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:48.263 INFO:tasks.ceph:Setting up mon nodes... 2023-12-22T08:39:48.263 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-22T08:39:48.264 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-22T08:39:48.329 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-22T08:39:48.332 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-22T08:39:48.393 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-22T08:39:48.396 INFO:tasks.ceph:Setting up mds nodes... 2023-12-22T08:39:48.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-22T08:39:48.461 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-22T08:39:48.464 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-22T08:39:48.494 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-22T08:39:48.596 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-22T08:39:48.598 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-22T08:39:48.629 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-22T08:39:48.683 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-22T08:39:48.685 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-22T08:39:48.712 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-22T08:39:48.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-22T08:39:48.856 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-22T08:39:48.916 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-22T08:39:48.916 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-22T08:39:48.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:48.948 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:48.948 INFO:tasks.ceph:role: osd.0 2023-12-22T08:39:48.948 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:39:48.949 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-22T08:39:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:49.028 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:49.028 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:49.028 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:49.028 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:49.028 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:49.029 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:49.029 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:49.549 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-12-22T08:39:49.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-12-22T08:39:49.552 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:49.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:49.757 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:49.831 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:49.832 INFO:tasks.ceph:role: osd.1 2023-12-22T08:39:49.832 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:39:49.832 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:49.912 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:49.913 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:50.353 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-12-22T08:39:50.355 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-12-22T08:39:50.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:50.469 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:50.509 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-22T08:39:50.583 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:50.583 INFO:tasks.ceph:role: osd.2 2023-12-22T08:39:50.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:39:50.584 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-22T08:39:50.664 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:50.664 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:50.664 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:50.664 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:50.664 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:50.664 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:50.664 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:50.665 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:50.665 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:50.665 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:51.149 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-12-22T08:39:51.151 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-12-22T08:39:51.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-22T08:39:51.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-22T08:39:51.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-22T08:39:51.390 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T08:39:51.390 INFO:tasks.ceph:role: osd.3 2023-12-22T08:39:51.390 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:39:51.390 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-22T08:39:51.472 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:39:51.472 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:39:51.472 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:39:51.472 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:39:51.472 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:39:51.472 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:39:51.472 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:39:51.473 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:39:51.473 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:39:51.473 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:39:51.959 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-12-22T08:39:51.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-12-22T08:39:51.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-22T08:39:52.096 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-22T08:39:52.132 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:52.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:52.228+0000 7f3868407500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-22T08:39:52.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:52.228+0000 7f3868407500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-22T08:39:52.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:52.228+0000 7f3868407500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T08:39:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:52.229+0000 7f3868407500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T08:39:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:52.229+0000 7f3868407500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T08:39:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:52.229+0000 7f3868407500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-22T08:39:55.081 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-22T08:39:55.117 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:55.210+0000 7fef0ee14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-22T08:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:55.211+0000 7fef0ee14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-22T08:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:55.211+0000 7fef0ee14500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T08:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:55.211+0000 7fef0ee14500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T08:39:55.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:55.211+0000 7fef0ee14500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T08:39:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:55.211+0000 7fef0ee14500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-22T08:39:58.071 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-22T08:39:58.107 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:39:58.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:58.199+0000 7fbc410d8500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-22T08:39:58.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:58.199+0000 7fbc410d8500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-22T08:39:58.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:58.199+0000 7fbc410d8500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T08:39:58.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:58.199+0000 7fbc410d8500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T08:39:58.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:58.199+0000 7fbc410d8500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T08:39:58.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:39:58.200+0000 7fbc410d8500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-22T08:40:01.053 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-22T08:40:01.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:40:01.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:01.181+0000 7fa266412500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-22T08:40:01.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:01.182+0000 7fa266412500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-22T08:40:01.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:01.182+0000 7fa266412500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T08:40:01.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:01.182+0000 7fa266412500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T08:40:01.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:01.182+0000 7fa266412500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T08:40:01.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:01.182+0000 7fa266412500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-22T08:40:04.038 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-22T08:40:04.074 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-22T08:40:04.108 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:40:04.108 INFO:tasks.ceph:role: osd.4 2023-12-22T08:40:04.108 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:40:04.108 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-22T08:40:04.186 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:40:04.187 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:40:04.668 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-12-22T08:40:04.673 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-12-22T08:40:04.673 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-22T08:40:04.786 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-22T08:40:04.823 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-22T08:40:04.893 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:40:04.893 INFO:tasks.ceph:role: osd.5 2023-12-22T08:40:04.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:40:04.894 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-22T08:40:04.970 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:40:04.970 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:40:04.970 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:40:04.970 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:40:04.971 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:40:04.971 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:40:04.971 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:40:04.971 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:40:04.971 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:40:04.971 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:40:05.419 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-12-22T08:40:05.421 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-12-22T08:40:05.421 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-22T08:40:05.499 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-22T08:40:05.571 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-22T08:40:05.638 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:40:05.638 INFO:tasks.ceph:role: osd.6 2023-12-22T08:40:05.638 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:40:05.639 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:40:05.712 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:40:06.196 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-12-22T08:40:06.198 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-12-22T08:40:06.198 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-22T08:40:06.293 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-22T08:40:06.323 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-22T08:40:06.390 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T08:40:06.390 INFO:tasks.ceph:role: osd.7 2023-12-22T08:40:06.390 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:40:06.390 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-22T08:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T08:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T08:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T08:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-22T08:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T08:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-12-22T08:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T08:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-22T08:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T08:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T08:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-12-22T08:40:06.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-12-22T08:40:06.969 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-22T08:40:07.103 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-22T08:40:07.137 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:40:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:07.235+0000 7f710a60c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-22T08:40:07.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:07.238+0000 7f710a60c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-22T08:40:07.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:07.239+0000 7f710a60c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T08:40:07.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:07.239+0000 7f710a60c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T08:40:07.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:07.239+0000 7f710a60c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T08:40:07.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:07.241+0000 7f710a60c500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-22T08:40:10.103 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-22T08:40:10.134 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:40:10.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:10.223+0000 7f6daae1a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-22T08:40:10.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:10.223+0000 7f6daae1a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-22T08:40:10.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:10.223+0000 7f6daae1a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T08:40:10.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:10.223+0000 7f6daae1a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T08:40:10.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:10.223+0000 7f6daae1a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T08:40:10.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:10.225+0000 7f6daae1a500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-22T08:40:13.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-22T08:40:13.112 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:40:13.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:13.200+0000 7f4c29e12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-22T08:40:13.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:13.200+0000 7f4c29e12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-22T08:40:13.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:13.200+0000 7f4c29e12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T08:40:13.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:13.200+0000 7f4c29e12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T08:40:13.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:13.200+0000 7f4c29e12500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T08:40:13.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:13.200+0000 7f4c29e12500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-22T08:40:15.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:15.385 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:15.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:16.045 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-22T08:40:16.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:40:16.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:16.157+0000 7f4eab794500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-22T08:40:16.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:16.157+0000 7f4eab794500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-22T08:40:16.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:16.157+0000 7f4eab794500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T08:40:16.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:16.157+0000 7f4eab794500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T08:40:16.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:16.157+0000 7f4eab794500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T08:40:16.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:16.158+0000 7f4eab794500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-22T08:40:18.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-22T08:40:19.028 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-22T08:40:19.028 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:19.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-22T08:40:19.064 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:19.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-22T08:40:19.138 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:19.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-22T08:40:19.215 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:19.215 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-22T08:40:19.286 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:19.286 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-22T08:40:19.358 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:19.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-22T08:40:19.430 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:19.430 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-22T08:40:19.501 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:19.501 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-22T08:40:19.534 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:19.534 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-22T08:40:19.604 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:19.605 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-22T08:40:19.675 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:19.676 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-22T08:40:19.745 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:19.745 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-22T08:40:19.815 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:19.815 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-22T08:40:19.884 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:40:19.884 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-22T08:40:19.945 INFO:tasks.ceph:Adding keys to all mons... 2023-12-22T08:40:19.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-22T08:40:19.948 DEBUG:teuthology.orchestra.run.smithi069:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-22T08:40:19.975 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.y] 2023-12-22T08:40:19.976 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBUS4Vl11+SExAAjvtZTtIUNoWGp6Afd597xw== 2023-12-22T08:40:19.976 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-12-22T08:40:19.976 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBUS4VluohwGxAA9l0mu9Qu9WflbVuQTUFOXA== 2023-12-22T08:40:19.976 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-12-22T08:40:19.976 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBUS4VlkFl3IxAADjuJaJmvn4B/w4NiOYytng== 2023-12-22T08:40:19.976 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.0] 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBYS4Vl+XevDRAA4l00XtZM7YHTHcuCNls+aQ== 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.1] 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBbS4Vl7CyfDBAA0arhtS3pCgpnRVwSdoRpbA== 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.2] 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBeS4VlfHX1CxAAVfkYlsCz603HDpa1ah+giA== 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.3] 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBhS4VlFAvnChAAeAVJVTALAUTZ/SnA7Rfvkg== 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.x] 2023-12-22T08:40:19.977 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBUS4VlaUNiFxAAUjWTvHgVgKfGMlRJqne8gw== 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBUS4VlhbypKBAAYYlRglfH3XaoJFivmxXImQ== 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.4] 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBnS4VlYQAZDhAAqBnHlQirGa3rI6dqIh+9WA== 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.5] 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBqS4VlxntiDRAACEtFiOZ36WLlAurFiSBoMg== 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.6] 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBtS4VlhT/9CxAA0qTCjEZeqkW/9l66toosZA== 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.7] 2023-12-22T08:40:19.978 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBwS4VlJB1uCRAABFBgUz2o1EFYZpac987hbA== 2023-12-22T08:40:19.979 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2023-12-22T08:40:19.979 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQBUS4Vlmjv6MhAAb3tw7TH+NUjFZ91G8B4xbQ== 2023-12-22T08:40:19.979 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2023-12-22T08:40:19.979 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBUS4Vl11+SExAAjvtZTtIUNoWGp6Afd597xw== 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBUS4VluohwGxAA9l0mu9Qu9WflbVuQTUFOXA== 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBUS4VlkFl3IxAADjuJaJmvn4B/w4NiOYytng== 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBYS4Vl+XevDRAA4l00XtZM7YHTHcuCNls+aQ== 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBbS4Vl7CyfDBAA0arhtS3pCgpnRVwSdoRpbA== 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBeS4VlfHX1CxAAVfkYlsCz603HDpa1ah+giA== 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2023-12-22T08:40:19.980 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBhS4VlFAvnChAAeAVJVTALAUTZ/SnA7Rfvkg== 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBUS4VlaUNiFxAAUjWTvHgVgKfGMlRJqne8gw== 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBUS4VlhbypKBAAYYlRglfH3XaoJFivmxXImQ== 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBnS4VlYQAZDhAAqBnHlQirGa3rI6dqIh+9WA== 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBqS4VlxntiDRAACEtFiOZ36WLlAurFiSBoMg== 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBtS4VlhT/9CxAA0qTCjEZeqkW/9l66toosZA== 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBwS4VlJB1uCRAABFBgUz2o1EFYZpac987hbA== 2023-12-22T08:40:19.981 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2023-12-22T08:40:19.982 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBUS4Vlmjv6MhAAb3tw7TH+NUjFZ91G8B4xbQ== 2023-12-22T08:40:19.983 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T08:40:20.027 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T08:40:20.084 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:40:20.087 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:40:20.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:40:20.148 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:40:20.205 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.208 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.261 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.264 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.318 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.374 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.426 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T08:40:20.429 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T08:40:20.482 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:40:20.485 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T08:40:20.541 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.544 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.597 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.599 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.652 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.654 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T08:40:20.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:40:20.767 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T08:40:20.823 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-22T08:40:20.823 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-22T08:40:20.854 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T08:40:20.955 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-22T08:40:20.985 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-22T08:40:21.013 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T08:40:21.112 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-22T08:40:21.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-22T08:40:21.205 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T08:40:21.302 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-22T08:40:21.329 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:40:21.331 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-22T08:40:21.384 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-22T08:40:21.385 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-22T08:40:21.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-22T08:40:21.387 INFO:tasks.ceph.mon.a:Started 2023-12-22T08:40:21.388 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-22T08:40:21.388 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-22T08:40:21.427 INFO:tasks.ceph.mon.b:Started 2023-12-22T08:40:21.427 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-22T08:40:21.427 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-22T08:40:21.429 INFO:tasks.ceph.mon.c:Started 2023-12-22T08:40:21.429 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-22T08:40:21.429 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-22T08:40:21.430 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-22T08:40:21.432 INFO:tasks.ceph.mgr.y:Started 2023-12-22T08:40:21.432 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-22T08:40:21.432 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-22T08:40:21.434 INFO:tasks.ceph.mgr.x:Started 2023-12-22T08:40:21.434 INFO:tasks.ceph:Setting crush tunables to default 2023-12-22T08:40:21.434 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2023-12-22T08:40:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.539+0000 7f9bf2496640 1 Processor -- start 2023-12-22T08:40:21.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.539+0000 7f9bf2496640 1 -- start start 2023-12-22T08:40:21.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bf2496640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9bec144e40 0x7f9bec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bf2496640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bf2496640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec14f0d0 con 0x7f9bec14ec40 2023-12-22T08:40:21.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bf2496640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec070630 con 0x7f9bec144e40 2023-12-22T08:40:21.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bf2496640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec070070 con 0x7f9bec0b0a40 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bebfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9bec144e40 0x7f9bec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bebfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9bec144e40 0x7f9bec06d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34064/0 (socket says 172.21.15.31:34064) 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bebfff640 1 -- 172.21.15.31:0/2739113763 learned_addr learned my addr 172.21.15.31:0/2739113763 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bebfff640 1 -- 172.21.15.31:0/2739113763 >> v2:172.21.15.31:3300/0 conn(0x7f9bec144e40 msgr2=0x7f9bec06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bebfff640 1 -- 172.21.15.31:0/2739113763 >> v2:172.21.15.31:3300/0 conn(0x7f9bec144e40 msgr2=0x7f9bec06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bebfff640 1 --2- 172.21.15.31:0/2739113763 >> v2:172.21.15.31:3300/0 conn(0x7f9bec144e40 0x7f9bec06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9bebfff640 1 --2- 172.21.15.31:0/2739113763 >> v2:172.21.15.31:3300/0 conn(0x7f9bec144e40 0x7f9bec06d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9beb7fe640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9beb7fe640 1 -- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 msgr2=0x7f9bec14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-22T08:40:21.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9beb7fe640 1 -- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 msgr2=0x7f9bec14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T08:40:21.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9beb7fe640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-22T08:40:21.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.540+0000 7f9beb7fe640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9bebfff640 1 --2- 172.21.15.31:0/2739113763 >> v2:172.21.15.31:3300/0 conn(0x7f9bec144e40 0x7f9bec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9beb7fe640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9beb7fe640 1 -- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 msgr2=0x7f9bec14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9beb7fe640 1 -- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 msgr2=0x7f9bec14e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9beb7fe640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9beb7fe640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9bebfff640 1 -- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 msgr2=0x7f9bec14e700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9bebfff640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9bebfff640 1 -- 172.21.15.31:0/2739113763 >> v1:172.21.15.69:6789/0 conn(0x7f9bec14ec40 legacy=0x7f9bec069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.741+0000 7f9bebfff640 1 -- 172.21.15.31:0/2739113763 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec070350 con 0x7f9bec144e40 2023-12-22T08:40:21.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.742+0000 7f9bebfff640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec06d680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009100 tx=0x7f9bdc02bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815e44d02278a45e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.742+0000 7f9beaffd640 1 -- 172.21.15.31:0/2739113763 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc02ca90 con 0x7f9bec144e40 2023-12-22T08:40:21.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.742+0000 7f9beaffd640 1 -- 172.21.15.31:0/2739113763 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc02cbf0 con 0x7f9bec144e40 2023-12-22T08:40:21.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.742+0000 7f9beaffd640 1 -- 172.21.15.31:0/2739113763 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc034440 con 0x7f9bec144e40 2023-12-22T08:40:21.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.743+0000 7f9bf2496640 1 -- 172.21.15.31:0/2739113763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 msgr2=0x7f9bec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.743+0000 7f9bf2496640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec06d680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009100 tx=0x7f9bdc02bce0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.743+0000 7f9bf2496640 1 -- 172.21.15.31:0/2739113763 shutdown_connections 2023-12-22T08:40:21.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.743+0000 7f9bf2496640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.743+0000 7f9bf2496640 1 --2- 172.21.15.31:0/2739113763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec06d680 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.743+0000 7f9bf2496640 1 -- 172.21.15.31:0/2739113763 >> 172.21.15.31:0/2739113763 conn(0x7f9bec06ae10 msgr2=0x7f9bec06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:21.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.743+0000 7f9bf2496640 1 -- 172.21.15.31:0/2739113763 shutdown_connections 2023-12-22T08:40:21.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.743+0000 7f9bf2496640 1 -- 172.21.15.31:0/2739113763 wait complete. 2023-12-22T08:40:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.744+0000 7f9bf2496640 1 Processor -- start 2023-12-22T08:40:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.744+0000 7f9bf2496640 1 -- start start 2023-12-22T08:40:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9bf2496640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9bf2496640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec1e00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9bf2496640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bec14ec40 0x7f9bec1e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9bf2496640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1459e0 con 0x7f9bec144e40 2023-12-22T08:40:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9bf2496640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1dfc00 con 0x7f9bec14ec40 2023-12-22T08:40:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9bf2496640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1e38e0 con 0x7f9bec0b0a40 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9beb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec1e00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9beb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec1e00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34104/0 (socket says 172.21.15.31:34104) 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9beb7fe640 1 -- 172.21.15.31:0/3740466747 learned_addr learned my addr 172.21.15.31:0/3740466747 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.745+0000 7f9bf0a33640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bec14ec40 0x7f9bec1e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.746+0000 7f9bebfff640 1 -- 172.21.15.31:0/3740466747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bec14ec40 msgr2=0x7f9bec1e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.746+0000 7f9bebfff640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bec14ec40 0x7f9bec1e05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.746+0000 7f9bebfff640 1 -- 172.21.15.31:0/3740466747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 msgr2=0x7f9bec1e00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.746+0000 7f9bebfff640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec1e00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.746+0000 7f9bebfff640 1 -- 172.21.15.31:0/3740466747 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc0095b0 con 0x7f9bec0b0a40 2023-12-22T08:40:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.746+0000 7f9beb7fe640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec1e00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:21.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.746+0000 7f9bebfff640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14d1e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc033000 tx=0x7f9bdc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.751+0000 7f9be8ff9640 1 -- 172.21.15.31:0/3740466747 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc003ae0 con 0x7f9bec0b0a40 2023-12-22T08:40:21.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.751+0000 7f9be8ff9640 1 -- 172.21.15.31:0/3740466747 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc003c40 con 0x7f9bec0b0a40 2023-12-22T08:40:21.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.751+0000 7f9be8ff9640 1 -- 172.21.15.31:0/3740466747 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc034440 con 0x7f9bec0b0a40 2023-12-22T08:40:21.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.751+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec1e3bc0 con 0x7f9bec0b0a40 2023-12-22T08:40:21.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.751+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec14ded0 con 0x7f9bec0b0a40 2023-12-22T08:40:21.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.751+0000 7f9be8ff9640 1 -- 172.21.15.31:0/3740466747 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9bdc03b050 con 0x7f9bec0b0a40 2023-12-22T08:40:21.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.752+0000 7f9be8ff9640 1 -- 172.21.15.31:0/3740466747 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9bdc0498c0 con 0x7f9bec0b0a40 2023-12-22T08:40:21.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.752+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec1dfdd0 con 0x7f9bec0b0a40 2023-12-22T08:40:21.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.756+0000 7f9be8ff9640 1 -- 172.21.15.31:0/3740466747 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f9bdc04e060 con 0x7f9bec0b0a40 2023-12-22T08:40:21.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.860+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9bec073a40 con 0x7f9bec0b0a40 2023-12-22T08:40:21.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.868+0000 7f9be8ff9640 1 -- 172.21.15.31:0/3740466747 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9bdc044070 con 0x7f9bec0b0a40 2023-12-22T08:40:21.871 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2023-12-22T08:40:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 msgr2=0x7f9bec14d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14d1e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc033000 tx=0x7f9bdc004730 comp rx=0 tx=0).stop 2023-12-22T08:40:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 shutdown_connections 2023-12-22T08:40:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bec14ec40 0x7f9bec1e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec144e40 0x7f9bec1e00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 --2- 172.21.15.31:0/3740466747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9bec0b0a40 0x7f9bec14d1e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 >> 172.21.15.31:0/3740466747 conn(0x7f9bec06ae10 msgr2=0x7f9bec06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:21.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 shutdown_connections 2023-12-22T08:40:21.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:21.869+0000 7f9bf2496640 1 -- 172.21.15.31:0/3740466747 wait complete. 2023-12-22T08:40:21.883 INFO:tasks.ceph:check_enable_crimson: False 2023-12-22T08:40:21.883 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-22T08:40:21.883 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:21.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-22T08:40:21.914 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:21.914 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-22T08:40:21.985 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:21.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-22T08:40:22.056 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-12-22T08:40:22.056 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-22T08:40:22.127 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:22.127 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-22T08:40:22.154 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:22.154 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-22T08:40:22.180 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:22.177+0000 7f7e7101c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-22T08:40:22.206 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:22.206 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-22T08:40:22.234 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:22.231+0000 7f7e7101c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-22T08:40:22.241 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:22.239+0000 7f44f6e17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-22T08:40:22.260 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-22T08:40:22.260 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-22T08:40:22.295 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:22.293+0000 7f44f6e17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-22T08:40:22.327 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 73bbab90-3a3c-4844-81e9-e85e6938f760 0 2023-12-22T08:40:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.464+0000 7fabed347640 1 Processor -- start 2023-12-22T08:40:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.464+0000 7fabed347640 1 -- start start 2023-12-22T08:40:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabed347640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fabe806a650 0x7fabe80b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabed347640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe80b8070 0x7fabe80b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabed347640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80ba770 con 0x7fabe8065c10 2023-12-22T08:40:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabed347640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80bbc10 con 0x7fabe806a650 2023-12-22T08:40:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabed347640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80b74a0 con 0x7fabe80b8070 2023-12-22T08:40:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe77fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe80b8070 0x7fabe80b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe6ffd640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fabe8065c10 0x7fabe8069f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57256/0 (socket says 172.21.15.69:57256) 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe6ffd640 1 -- 172.21.15.69:0/794652104 learned_addr learned my addr 172.21.15.69:0/794652104 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe67fc640 1 --2- 172.21.15.69:0/794652104 >> v2:172.21.15.31:3300/0 conn(0x7fabe806a650 0x7fabe80b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe5ffb640 1 -- 172.21.15.69:0/794652104 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312210782 0 0) 0x7fabe80ba770 con 0x7fabe8065c10 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe5ffb640 1 -- 172.21.15.69:0/794652104 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd0003520 con 0x7fabe8065c10 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe77fe640 1 -- 172.21.15.69:0/794652104 >> v2:172.21.15.31:3300/0 conn(0x7fabe806a650 msgr2=0x7fabe80b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe77fe640 1 --2- 172.21.15.69:0/794652104 >> v2:172.21.15.31:3300/0 conn(0x7fabe806a650 0x7fabe80b7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe77fe640 1 -- 172.21.15.69:0/794652104 >> v1:172.21.15.69:6789/0 conn(0x7fabe8065c10 legacy=0x7fabe8069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.465+0000 7fabe77fe640 1 -- 172.21.15.69:0/794652104 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80bb550 con 0x7fabe80b8070 2023-12-22T08:40:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.466+0000 7fabe77fe640 1 --2- 172.21.15.69:0/794652104 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe80b8070 0x7fabe80b8450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009d90 tx=0x7fabe002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=863a7636b766647b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.466+0000 7fabe5ffb640 1 -- 172.21.15.69:0/794652104 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe002cc50 con 0x7fabe80b8070 2023-12-22T08:40:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.466+0000 7fabe5ffb640 1 -- 172.21.15.69:0/794652104 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe002cdb0 con 0x7fabe80b8070 2023-12-22T08:40:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.466+0000 7fabe5ffb640 1 -- 172.21.15.69:0/794652104 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0034660 con 0x7fabe80b8070 2023-12-22T08:40:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.467+0000 7fabed347640 1 -- 172.21.15.69:0/794652104 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe80b8070 msgr2=0x7fabe80b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.467+0000 7fabed347640 1 --2- 172.21.15.69:0/794652104 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe80b8070 0x7fabe80b8450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009d90 tx=0x7fabe002bea0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.467+0000 7fabed347640 1 -- 172.21.15.69:0/794652104 shutdown_connections 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.467+0000 7fabed347640 1 --2- 172.21.15.69:0/794652104 >> v2:172.21.15.31:3300/0 conn(0x7fabe806a650 0x7fabe80b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.467+0000 7fabed347640 1 --2- 172.21.15.69:0/794652104 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe80b8070 0x7fabe80b8450 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.467+0000 7fabed347640 1 -- 172.21.15.69:0/794652104 >> 172.21.15.69:0/794652104 conn(0x7fabe80b9250 msgr2=0x7fabe80b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.467+0000 7fabed347640 1 -- 172.21.15.69:0/794652104 shutdown_connections 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.467+0000 7fabed347640 1 -- 172.21.15.69:0/794652104 wait complete. 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.468+0000 7fabed347640 1 Processor -- start 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.468+0000 7fabed347640 1 -- start start 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabed347640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe8065c10 0x7fabe81a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabed347640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe806a650 0x7fabe80b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabed347640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe80b8070 0x7fabe809ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabed347640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe809bbe0 con 0x7fabe806a650 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabed347640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80992d0 con 0x7fabe80b8070 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabed347640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe81e1050 con 0x7fabe8065c10 2023-12-22T08:40:22.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe8065c10 0x7fabe81a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe77fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe80b8070 0x7fabe809ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe8065c10 0x7fabe81a9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:47652/0 (socket says 172.21.15.69:47652) 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 -- 172.21.15.69:0/907262717 learned_addr learned my addr 172.21.15.69:0/907262717 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe77fe640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe80b8070 0x7fabe809ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59256/0 (socket says 172.21.15.69:59256) 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe67fc640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe806a650 0x7fabe80b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 -- 172.21.15.69:0/907262717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe80b8070 msgr2=0x7fabe809ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe80b8070 0x7fabe809ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 -- 172.21.15.69:0/907262717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe806a650 msgr2=0x7fabe80b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe806a650 0x7fabe80b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 -- 172.21.15.69:0/907262717 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009a70 con 0x7fabe8065c10 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabe6ffd640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe8065c10 0x7fabe81a9290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c500 tx=0x7fabdc00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabcf7fe640 1 -- 172.21.15.69:0/907262717 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc005ce0 con 0x7fabe8065c10 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabcf7fe640 1 -- 172.21.15.69:0/907262717 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc005e40 con 0x7fabe8065c10 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabcf7fe640 1 -- 172.21.15.69:0/907262717 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc007330 con 0x7fabe8065c10 2023-12-22T08:40:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe81e1330 con 0x7fabe8065c10 2023-12-22T08:40:22.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe809b2a0 con 0x7fabe8065c10 2023-12-22T08:40:22.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabcf7fe640 1 -- 172.21.15.69:0/907262717 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fabdc01c440 con 0x7fabe8065c10 2023-12-22T08:40:22.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.469+0000 7fabcf7fe640 1 -- 172.21.15.69:0/907262717 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fabdc012940 con 0x7fabe8065c10 2023-12-22T08:40:22.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.470+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe8073a40 con 0x7fabe8065c10 2023-12-22T08:40:22.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.472+0000 7fabcf7fe640 1 -- 172.21.15.69:0/907262717 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fabdc017070 con 0x7fabe8065c10 2023-12-22T08:40:22.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.544+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd new", "uuid": "73bbab90-3a3c-4844-81e9-e85e6938f760", "id": 0} v 0) v1 -- 0x7fabe80b7e50 con 0x7fabe8065c10 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabcf7fe640 1 -- 172.21.15.69:0/907262717 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73bbab90-3a3c-4844-81e9-e85e6938f760", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fabdc01b3b0 con 0x7fabe8065c10 2023-12-22T08:40:22.549 INFO:teuthology.orchestra.run.smithi069.stdout:0 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe8065c10 msgr2=0x7fabe81a9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabed347640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe8065c10 0x7fabe81a9290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c500 tx=0x7fabdc00c9c0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 shutdown_connections 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabed347640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe80b8070 0x7fabe809ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabed347640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe806a650 0x7fabe80b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabed347640 1 --2- 172.21.15.69:0/907262717 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fabe8065c10 0x7fabe81a9290 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 >> 172.21.15.69:0/907262717 conn(0x7fabe80b9250 msgr2=0x7fabe809dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.547+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 shutdown_connections 2023-12-22T08:40:22.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.548+0000 7fabed347640 1 -- 172.21.15.69:0/907262717 wait complete. 2023-12-22T08:40:22.560 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 1f73a722-71ce-4761-be63-24052f045111 1 2023-12-22T08:40:22.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.657+0000 7f8fb72ab640 1 Processor -- start 2023-12-22T08:40:22.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.657+0000 7f8fb72ab640 1 -- start start 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb72ab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb0065c10 0x7f8fb006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb72ab640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8fb0152aa0 0x7f8fb0154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb72ab640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb00ba5d0 con 0x7f8fb00b7410 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb72ab640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00bbf00 con 0x7f8fb0152aa0 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb72ab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0072130 con 0x7f8fb0065c10 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb5047640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb0065c10 0x7f8fb006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb4846640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8fb00b7410 0x7f8fb00ba800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57258/0 (socket says 172.21.15.69:57258) 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb4846640 1 -- 172.21.15.69:0/3794867065 learned_addr learned my addr 172.21.15.69:0/3794867065 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb5047640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb0065c10 0x7f8fb006a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:47666/0 (socket says 172.21.15.69:47666) 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fb5848640 1 --2- 172.21.15.69:0/3794867065 >> v2:172.21.15.31:3300/0 conn(0x7f8fb0152aa0 0x7f8fb0154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.658+0000 7f8fa7fff640 1 -- 172.21.15.69:0/3794867065 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426223990 0 0) 0x7f8fb00ba5d0 con 0x7f8fb00b7410 2023-12-22T08:40:22.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fa7fff640 1 -- 172.21.15.69:0/3794867065 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f9c003520 con 0x7f8fb00b7410 2023-12-22T08:40:22.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fb5047640 1 -- 172.21.15.69:0/3794867065 >> v2:172.21.15.31:3300/0 conn(0x7f8fb0152aa0 msgr2=0x7f8fb0154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:22.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fb5047640 1 --2- 172.21.15.69:0/3794867065 >> v2:172.21.15.31:3300/0 conn(0x7f8fb0152aa0 0x7f8fb0154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fb5047640 1 -- 172.21.15.69:0/3794867065 >> v1:172.21.15.69:6789/0 conn(0x7f8fb00b7410 legacy=0x7f8fb00ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fb5047640 1 -- 172.21.15.69:0/3794867065 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb006a3b0 con 0x7f8fb0065c10 2023-12-22T08:40:22.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fb5047640 1 --2- 172.21.15.69:0/3794867065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb0065c10 0x7f8fb006a8d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00097a0 tx=0x7f8fa002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d1c113846ed4358 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fa7fff640 1 -- 172.21.15.69:0/3794867065 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0031780 con 0x7f8fb0065c10 2023-12-22T08:40:22.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fa7fff640 1 -- 172.21.15.69:0/3794867065 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa00318e0 con 0x7f8fb0065c10 2023-12-22T08:40:22.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.659+0000 7f8fa7fff640 1 -- 172.21.15.69:0/3794867065 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0031c70 con 0x7f8fb0065c10 2023-12-22T08:40:22.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.660+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3794867065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb0065c10 msgr2=0x7f8fb006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.660+0000 7f8fb72ab640 1 --2- 172.21.15.69:0/3794867065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb0065c10 0x7f8fb006a8d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00097a0 tx=0x7f8fa002b820 comp rx=0 tx=0).stop 2023-12-22T08:40:22.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.660+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3794867065 shutdown_connections 2023-12-22T08:40:22.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.660+0000 7f8fb72ab640 1 --2- 172.21.15.69:0/3794867065 >> v2:172.21.15.31:3300/0 conn(0x7f8fb0152aa0 0x7f8fb0154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.660+0000 7f8fb72ab640 1 --2- 172.21.15.69:0/3794867065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb0065c10 0x7f8fb006a8d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.660+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3794867065 >> 172.21.15.69:0/3794867065 conn(0x7f8fb00b9250 msgr2=0x7f8fb00b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.660+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3794867065 shutdown_connections 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.660+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3794867065 wait complete. 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.661+0000 7f8fb72ab640 1 Processor -- start 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.661+0000 7f8fb72ab640 1 -- start start 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb72ab640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fb0065c10 0x7f8fb009faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb72ab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb00b7410 0x7f8fb01495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb72ab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb0152aa0 0x7f8fb0149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb72ab640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0071590 con 0x7f8fb0152aa0 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb72ab640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00a0030 con 0x7f8fb0065c10 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb72ab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00707c0 con 0x7f8fb00b7410 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5047640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fb0065c10 0x7f8fb009faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb4846640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb00b7410 0x7f8fb01495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5047640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fb0065c10 0x7f8fb009faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59258/0 (socket says 172.21.15.69:59258) 2023-12-22T08:40:22.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5047640 1 -- 172.21.15.69:0/3382218559 learned_addr learned my addr 172.21.15.69:0/3382218559 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5848640 1 --2- 172.21.15.69:0/3382218559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb0152aa0 0x7f8fb0149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5047640 1 -- 172.21.15.69:0/3382218559 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb00b7410 msgr2=0x7f8fb01495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5047640 1 --2- 172.21.15.69:0/3382218559 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb00b7410 0x7f8fb01495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5047640 1 -- 172.21.15.69:0/3382218559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb0152aa0 msgr2=0x7f8fb0149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5047640 1 --2- 172.21.15.69:0/3382218559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb0152aa0 0x7f8fb0149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.662+0000 7f8fb5047640 1 -- 172.21.15.69:0/3382218559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009400 con 0x7f8fb0065c10 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.663+0000 7f8fb5047640 1 --2- 172.21.15.69:0/3382218559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fb0065c10 0x7f8fb009faf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00098c0 tx=0x7f8fa00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.663+0000 7f8fa5ffb640 1 -- 172.21.15.69:0/3382218559 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0032820 con 0x7f8fb0065c10 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.663+0000 7f8fa5ffb640 1 -- 172.21.15.69:0/3382218559 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0032980 con 0x7f8fb0065c10 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.663+0000 7f8fa5ffb640 1 -- 172.21.15.69:0/3382218559 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0032d30 con 0x7f8fb0065c10 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.663+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb014a6a0 con 0x7f8fb0065c10 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.663+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb014a940 con 0x7f8fb0065c10 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.663+0000 7f8fa5ffb640 1 -- 172.21.15.69:0/3382218559 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8fa004e440 con 0x7f8fb0065c10 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.663+0000 7f8fa5ffb640 1 -- 172.21.15.69:0/3382218559 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f8fa00457b0 con 0x7f8fb0065c10 2023-12-22T08:40:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.664+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb0073a40 con 0x7f8fb0065c10 2023-12-22T08:40:22.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.666+0000 7f8fa5ffb640 1 -- 172.21.15.69:0/3382218559 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f8fa0031e80 con 0x7f8fb0065c10 2023-12-22T08:40:22.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.739+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1f73a722-71ce-4761-be63-24052f045111", "id": 1} v 0) v1 -- 0x7f8fb00bb1c0 con 0x7f8fb0065c10 2023-12-22T08:40:22.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.743+0000 7f8fa5ffb640 1 -- 172.21.15.69:0/3382218559 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f73a722-71ce-4761-be63-24052f045111", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8fa00459c0 con 0x7f8fb0065c10 2023-12-22T08:40:22.745 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-12-22T08:40:22.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.743+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fb0065c10 msgr2=0x7f8fb009faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.743+0000 7f8fb72ab640 1 --2- 172.21.15.69:0/3382218559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fb0065c10 0x7f8fb009faf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00098c0 tx=0x7f8fa00046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.744+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 shutdown_connections 2023-12-22T08:40:22.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.744+0000 7f8fb72ab640 1 --2- 172.21.15.69:0/3382218559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb0152aa0 0x7f8fb0149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.744+0000 7f8fb72ab640 1 --2- 172.21.15.69:0/3382218559 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fb00b7410 0x7f8fb01495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.744+0000 7f8fb72ab640 1 --2- 172.21.15.69:0/3382218559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fb0065c10 0x7f8fb009faf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.744+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 >> 172.21.15.69:0/3382218559 conn(0x7f8fb00b9250 msgr2=0x7f8fb01522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:22.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.744+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 shutdown_connections 2023-12-22T08:40:22.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.744+0000 7f8fb72ab640 1 -- 172.21.15.69:0/3382218559 wait complete. 2023-12-22T08:40:22.756 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 8489b4d7-5dfc-4d5d-9b44-008d0a30caeb 2 2023-12-22T08:40:22.770 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:22.768+0000 7f7e7101c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-22T08:40:22.826 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:22.823+0000 7f7e7101c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-22T08:40:22.840 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:22.838+0000 7f44f6e17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-22T08:40:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.854+0000 7f077e8a1640 1 Processor -- start 2023-12-22T08:40:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.854+0000 7f077e8a1640 1 -- start start 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f077e8a1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07780b6770 0x7f077806d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f077e8a1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806b930 0x7f07780b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f077e8a1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07781486a0 con 0x7f077806dbc0 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f077e8a1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0778071b90 con 0x7f07780b6770 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f077e8a1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780b6ff0 con 0x7f077806b930 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f07777fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806b930 0x7f07780b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f07777fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806b930 0x7f07780b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:47676/0 (socket says 172.21.15.69:47676) 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f07777fe640 1 -- 172.21.15.69:0/3730654130 learned_addr learned my addr 172.21.15.69:0/3730654130 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f0777fff640 1 --2- 172.21.15.69:0/3730654130 >> v2:172.21.15.31:3300/0 conn(0x7f07780b6770 0x7f077806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f07777fe640 1 -- 172.21.15.69:0/3730654130 >> v2:172.21.15.31:3300/0 conn(0x7f07780b6770 msgr2=0x7f077806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:22.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f07777fe640 1 --2- 172.21.15.69:0/3730654130 >> v2:172.21.15.31:3300/0 conn(0x7f07780b6770 0x7f077806d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f07777fe640 1 -- 172.21.15.69:0/3730654130 >> v1:172.21.15.31:6789/0 conn(0x7f077806dbc0 legacy=0x7f077814af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.855+0000 7f07777fe640 1 -- 172.21.15.69:0/3730654130 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778147d70 con 0x7f077806b930 2023-12-22T08:40:22.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.856+0000 7f07777fe640 1 --2- 172.21.15.69:0/3730654130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806b930 0x7f07780b78d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0768009870 tx=0x7f076802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470ded562a7aec57 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.856+0000 7f0776ffd640 1 -- 172.21.15.69:0/3730654130 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768030840 con 0x7f077806b930 2023-12-22T08:40:22.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.856+0000 7f0776ffd640 1 -- 172.21.15.69:0/3730654130 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07680309a0 con 0x7f077806b930 2023-12-22T08:40:22.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.856+0000 7f0776ffd640 1 -- 172.21.15.69:0/3730654130 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768030d30 con 0x7f077806b930 2023-12-22T08:40:22.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.857+0000 7f077e8a1640 1 -- 172.21.15.69:0/3730654130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806b930 msgr2=0x7f07780b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.857+0000 7f077e8a1640 1 --2- 172.21.15.69:0/3730654130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806b930 0x7f07780b78d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0768009870 tx=0x7f076802b980 comp rx=0 tx=0).stop 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.857+0000 7f077e8a1640 1 -- 172.21.15.69:0/3730654130 shutdown_connections 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.857+0000 7f077e8a1640 1 --2- 172.21.15.69:0/3730654130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806b930 0x7f07780b78d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.857+0000 7f077e8a1640 1 --2- 172.21.15.69:0/3730654130 >> v2:172.21.15.31:3300/0 conn(0x7f07780b6770 0x7f077806d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.857+0000 7f077e8a1640 1 -- 172.21.15.69:0/3730654130 >> 172.21.15.69:0/3730654130 conn(0x7f077806ae10 msgr2=0x7f077806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.857+0000 7f077e8a1640 1 -- 172.21.15.69:0/3730654130 shutdown_connections 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.857+0000 7f077e8a1640 1 -- 172.21.15.69:0/3730654130 wait complete. 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.858+0000 7f077e8a1640 1 Processor -- start 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.858+0000 7f077e8a1640 1 -- start start 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f077e8a1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806dbc0 0x7f0778143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f077e8a1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07780b6770 0x7f07781d3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f077e8a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07780b26c0 0x7f077813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f077e8a1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778143980 con 0x7f07780b26c0 2023-12-22T08:40:22.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f077e8a1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780b3a60 con 0x7f07780b6770 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f077e8a1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780b34a0 con 0x7f077806dbc0 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806dbc0 0x7f0778143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f07777fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07780b6770 0x7f07781d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806dbc0 0x7f0778143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:47688/0 (socket says 172.21.15.69:47688) 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 -- 172.21.15.69:0/1912600694 learned_addr learned my addr 172.21.15.69:0/1912600694 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f077ce3e640 1 --2- 172.21.15.69:0/1912600694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07780b26c0 0x7f077813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 -- 172.21.15.69:0/1912600694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07780b6770 msgr2=0x7f07781d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 --2- 172.21.15.69:0/1912600694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07780b6770 0x7f07781d3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 -- 172.21.15.69:0/1912600694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07780b26c0 msgr2=0x7f077813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 --2- 172.21.15.69:0/1912600694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07780b26c0 0x7f077813ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 -- 172.21.15.69:0/1912600694 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680094d0 con 0x7f077806dbc0 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.859+0000 7f0777fff640 1 --2- 172.21.15.69:0/1912600694 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806dbc0 0x7f0778143440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f076c00e8a0 tx=0x7f076c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.860+0000 7f0774ff9640 1 -- 172.21.15.69:0/1912600694 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c0094f0 con 0x7f077806dbc0 2023-12-22T08:40:22.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.860+0000 7f0774ff9640 1 -- 172.21.15.69:0/1912600694 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c00c940 con 0x7f077806dbc0 2023-12-22T08:40:22.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.860+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07780b3780 con 0x7f077806dbc0 2023-12-22T08:40:22.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.860+0000 7f0774ff9640 1 -- 172.21.15.69:0/1912600694 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c00ccf0 con 0x7f077806dbc0 2023-12-22T08:40:22.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.860+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780b0cd0 con 0x7f077806dbc0 2023-12-22T08:40:22.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.860+0000 7f0774ff9640 1 -- 172.21.15.69:0/1912600694 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f076c005c90 con 0x7f077806dbc0 2023-12-22T08:40:22.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.860+0000 7f0774ff9640 1 -- 172.21.15.69:0/1912600694 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f076c0067a0 con 0x7f077806dbc0 2023-12-22T08:40:22.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.861+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0778073a40 con 0x7f077806dbc0 2023-12-22T08:40:22.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.863+0000 7f0774ff9640 1 -- 172.21.15.69:0/1912600694 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f076c021060 con 0x7f077806dbc0 2023-12-22T08:40:22.873 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:22.871+0000 7f7e7101c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-22T08:40:22.895 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:22.893+0000 7f44f6e17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-22T08:40:22.928 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:22.926+0000 7f7e7101c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-22T08:40:22.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.934+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8489b4d7-5dfc-4d5d-9b44-008d0a30caeb", "id": 2} v 0) v1 -- 0x7f07781417c0 con 0x7f077806dbc0 2023-12-22T08:40:22.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.938+0000 7f0774ff9640 1 -- 172.21.15.69:0/1912600694 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8489b4d7-5dfc-4d5d-9b44-008d0a30caeb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f076c017070 con 0x7f077806dbc0 2023-12-22T08:40:22.941 INFO:teuthology.orchestra.run.smithi069.stdout:2 2023-12-22T08:40:22.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806dbc0 msgr2=0x7f0778143440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:22.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 --2- 172.21.15.69:0/1912600694 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806dbc0 0x7f0778143440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f076c00e8a0 tx=0x7f076c00ed60 comp rx=0 tx=0).stop 2023-12-22T08:40:22.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 shutdown_connections 2023-12-22T08:40:22.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 --2- 172.21.15.69:0/1912600694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07780b26c0 0x7f077813ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 --2- 172.21.15.69:0/1912600694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07780b6770 0x7f07781d3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 --2- 172.21.15.69:0/1912600694 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f077806dbc0 0x7f0778143440 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:22.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 >> 172.21.15.69:0/1912600694 conn(0x7f077806ae10 msgr2=0x7f0778146e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:22.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 shutdown_connections 2023-12-22T08:40:22.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:22.939+0000 7f077e8a1640 1 -- 172.21.15.69:0/1912600694 wait complete. 2023-12-22T08:40:22.943 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:22.940+0000 7f44f6e17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-22T08:40:22.952 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 08a73907-f641-4405-8fd1-91dc2cd5c200 3 2023-12-22T08:40:22.973 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:22.970+0000 7f7e7101c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-22T08:40:22.998 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:22.996+0000 7f44f6e17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-22T08:40:23.042 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:23.040+0000 7f44f6e17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-22T08:40:23.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.069+0000 7fb33da4b640 1 Processor -- start 2023-12-22T08:40:23.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.069+0000 7fb33da4b640 1 -- start start 2023-12-22T08:40:23.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb33da4b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3380b8690 0x7fb3380b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb33da4b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b77d0 0x7fb338144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb33da4b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33814ab10 con 0x7fb338144bb0 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb33da4b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33806c2f0 con 0x7fb3380b8690 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb33da4b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380ba620 con 0x7fb3380b77d0 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb3367fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b77d0 0x7fb338144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb3367fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b77d0 0x7fb338144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:47704/0 (socket says 172.21.15.69:47704) 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb3367fc640 1 -- 172.21.15.69:0/2388877533 learned_addr learned my addr 172.21.15.69:0/2388877533 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb336ffd640 1 --2- 172.21.15.69:0/2388877533 >> v2:172.21.15.31:3300/0 conn(0x7fb3380b8690 0x7fb3380b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb3367fc640 1 -- 172.21.15.69:0/2388877533 >> v2:172.21.15.31:3300/0 conn(0x7fb3380b8690 msgr2=0x7fb3380b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb3367fc640 1 --2- 172.21.15.69:0/2388877533 >> v2:172.21.15.31:3300/0 conn(0x7fb3380b8690 0x7fb3380b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb3367fc640 1 -- 172.21.15.69:0/2388877533 >> v1:172.21.15.31:6789/0 conn(0x7fb338144bb0 legacy=0x7fb33814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.070+0000 7fb3367fc640 1 -- 172.21.15.69:0/2388877533 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3380b9e60 con 0x7fb3380b77d0 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.071+0000 7fb3367fc640 1 --2- 172.21.15.69:0/2388877533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b77d0 0x7fb338144670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb328009870 tx=0x7fb32802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0abac536afdebe server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.071+0000 7fb335ffb640 1 -- 172.21.15.69:0/2388877533 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb328031640 con 0x7fb3380b77d0 2023-12-22T08:40:23.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.071+0000 7fb335ffb640 1 -- 172.21.15.69:0/2388877533 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3280317a0 con 0x7fb3380b77d0 2023-12-22T08:40:23.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.071+0000 7fb335ffb640 1 -- 172.21.15.69:0/2388877533 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb328031b30 con 0x7fb3380b77d0 2023-12-22T08:40:23.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.072+0000 7fb33da4b640 1 -- 172.21.15.69:0/2388877533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b77d0 msgr2=0x7fb338144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.072+0000 7fb33da4b640 1 --2- 172.21.15.69:0/2388877533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b77d0 0x7fb338144670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb328009870 tx=0x7fb32802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.072+0000 7fb33da4b640 1 -- 172.21.15.69:0/2388877533 shutdown_connections 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.072+0000 7fb33da4b640 1 --2- 172.21.15.69:0/2388877533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b77d0 0x7fb338144670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.072+0000 7fb33da4b640 1 --2- 172.21.15.69:0/2388877533 >> v2:172.21.15.31:3300/0 conn(0x7fb3380b8690 0x7fb3380b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.072+0000 7fb33da4b640 1 -- 172.21.15.69:0/2388877533 >> 172.21.15.69:0/2388877533 conn(0x7fb33806b6a0 msgr2=0x7fb33806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.072+0000 7fb33da4b640 1 -- 172.21.15.69:0/2388877533 shutdown_connections 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.072+0000 7fb33da4b640 1 -- 172.21.15.69:0/2388877533 wait complete. 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.073+0000 7fb33da4b640 1 Processor -- start 2023-12-22T08:40:23.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.073+0000 7fb33da4b640 1 -- start start 2023-12-22T08:40:23.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb33da4b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3380b77d0 0x7fb338149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb33da4b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b8690 0x7fb338135730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb33da4b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb338144bb0 0x7fb338149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb33da4b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338146ec0 con 0x7fb3380b77d0 2023-12-22T08:40:23.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb33da4b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3381471a0 con 0x7fb338144bb0 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb33da4b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb338147480 con 0x7fb3380b8690 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b8690 0x7fb338135730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b8690 0x7fb338135730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:47710/0 (socket says 172.21.15.69:47710) 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 -- 172.21.15.69:0/3163907394 learned_addr learned my addr 172.21.15.69:0/3163907394 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3377fe640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb338144bb0 0x7fb338149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb336ffd640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3380b77d0 0x7fb338149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 -- 172.21.15.69:0/3163907394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb338144bb0 msgr2=0x7fb338149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb338144bb0 0x7fb338149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 -- 172.21.15.69:0/3163907394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3380b77d0 msgr2=0x7fb338149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3380b77d0 0x7fb338149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 -- 172.21.15.69:0/3163907394 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280094d0 con 0x7fb3380b8690 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb3367fc640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b8690 0x7fb338135730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb328000c00 tx=0x7fb3280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb31ffff640 1 -- 172.21.15.69:0/3163907394 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32803a930 con 0x7fb3380b8690 2023-12-22T08:40:23.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb31ffff640 1 -- 172.21.15.69:0/3163907394 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32803aa90 con 0x7fb3380b8690 2023-12-22T08:40:23.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb31ffff640 1 -- 172.21.15.69:0/3163907394 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32803ae40 con 0x7fb3380b8690 2023-12-22T08:40:23.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb338143a30 con 0x7fb3380b8690 2023-12-22T08:40:23.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.074+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb338135c70 con 0x7fb3380b8690 2023-12-22T08:40:23.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.075+0000 7fb31ffff640 1 -- 172.21.15.69:0/3163907394 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb32802f050 con 0x7fb3380b8690 2023-12-22T08:40:23.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.075+0000 7fb31ffff640 1 -- 172.21.15.69:0/3163907394 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb328044970 con 0x7fb3380b8690 2023-12-22T08:40:23.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.075+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb338147640 con 0x7fb3380b8690 2023-12-22T08:40:23.080 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:23.077+0000 7f7e7101c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-22T08:40:23.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.077+0000 7fb31ffff640 1 -- 172.21.15.69:0/3163907394 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fb328035020 con 0x7fb3380b8690 2023-12-22T08:40:23.148 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:23.146+0000 7f44f6e17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-22T08:40:23.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.148+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd new", "uuid": "08a73907-f641-4405-8fd1-91dc2cd5c200", "id": 3} v 0) v1 -- 0x7fb338073a40 con 0x7fb3380b8690 2023-12-22T08:40:23.151 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:23.148+0000 7f7e7101c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-22T08:40:23.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.156+0000 7fb31ffff640 1 -- 172.21.15.69:0/3163907394 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08a73907-f641-4405-8fd1-91dc2cd5c200", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb32802d040 con 0x7fb3380b8690 2023-12-22T08:40:23.158 INFO:teuthology.orchestra.run.smithi069.stdout:3 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b8690 msgr2=0x7fb338135730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b8690 0x7fb338135730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb328000c00 tx=0x7fb3280046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 shutdown_connections 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb338144bb0 0x7fb338149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb3380b8690 0x7fb338135730 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 --2- 172.21.15.69:0/3163907394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3380b77d0 0x7fb338149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 >> 172.21.15.69:0/3163907394 conn(0x7fb33806b6a0 msgr2=0x7fb3380b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 shutdown_connections 2023-12-22T08:40:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.157+0000 7fb33da4b640 1 -- 172.21.15.69:0/3163907394 wait complete. 2023-12-22T08:40:23.170 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 627c34fc-9601-4362-a7b9-419ab1465a19 4 2023-12-22T08:40:23.200 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:23.198+0000 7f7e7101c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-22T08:40:23.221 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:23.219+0000 7f44f6e17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-22T08:40:23.255 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:23.252+0000 7f7e7101c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-22T08:40:23.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.266+0000 7fe3f6901640 1 Processor -- start 2023-12-22T08:40:23.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.266+0000 7fe3f6901640 1 -- start start 2023-12-22T08:40:23.270 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:23.267+0000 7f44f6e17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3f6901640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe3f0144e40 0x7fe3f006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3f6901640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3f014ee10 0x7fe3f01554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3f6901640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f0070630 con 0x7fe3f00b0a40 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3f6901640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f0070070 con 0x7fe3f014ee10 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3f6901640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f0070350 con 0x7fe3f0144e40 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3effff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe3f0144e40 0x7fe3f006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3effff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe3f0144e40 0x7fe3f006d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59274/0 (socket says 172.21.15.69:59274) 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3effff640 1 -- 172.21.15.69:0/3092116747 learned_addr learned my addr 172.21.15.69:0/3092116747 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3f4e9e640 1 --2- 172.21.15.69:0/3092116747 >> v2:172.21.15.31:3300/0 conn(0x7fe3f014ee10 0x7fe3f01554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3effff640 1 -- 172.21.15.69:0/3092116747 >> v2:172.21.15.31:3300/0 conn(0x7fe3f014ee10 msgr2=0x7fe3f01554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3effff640 1 --2- 172.21.15.69:0/3092116747 >> v2:172.21.15.31:3300/0 conn(0x7fe3f014ee10 0x7fe3f01554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3effff640 1 -- 172.21.15.69:0/3092116747 >> v1:172.21.15.31:6789/0 conn(0x7fe3f00b0a40 legacy=0x7fe3f014e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.267+0000 7fe3effff640 1 -- 172.21.15.69:0/3092116747 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f014e1e0 con 0x7fe3f0144e40 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.268+0000 7fe3effff640 1 --2- 172.21.15.69:0/3092116747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f006d680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe3f006faf0 tx=0x7fe3e402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0a7b125602227bc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.268+0000 7fe3eeffd640 1 -- 172.21.15.69:0/3092116747 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4030860 con 0x7fe3f0144e40 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.268+0000 7fe3eeffd640 1 -- 172.21.15.69:0/3092116747 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e40309c0 con 0x7fe3f0144e40 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.268+0000 7fe3eeffd640 1 -- 172.21.15.69:0/3092116747 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4030d50 con 0x7fe3f0144e40 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.269+0000 7fe3f6901640 1 -- 172.21.15.69:0/3092116747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 msgr2=0x7fe3f006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.269+0000 7fe3f6901640 1 --2- 172.21.15.69:0/3092116747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f006d680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe3f006faf0 tx=0x7fe3e402b9a0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.269+0000 7fe3f6901640 1 -- 172.21.15.69:0/3092116747 shutdown_connections 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.269+0000 7fe3f6901640 1 --2- 172.21.15.69:0/3092116747 >> v2:172.21.15.31:3300/0 conn(0x7fe3f014ee10 0x7fe3f01554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.269+0000 7fe3f6901640 1 --2- 172.21.15.69:0/3092116747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f006d680 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.269+0000 7fe3f6901640 1 -- 172.21.15.69:0/3092116747 >> 172.21.15.69:0/3092116747 conn(0x7fe3f006ae10 msgr2=0x7fe3f006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.269+0000 7fe3f6901640 1 -- 172.21.15.69:0/3092116747 shutdown_connections 2023-12-22T08:40:23.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.269+0000 7fe3f6901640 1 -- 172.21.15.69:0/3092116747 wait complete. 2023-12-22T08:40:23.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.270+0000 7fe3f6901640 1 Processor -- start 2023-12-22T08:40:23.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.270+0000 7fe3f6901640 1 -- start start 2023-12-22T08:40:23.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f6901640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f00b0a40 0x7fe3f0145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f6901640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f00b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f6901640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe3f014ee10 0x7fe3f01e0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f6901640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00b4580 con 0x7fe3f00b0a40 2023-12-22T08:40:23.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f6901640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00b5640 con 0x7fe3f0144e40 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f6901640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f014a040 con 0x7fe3f014ee10 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3ef7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f00b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f4e9e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe3f014ee10 0x7fe3f01e0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3ef7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f00b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59286/0 (socket says 172.21.15.69:59286) 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3ef7fe640 1 -- 172.21.15.69:0/980952670 learned_addr learned my addr 172.21.15.69:0/980952670 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3effff640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f00b0a40 0x7fe3f0145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f4e9e640 1 -- 172.21.15.69:0/980952670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 msgr2=0x7fe3f00b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f4e9e640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f00b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f4e9e640 1 -- 172.21.15.69:0/980952670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f00b0a40 msgr2=0x7fe3f0145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f4e9e640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f00b0a40 0x7fe3f0145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f4e9e640 1 -- 172.21.15.69:0/980952670 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e40094d0 con 0x7fe3f014ee10 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3ef7fe640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f00b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:23.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3effff640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f00b0a40 0x7fe3f0145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.271+0000 7fe3f4e9e640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe3f014ee10 0x7fe3f01e0240 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800ebd0 tx=0x7fe3e800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.272+0000 7fe3ecff9640 1 -- 172.21.15.69:0/980952670 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800cd20 con 0x7fe3f014ee10 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.272+0000 7fe3ecff9640 1 -- 172.21.15.69:0/980952670 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e800f040 con 0x7fe3f014ee10 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.272+0000 7fe3ecff9640 1 -- 172.21.15.69:0/980952670 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80146c0 con 0x7fe3f014ee10 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.272+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f014a240 con 0x7fe3f014ee10 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.272+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f00b5b40 con 0x7fe3f014ee10 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.272+0000 7fe3ecff9640 1 -- 172.21.15.69:0/980952670 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe3e8014b20 con 0x7fe3f014ee10 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.272+0000 7fe3ecff9640 1 -- 172.21.15.69:0/980952670 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe3e801db30 con 0x7fe3f014ee10 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.273+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f0073a40 con 0x7fe3f014ee10 2023-12-22T08:40:23.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.274+0000 7fe3ecff9640 1 -- 172.21.15.69:0/980952670 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fe3e803cb10 con 0x7fe3f014ee10 2023-12-22T08:40:23.304 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:23.302+0000 7f7e7101c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-22T08:40:23.324 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:23.321+0000 7f44f6e17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-22T08:40:23.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.347+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd new", "uuid": "627c34fc-9601-4362-a7b9-419ab1465a19", "id": 4} v 0) v1 -- 0x7fe3f00731b0 con 0x7fe3f014ee10 2023-12-22T08:40:23.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.354+0000 7fe3ecff9640 1 -- 172.21.15.69:0/980952670 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "627c34fc-9601-4362-a7b9-419ab1465a19", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe3e802b070 con 0x7fe3f014ee10 2023-12-22T08:40:23.357 INFO:teuthology.orchestra.run.smithi069.stdout:4 2023-12-22T08:40:23.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe3f014ee10 msgr2=0x7fe3f01e0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe3f014ee10 0x7fe3f01e0240 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800ebd0 tx=0x7fe3e800c490 comp rx=0 tx=0).stop 2023-12-22T08:40:23.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 shutdown_connections 2023-12-22T08:40:23.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe3f014ee10 0x7fe3f01e0240 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3f0144e40 0x7fe3f00b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 --2- 172.21.15.69:0/980952670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f00b0a40 0x7fe3f0145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 >> 172.21.15.69:0/980952670 conn(0x7fe3f006ae10 msgr2=0x7fe3f006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 shutdown_connections 2023-12-22T08:40:23.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.355+0000 7fe3f6901640 1 -- 172.21.15.69:0/980952670 wait complete. 2023-12-22T08:40:23.368 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new e071a2d4-d0bf-401c-8cd1-73106bd306e6 5 2023-12-22T08:40:23.373 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:23.371+0000 7f44f6e17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-22T08:40:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.505+0000 7fe4fbdab640 1 Processor -- start 2023-12-22T08:40:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4fbdab640 1 -- start start 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4fbdab640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe4f40b6770 0x7fe4f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4fbdab640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f41486a0 con 0x7fe4f406dbc0 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4fbdab640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f40b6ff0 con 0x7fe4f406b930 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4fbdab640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f4071b90 con 0x7fe4f40b6770 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4f9b47640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe4f40b6770 0x7fe4f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4f9b47640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe4f40b6770 0x7fe4f406d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55886/0 (socket says 172.21.15.69:55886) 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4f9b47640 1 -- 172.21.15.69:0/3650248033 learned_addr learned my addr 172.21.15.69:0/3650248033 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.506+0000 7fe4f9346640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe4f406b930 0x7fe4f40b78d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:48946/0 (socket says 172.21.15.69:48946) 2023-12-22T08:40:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.507+0000 7fe4f9b47640 1 -- 172.21.15.69:0/3650248033 >> v1:172.21.15.69:6789/0 conn(0x7fe4f406b930 legacy=0x7fe4f40b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.507+0000 7fe4f9b47640 1 -- 172.21.15.69:0/3650248033 >> v1:172.21.15.31:6789/0 conn(0x7fe4f406dbc0 legacy=0x7fe4f4152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.507+0000 7fe4f8b45640 1 -- 172.21.15.69:0/3650248033 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965969911 0 0) 0x7fe4f40b6ff0 con 0x7fe4f406b930 2023-12-22T08:40:23.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.507+0000 7fe4f9b47640 1 -- 172.21.15.69:0/3650248033 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4147d70 con 0x7fe4f40b6770 2023-12-22T08:40:23.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.507+0000 7fe4f9b47640 1 --2- 172.21.15.69:0/3650248033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f406d680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40b7180 tx=0x7fe4e402e1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6dcae96a92539f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4f8b45640 1 -- 172.21.15.69:0/3650248033 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4036440 con 0x7fe4f40b6770 2023-12-22T08:40:23.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4f8b45640 1 -- 172.21.15.69:0/3650248033 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e40365a0 con 0x7fe4f40b6770 2023-12-22T08:40:23.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4f8b45640 1 -- 172.21.15.69:0/3650248033 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4036930 con 0x7fe4f40b6770 2023-12-22T08:40:23.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3650248033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 msgr2=0x7fe4f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4fbdab640 1 --2- 172.21.15.69:0/3650248033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f406d680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40b7180 tx=0x7fe4e402e1f0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3650248033 shutdown_connections 2023-12-22T08:40:23.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4fbdab640 1 --2- 172.21.15.69:0/3650248033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f406d680 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3650248033 >> 172.21.15.69:0/3650248033 conn(0x7fe4f406ae10 msgr2=0x7fe4f406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3650248033 shutdown_connections 2023-12-22T08:40:23.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.508+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3650248033 wait complete. 2023-12-22T08:40:23.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.509+0000 7fe4fbdab640 1 Processor -- start 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.509+0000 7fe4fbdab640 1 -- start start 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4fbdab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe4f406dbc0 0x7fe4f41cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4fbdab640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f41ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4fbdab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f41cef20 0x7fe4f4143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4fbdab640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40b4320 con 0x7fe4f41cef20 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4fbdab640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41ce1e0 con 0x7fe4f40b6770 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4fbdab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41cf480 con 0x7fe4f406dbc0 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f41ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9b47640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe4f406dbc0 0x7fe4f41cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f41ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55888/0 (socket says 172.21.15.69:55888) 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 -- 172.21.15.69:0/3340498080 learned_addr learned my addr 172.21.15.69:0/3340498080 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4fa348640 1 --2- 172.21.15.69:0/3340498080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f41cef20 0x7fe4f4143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 -- 172.21.15.69:0/3340498080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe4f406dbc0 msgr2=0x7fe4f41cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 --2- 172.21.15.69:0/3340498080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe4f406dbc0 0x7fe4f41cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 -- 172.21.15.69:0/3340498080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f41cef20 msgr2=0x7fe4f4143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 --2- 172.21.15.69:0/3340498080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f41cef20 0x7fe4f4143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 -- 172.21.15.69:0/3340498080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e400b770 con 0x7fe4f40b6770 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.510+0000 7fe4f9346640 1 --2- 172.21.15.69:0/3340498080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f41ce9e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000c4a0 tx=0x7fe4f000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.511+0000 7fe4ea7fc640 1 -- 172.21.15.69:0/3340498080 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00074e0 con 0x7fe4f40b6770 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.511+0000 7fe4ea7fc640 1 -- 172.21.15.69:0/3340498080 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f0007640 con 0x7fe4f40b6770 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.511+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f4143760 con 0x7fe4f40b6770 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.511+0000 7fe4ea7fc640 1 -- 172.21.15.69:0/3340498080 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0004a00 con 0x7fe4f40b6770 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.511+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f406d6e0 con 0x7fe4f40b6770 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.511+0000 7fe4ea7fc640 1 -- 172.21.15.69:0/3340498080 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe4f001d440 con 0x7fe4f40b6770 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.511+0000 7fe4ea7fc640 1 -- 172.21.15.69:0/3340498080 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe4f0012980 con 0x7fe4f40b6770 2023-12-22T08:40:23.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.512+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f41ce3b0 con 0x7fe4f40b6770 2023-12-22T08:40:23.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.514+0000 7fe4ea7fc640 1 -- 172.21.15.69:0/3340498080 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fe4f41ce3b0 con 0x7fe4f40b6770 2023-12-22T08:40:23.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.585+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e071a2d4-d0bf-401c-8cd1-73106bd306e6", "id": 5} v 0) v1 -- 0x7fe4f41435c0 con 0x7fe4f40b6770 2023-12-22T08:40:23.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.593+0000 7fe4ea7fc640 1 -- 172.21.15.69:0/3340498080 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e071a2d4-d0bf-401c-8cd1-73106bd306e6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe4f41435c0 con 0x7fe4f40b6770 2023-12-22T08:40:23.596 INFO:teuthology.orchestra.run.smithi069.stdout:5 2023-12-22T08:40:23.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 msgr2=0x7fe4f41ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 --2- 172.21.15.69:0/3340498080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f41ce9e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000c4a0 tx=0x7fe4f000c960 comp rx=0 tx=0).stop 2023-12-22T08:40:23.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 shutdown_connections 2023-12-22T08:40:23.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 --2- 172.21.15.69:0/3340498080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f41cef20 0x7fe4f4143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 --2- 172.21.15.69:0/3340498080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4f40b6770 0x7fe4f41ce9e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 --2- 172.21.15.69:0/3340498080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe4f406dbc0 0x7fe4f41cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 >> 172.21.15.69:0/3340498080 conn(0x7fe4f406ae10 msgr2=0x7fe4f4069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 shutdown_connections 2023-12-22T08:40:23.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.594+0000 7fe4fbdab640 1 -- 172.21.15.69:0/3340498080 wait complete. 2023-12-22T08:40:23.606 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new c48886a0-c0ab-459e-9bcb-0eafc32700d6 6 2023-12-22T08:40:23.700 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:23.697+0000 7f7e7101c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-22T08:40:23.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.704+0000 7ff686c84640 1 Processor -- start 2023-12-22T08:40:23.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.704+0000 7ff686c84640 1 -- start start 2023-12-22T08:40:23.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff686c84640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff6800b8240 0x7ff6800b8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff686c84640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6800ba770 con 0x7ff68006a650 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff686c84640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6800b74a0 con 0x7ff680065c10 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff686c84640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800bbc10 con 0x7ff6800b8240 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff684a20640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff680065c10 0x7ff680069f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:48954/0 (socket says 172.21.15.69:48954) 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff684a20640 1 -- 172.21.15.69:0/437390750 learned_addr learned my addr 172.21.15.69:0/437390750 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff685221640 1 --2- 172.21.15.69:0/437390750 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff6800b8240 0x7ff6800b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff67f7fe640 1 -- 172.21.15.69:0/437390750 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162929503 0 0) 0x7ff6800b74a0 con 0x7ff680065c10 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff67f7fe640 1 -- 172.21.15.69:0/437390750 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff670003520 con 0x7ff680065c10 2023-12-22T08:40:23.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff685221640 1 -- 172.21.15.69:0/437390750 >> v1:172.21.15.69:6789/0 conn(0x7ff680065c10 legacy=0x7ff680069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff685221640 1 -- 172.21.15.69:0/437390750 >> v1:172.21.15.31:6789/0 conn(0x7ff68006a650 legacy=0x7ff6800b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.705+0000 7ff685221640 1 -- 172.21.15.69:0/437390750 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6800bb550 con 0x7ff6800b8240 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.706+0000 7ff685221640 1 --2- 172.21.15.69:0/437390750 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff6800b8240 0x7ff6800b8620 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff678009dc0 tx=0x7ff67802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7fee132dced9fca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.706+0000 7ff67f7fe640 1 -- 172.21.15.69:0/437390750 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67802ccd0 con 0x7ff6800b8240 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.706+0000 7ff67f7fe640 1 -- 172.21.15.69:0/437390750 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67802ce30 con 0x7ff6800b8240 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.706+0000 7ff67f7fe640 1 -- 172.21.15.69:0/437390750 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678034660 con 0x7ff6800b8240 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.707+0000 7ff686c84640 1 -- 172.21.15.69:0/437390750 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff6800b8240 msgr2=0x7ff6800b8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.707+0000 7ff686c84640 1 --2- 172.21.15.69:0/437390750 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff6800b8240 0x7ff6800b8620 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff678009dc0 tx=0x7ff67802bf20 comp rx=0 tx=0).stop 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.707+0000 7ff686c84640 1 -- 172.21.15.69:0/437390750 shutdown_connections 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.707+0000 7ff686c84640 1 --2- 172.21.15.69:0/437390750 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff6800b8240 0x7ff6800b8620 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.707+0000 7ff686c84640 1 -- 172.21.15.69:0/437390750 >> 172.21.15.69:0/437390750 conn(0x7ff6800b9250 msgr2=0x7ff6800b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.707+0000 7ff686c84640 1 -- 172.21.15.69:0/437390750 shutdown_connections 2023-12-22T08:40:23.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.707+0000 7ff686c84640 1 -- 172.21.15.69:0/437390750 wait complete. 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.708+0000 7ff686c84640 1 Processor -- start 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.709+0000 7ff686c84640 1 -- start start 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff686c84640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff680065c10 0x7ff6800b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff686c84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68006a650 0x7ff680099000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff686c84640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6800b8240 0x7ff6801de480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff686c84640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b69d0 con 0x7ff68006a650 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff686c84640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6801de030 con 0x7ff6800b8240 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff686c84640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff680099de0 con 0x7ff680065c10 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff680065c10 0x7ff6800b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff680065c10 0x7ff6800b6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:52726/0 (socket says 172.21.15.69:52726) 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff685221640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6800b8240 0x7ff6801de480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 -- 172.21.15.69:0/1671664259 learned_addr learned my addr 172.21.15.69:0/1671664259 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff67ffff640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68006a650 0x7ff680099000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 -- 172.21.15.69:0/1671664259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6800b8240 msgr2=0x7ff6801de480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6800b8240 0x7ff6801de480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 -- 172.21.15.69:0/1671664259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68006a650 msgr2=0x7ff680099000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68006a650 0x7ff680099000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 -- 172.21.15.69:0/1671664259 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff678009a70 con 0x7ff680065c10 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff685221640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6800b8240 0x7ff6801de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff684a20640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff680065c10 0x7ff6800b6490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c530 tx=0x7ff67400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.710+0000 7ff67d7fa640 1 -- 172.21.15.69:0/1671664259 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674005ce0 con 0x7ff680065c10 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.711+0000 7ff67d7fa640 1 -- 172.21.15.69:0/1671664259 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff674005e40 con 0x7ff680065c10 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.711+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6801d27b0 con 0x7ff680065c10 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.711+0000 7ff67d7fa640 1 -- 172.21.15.69:0/1671664259 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6740072b0 con 0x7ff680065c10 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.711+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6801d2980 con 0x7ff680065c10 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.711+0000 7ff67d7fa640 1 -- 172.21.15.69:0/1671664259 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff67401c440 con 0x7ff680065c10 2023-12-22T08:40:23.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.711+0000 7ff67d7fa640 1 -- 172.21.15.69:0/1671664259 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ff6740129f0 con 0x7ff680065c10 2023-12-22T08:40:23.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.711+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff680073a40 con 0x7ff680065c10 2023-12-22T08:40:23.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.713+0000 7ff67d7fa640 1 -- 172.21.15.69:0/1671664259 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7ff674017070 con 0x7ff680065c10 2023-12-22T08:40:23.773 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:23.770+0000 7f44f6e17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-22T08:40:23.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.786+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c48886a0-c0ab-459e-9bcb-0eafc32700d6", "id": 6} v 0) v1 -- 0x7ff680070e70 con 0x7ff680065c10 2023-12-22T08:40:23.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.794+0000 7ff67d7fa640 1 -- 172.21.15.69:0/1671664259 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c48886a0-c0ab-459e-9bcb-0eafc32700d6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6740124d0 con 0x7ff680065c10 2023-12-22T08:40:23.797 INFO:teuthology.orchestra.run.smithi069.stdout:6 2023-12-22T08:40:23.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff680065c10 msgr2=0x7ff6800b6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff680065c10 0x7ff6800b6490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c530 tx=0x7ff67400c9f0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 shutdown_connections 2023-12-22T08:40:23.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6800b8240 0x7ff6801de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff68006a650 0x7ff680099000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 --2- 172.21.15.69:0/1671664259 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff680065c10 0x7ff6800b6490 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 >> 172.21.15.69:0/1671664259 conn(0x7ff6800b9250 msgr2=0x7ff6801cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 shutdown_connections 2023-12-22T08:40:23.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.795+0000 7ff686c84640 1 -- 172.21.15.69:0/1671664259 wait complete. 2023-12-22T08:40:23.807 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc 7 2023-12-22T08:40:23.843 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:23.840+0000 7f7e7101c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-22T08:40:23.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.904+0000 7fa4a0cbd640 1 Processor -- start 2023-12-22T08:40:23.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.904+0000 7fa4a0cbd640 1 -- start start 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa4a0cbd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa49c0b0a40 0x7fa49c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa4a0cbd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa49c14ec40 0x7fa49c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa4a0cbd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49c06dd90 con 0x7fa49c144e40 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa4a0cbd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c14f0b0 con 0x7fa49c14ec40 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa4a0cbd640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c070630 con 0x7fa49c0b0a40 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa499d9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa49c0b0a40 0x7fa49c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa499d9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa49c0b0a40 0x7fa49c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55896/0 (socket says 172.21.15.69:55896) 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa499d9b640 1 -- 172.21.15.69:0/1596335850 learned_addr learned my addr 172.21.15.69:0/1596335850 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa49ad9d640 1 --2- 172.21.15.69:0/1596335850 >> v2:172.21.15.31:3300/0 conn(0x7fa49c14ec40 0x7fa49c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa499d9b640 1 -- 172.21.15.69:0/1596335850 >> v2:172.21.15.31:3300/0 conn(0x7fa49c14ec40 msgr2=0x7fa49c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:23.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa499d9b640 1 --2- 172.21.15.69:0/1596335850 >> v2:172.21.15.31:3300/0 conn(0x7fa49c14ec40 0x7fa49c1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa499d9b640 1 -- 172.21.15.69:0/1596335850 >> v1:172.21.15.31:6789/0 conn(0x7fa49c144e40 legacy=0x7fa49c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.905+0000 7fa499d9b640 1 -- 172.21.15.69:0/1596335850 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c070070 con 0x7fa49c0b0a40 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.906+0000 7fa499d9b640 1 --2- 172.21.15.69:0/1596335850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c14e700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0b9aa0 tx=0x7fa48c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb8339419a6b639 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.906+0000 7fa49959a640 1 -- 172.21.15.69:0/1596335850 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c030860 con 0x7fa49c0b0a40 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.906+0000 7fa49959a640 1 -- 172.21.15.69:0/1596335850 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c0309c0 con 0x7fa49c0b0a40 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.906+0000 7fa49959a640 1 -- 172.21.15.69:0/1596335850 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c030d50 con 0x7fa49c0b0a40 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.907+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/1596335850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 msgr2=0x7fa49c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.907+0000 7fa4a0cbd640 1 --2- 172.21.15.69:0/1596335850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c14e700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0b9aa0 tx=0x7fa48c02b9a0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.907+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/1596335850 shutdown_connections 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.907+0000 7fa4a0cbd640 1 --2- 172.21.15.69:0/1596335850 >> v2:172.21.15.31:3300/0 conn(0x7fa49c14ec40 0x7fa49c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.907+0000 7fa4a0cbd640 1 --2- 172.21.15.69:0/1596335850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c14e700 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.907+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/1596335850 >> 172.21.15.69:0/1596335850 conn(0x7fa49c06ae10 msgr2=0x7fa49c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.907+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/1596335850 shutdown_connections 2023-12-22T08:40:23.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.907+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/1596335850 wait complete. 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.908+0000 7fa4a0cbd640 1 Processor -- start 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.908+0000 7fa4a0cbd640 1 -- start start 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa4a0cbd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa4a0cbd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49c144e40 0x7fa49c1e3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa4a0cbd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa49c14ec40 0x7fa49c1e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa4a0cbd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1483b0 con 0x7fa49c144e40 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa4a0cbd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c0b34e0 con 0x7fa49c0b0a40 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa4a0cbd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1e2de0 con 0x7fa49c14ec40 2023-12-22T08:40:23.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49a59c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55908/0 (socket says 172.21.15.69:55908) 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49ad9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa49c14ec40 0x7fa49c1e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49a59c640 1 -- 172.21.15.69:0/2059595077 learned_addr learned my addr 172.21.15.69:0/2059595077 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa499d9b640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49c144e40 0x7fa49c1e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49ad9d640 1 -- 172.21.15.69:0/2059595077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 msgr2=0x7fa49c147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49ad9d640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49ad9d640 1 -- 172.21.15.69:0/2059595077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49c144e40 msgr2=0x7fa49c1e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49ad9d640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49c144e40 0x7fa49c1e3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49ad9d640 1 -- 172.21.15.69:0/2059595077 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0094d0 con 0x7fa49c14ec40 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49a59c640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa499d9b640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49c144e40 0x7fa49c1e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa49ad9d640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa49c14ec40 0x7fa49c1e3770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa49400eba0 tx=0x7fa49400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.909+0000 7fa48affd640 1 -- 172.21.15.69:0/2059595077 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400cd20 con 0x7fa49c14ec40 2023-12-22T08:40:23.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.910+0000 7fa48affd640 1 -- 172.21.15.69:0/2059595077 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49400f040 con 0x7fa49c14ec40 2023-12-22T08:40:23.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.910+0000 7fa48affd640 1 -- 172.21.15.69:0/2059595077 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4940146c0 con 0x7fa49c14ec40 2023-12-22T08:40:23.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.910+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c0b2c40 con 0x7fa49c14ec40 2023-12-22T08:40:23.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.910+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c0b3200 con 0x7fa49c14ec40 2023-12-22T08:40:23.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.910+0000 7fa48affd640 1 -- 172.21.15.69:0/2059595077 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa494014b20 con 0x7fa49c14ec40 2023-12-22T08:40:23.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.910+0000 7fa48affd640 1 -- 172.21.15.69:0/2059595077 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa49401db30 con 0x7fa49c14ec40 2023-12-22T08:40:23.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.911+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c1e2f50 con 0x7fa49c14ec40 2023-12-22T08:40:23.916 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:23.913+0000 7f44f6e17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-22T08:40:23.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.913+0000 7fa48affd640 1 -- 172.21.15.69:0/2059595077 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fa49403bb10 con 0x7fa49c14ec40 2023-12-22T08:40:23.965 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:23.962+0000 7f7e7101c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-22T08:40:23.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.984+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc", "id": 7} v 0) v1 -- 0x7fa49c070300 con 0x7fa49c14ec40 2023-12-22T08:40:23.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.992+0000 7fa48affd640 1 -- 172.21.15.69:0/2059595077 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa49402a070 con 0x7fa49c14ec40 2023-12-22T08:40:23.994 INFO:teuthology.orchestra.run.smithi069.stdout:7 2023-12-22T08:40:23.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa49c14ec40 msgr2=0x7fa49c1e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:23.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa49c14ec40 0x7fa49c1e3770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa49400eba0 tx=0x7fa49400c490 comp rx=0 tx=0).stop 2023-12-22T08:40:23.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 shutdown_connections 2023-12-22T08:40:23.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa49c14ec40 0x7fa49c1e3770 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa49c144e40 0x7fa49c1e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 --2- 172.21.15.69:0/2059595077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa49c0b0a40 0x7fa49c147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:23.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 >> 172.21.15.69:0/2059595077 conn(0x7fa49c06ae10 msgr2=0x7fa49c06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:23.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 shutdown_connections 2023-12-22T08:40:23.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-22T08:40:23.993+0000 7fa4a0cbd640 1 -- 172.21.15.69:0/2059595077 wait complete. 2023-12-22T08:40:24.005 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-22T08:40:24.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-22T08:40:24.008 INFO:tasks.ceph.osd.0:Started 2023-12-22T08:40:24.008 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-22T08:40:24.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-22T08:40:24.010 INFO:tasks.ceph.osd.1:Started 2023-12-22T08:40:24.010 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-22T08:40:24.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-22T08:40:24.012 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:24.010+0000 7f7e7101c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-22T08:40:24.013 INFO:tasks.ceph.osd.2:Started 2023-12-22T08:40:24.013 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-22T08:40:24.013 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-22T08:40:24.015 INFO:tasks.ceph.osd.3:Started 2023-12-22T08:40:24.015 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-22T08:40:24.015 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-22T08:40:24.017 INFO:tasks.ceph.osd.4:Started 2023-12-22T08:40:24.018 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-22T08:40:24.018 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-22T08:40:24.020 INFO:tasks.ceph.osd.5:Started 2023-12-22T08:40:24.020 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-22T08:40:24.020 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-22T08:40:24.022 INFO:tasks.ceph.osd.6:Started 2023-12-22T08:40:24.023 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-22T08:40:24.023 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-22T08:40:24.025 INFO:tasks.ceph.osd.7:Started 2023-12-22T08:40:24.025 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:24.033 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:24.031+0000 7f44f6e17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-22T08:40:24.108 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:24.106+0000 7f44f6e17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-22T08:40:24.129 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:24.127+0000 7f7e7101c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-22T08:40:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.155+0000 7f3b2ce10640 1 Processor -- start 2023-12-22T08:40:24.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.155+0000 7f3b2ce10640 1 -- start start 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b2ce10640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b2814af10 0x7f3b2814b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b2ce10640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3b281534f0 0x7f3b281558e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b2ce10640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2809fab0 con 0x7f3b280bfad0 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b2ce10640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2814b890 con 0x7f3b281534f0 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b2ce10640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b280bae90 con 0x7f3b2814af10 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b2659c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3b280bfad0 0x7f3b28148140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50728/0 (socket says 172.21.15.31:50728) 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b2659c640 1 -- 172.21.15.31:0/266034606 learned_addr learned my addr 172.21.15.31:0/266034606 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b1ffff640 1 --2- 172.21.15.31:0/266034606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b2814af10 0x7f3b2814b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b26d9d640 1 --2- 172.21.15.31:0/266034606 >> v2:172.21.15.69:3300/0 conn(0x7f3b281534f0 0x7f3b281558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b25d9b640 1 -- 172.21.15.31:0/266034606 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161335900 0 0) 0x7f3b2809fab0 con 0x7f3b280bfad0 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.156+0000 7f3b25d9b640 1 -- 172.21.15.31:0/266034606 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b14003520 con 0x7f3b280bfad0 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.157+0000 7f3b25d9b640 1 -- 172.21.15.31:0/266034606 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2302432193 0 0) 0x7f3b14003520 con 0x7f3b280bfad0 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.157+0000 7f3b1ffff640 1 -- 172.21.15.31:0/266034606 >> v2:172.21.15.69:3300/0 conn(0x7f3b281534f0 msgr2=0x7f3b281558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.157+0000 7f3b1ffff640 1 --2- 172.21.15.31:0/266034606 >> v2:172.21.15.69:3300/0 conn(0x7f3b281534f0 0x7f3b281558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.157+0000 7f3b1ffff640 1 -- 172.21.15.31:0/266034606 >> v1:172.21.15.31:6789/0 conn(0x7f3b280bfad0 legacy=0x7f3b28148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.157+0000 7f3b1ffff640 1 -- 172.21.15.31:0/266034606 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b280bb170 con 0x7f3b2814af10 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.157+0000 7f3b26d9d640 1 --2- 172.21.15.31:0/266034606 >> v2:172.21.15.69:3300/0 conn(0x7f3b281534f0 0x7f3b281558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.157+0000 7f3b1ffff640 1 --2- 172.21.15.31:0/266034606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b2814af10 0x7f3b2814b350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3b100097a0 tx=0x7f3b1002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d9b277ab40f23a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b25d9b640 1 -- 172.21.15.31:0/266034606 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18001670 con 0x7f3b2814af10 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b25d9b640 1 -- 172.21.15.31:0/266034606 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1002e050 con 0x7f3b2814af10 2023-12-22T08:40:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b25d9b640 1 -- 172.21.15.31:0/266034606 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10030730 con 0x7f3b2814af10 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b2ce10640 1 -- 172.21.15.31:0/266034606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b2814af10 msgr2=0x7f3b2814b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b2ce10640 1 --2- 172.21.15.31:0/266034606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b2814af10 0x7f3b2814b350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3b100097a0 tx=0x7f3b1002b710 comp rx=0 tx=0).stop 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b2ce10640 1 -- 172.21.15.31:0/266034606 shutdown_connections 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b2ce10640 1 --2- 172.21.15.31:0/266034606 >> v2:172.21.15.69:3300/0 conn(0x7f3b281534f0 0x7f3b281558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b2ce10640 1 --2- 172.21.15.31:0/266034606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b2814af10 0x7f3b2814b350 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b2ce10640 1 -- 172.21.15.31:0/266034606 >> 172.21.15.31:0/266034606 conn(0x7f3b280c0370 msgr2=0x7f3b280c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b2ce10640 1 -- 172.21.15.31:0/266034606 shutdown_connections 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.158+0000 7f3b2ce10640 1 -- 172.21.15.31:0/266034606 wait complete. 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.159+0000 7f3b2ce10640 1 Processor -- start 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.159+0000 7f3b2ce10640 1 -- start start 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2ce10640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b280bfad0 0x7f3b28145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2ce10640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b2814af10 0x7f3b281dfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:24.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2ce10640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b281534f0 0x7f3b281e0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2ce10640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b281e3fb0 con 0x7f3b280bfad0 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2ce10640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b28145a60 con 0x7f3b2814af10 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2ce10640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b281e3670 con 0x7f3b281534f0 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b280bfad0 0x7f3b28145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b280bfad0 0x7f3b28145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34136/0 (socket says 172.21.15.31:34136) 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2659c640 1 -- 172.21.15.31:0/3967645453 learned_addr learned my addr 172.21.15.31:0/3967645453 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b1ffff640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b2814af10 0x7f3b281dfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b26d9d640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b281534f0 0x7f3b281e0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2659c640 1 -- 172.21.15.31:0/3967645453 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b281534f0 msgr2=0x7f3b281e0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2659c640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b281534f0 0x7f3b281e0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.160+0000 7f3b2659c640 1 -- 172.21.15.31:0/3967645453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b2814af10 msgr2=0x7f3b281dfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b2659c640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b2814af10 0x7f3b281dfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b2659c640 1 -- 172.21.15.31:0/3967645453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20009a70 con 0x7f3b280bfad0 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b2659c640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b280bfad0 0x7f3b28145520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c710 tx=0x7f3b1800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b1effd640 1 -- 172.21.15.31:0/3967645453 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18005ad0 con 0x7f3b280bfad0 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b1effd640 1 -- 172.21.15.31:0/3967645453 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18005c30 con 0x7f3b280bfad0 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b1effd640 1 -- 172.21.15.31:0/3967645453 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18007070 con 0x7f3b280bfad0 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b10009400 con 0x7f3b280bfad0 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b281e3bd0 con 0x7f3b280bfad0 2023-12-22T08:40:24.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b1effd640 1 -- 172.21.15.31:0/3967645453 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3b180074f0 con 0x7f3b280bfad0 2023-12-22T08:40:24.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.161+0000 7f3b1effd640 1 -- 172.21.15.31:0/3967645453 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3b18012400 con 0x7f3b280bfad0 2023-12-22T08:40:24.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.162+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b28073a40 con 0x7f3b280bfad0 2023-12-22T08:40:24.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.164+0000 7f3b1effd640 1 -- 172.21.15.31:0/3967645453 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f3b1800a640 con 0x7f3b280bfad0 2023-12-22T08:40:24.218 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:24.216+0000 7f44f6e17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-22T08:40:24.226 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:24.224+0000 7f7e7101c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-22T08:40:24.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.225+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b2814a4f0 con 0x7f3b280bfad0 2023-12-22T08:40:24.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.226+0000 7f3b1effd640 1 -- 172.21.15.31:0/3967645453 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3b1800a7e0 con 0x7f3b280bfad0 2023-12-22T08:40:24.228 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:24.229 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:23.986727+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:24.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.226+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b280bfad0 msgr2=0x7f3b28145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:24.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.226+0000 7f3b2ce10640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b280bfad0 0x7f3b28145520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c710 tx=0x7f3b1800cbd0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.227+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 shutdown_connections 2023-12-22T08:40:24.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.227+0000 7f3b2ce10640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b281534f0 0x7f3b281e0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.227+0000 7f3b2ce10640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b2814af10 0x7f3b281dfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.227+0000 7f3b2ce10640 1 --2- 172.21.15.31:0/3967645453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b280bfad0 0x7f3b28145520 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:24.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.227+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 >> 172.21.15.31:0/3967645453 conn(0x7f3b280c0370 msgr2=0x7f3b28147600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:24.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.227+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 shutdown_connections 2023-12-22T08:40:24.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:24.227+0000 7f3b2ce10640 1 -- 172.21.15.31:0/3967645453 wait complete. 2023-12-22T08:40:24.240 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-22T08:40:24.240 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-22T08:40:24.319 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:24.316+0000 7f44f6e17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-22T08:40:24.365 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:24.362+0000 7f7e7101c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-22T08:40:24.407 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:24.405+0000 7f7e7101c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-22T08:40:24.465 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:24.462+0000 7f44f6e17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-22T08:40:24.509 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:24.507+0000 7f44f6e17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-22T08:40:24.545 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:24.543+0000 7f7e7101c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-22T08:40:24.615 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-22T08:40:24.612+0000 7fe54e103500 -1 Falling back to public interface 2023-12-22T08:40:24.619 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-22T08:40:24.617+0000 7fa1bb9e2500 -1 Falling back to public interface 2023-12-22T08:40:24.629 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-12-22T08:40:24.626+0000 7f04ae9e2500 -1 Falling back to public interface 2023-12-22T08:40:24.636 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-22T08:40:24.633+0000 7fe0ff413500 -1 Falling back to public interface 2023-12-22T08:40:24.643 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-12-22T08:40:24.641+0000 7f61fc20f500 -1 Falling back to public interface 2023-12-22T08:40:24.645 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-12-22T08:40:24.642+0000 7f0605018500 -1 Falling back to public interface 2023-12-22T08:40:24.645 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-12-22T08:40:24.642+0000 7f0603a8f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6812/0: (98) Address already in use 2023-12-22T08:40:24.645 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-22T08:40:24.642+0000 7f4517225500 -1 Falling back to public interface 2023-12-22T08:40:24.645 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-12-22T08:40:24.643+0000 7f61fabf7640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-12-22T08:40:24.657 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-12-22T08:40:24.654+0000 7f26f802a500 -1 Falling back to public interface 2023-12-22T08:40:24.658 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:24.656+0000 7f44f6e17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-22T08:40:25.047 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:25.140 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.137+0000 7fa3a6877640 1 Processor -- start 2023-12-22T08:40:25.140 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.137+0000 7fa3a6877640 1 -- start start 2023-12-22T08:40:25.140 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.137+0000 7fa3a6877640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b53f0 0x7fa3a0147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.137+0000 7fa3a6877640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3a0148110 0x7fa3a00bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.137+0000 7fa3a6877640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a00baf30 con 0x7fa3a00b6280 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.137+0000 7fa3a6877640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a00b6a00 con 0x7fa3a0148110 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.137+0000 7fa3a6877640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0148560 con 0x7fa3a00b53f0 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.137+0000 7fa3a4e14640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3a0148110 0x7fa3a00bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa3a4e14640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3a0148110 0x7fa3a00bb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47344/0 (socket says 172.21.15.31:47344) 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa39ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa3a00b6280 0x7fa3a014e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45010/0 (socket says 172.21.15.31:45010) 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa3a4e14640 1 -- 172.21.15.31:0/1473815199 learned_addr learned my addr 172.21.15.31:0/1473815199 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa39f7fe640 1 --2- 172.21.15.31:0/1473815199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b53f0 0x7fa3a0147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa3a4e14640 1 -- 172.21.15.31:0/1473815199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b53f0 msgr2=0x7fa3a0147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa3a4e14640 1 --2- 172.21.15.31:0/1473815199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b53f0 0x7fa3a0147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa3a4e14640 1 -- 172.21.15.31:0/1473815199 >> v1:172.21.15.31:6789/0 conn(0x7fa3a00b6280 legacy=0x7fa3a014e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:25.141 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa3a4e14640 1 -- 172.21.15.31:0/1473815199 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a014e880 con 0x7fa3a0148110 2023-12-22T08:40:25.142 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.138+0000 7fa39effd640 1 -- 172.21.15.31:0/1473815199 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728364380 0 0) 0x7fa3a00baf30 con 0x7fa3a00b6280 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a4e14640 1 --2- 172.21.15.31:0/1473815199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a00bb3c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa398009e50 tx=0x7fa39802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f13a36968779f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa39effd640 1 -- 172.21.15.31:0/1473815199 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39802cb00 con 0x7fa3a0148110 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa39effd640 1 -- 172.21.15.31:0/1473815199 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39802cc60 con 0x7fa3a0148110 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa39effd640 1 -- 172.21.15.31:0/1473815199 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980343f0 con 0x7fa3a0148110 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a6877640 1 -- 172.21.15.31:0/1473815199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 msgr2=0x7fa3a00bb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a6877640 1 --2- 172.21.15.31:0/1473815199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a00bb3c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa398009e50 tx=0x7fa39802bf60 comp rx=0 tx=0).stop 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a6877640 1 -- 172.21.15.31:0/1473815199 shutdown_connections 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a6877640 1 --2- 172.21.15.31:0/1473815199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a00bb3c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:25.143 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a6877640 1 --2- 172.21.15.31:0/1473815199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b53f0 0x7fa3a0147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:25.144 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a6877640 1 -- 172.21.15.31:0/1473815199 >> 172.21.15.31:0/1473815199 conn(0x7fa3a00c05b0 msgr2=0x7fa3a00c09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:25.144 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a6877640 1 -- 172.21.15.31:0/1473815199 shutdown_connections 2023-12-22T08:40:25.144 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.139+0000 7fa3a6877640 1 -- 172.21.15.31:0/1473815199 wait complete. 2023-12-22T08:40:25.144 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.140+0000 7fa3a6877640 1 Processor -- start 2023-12-22T08:40:25.144 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.140+0000 7fa3a6877640 1 -- start start 2023-12-22T08:40:25.146 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a6877640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a00b53f0 0x7fa3a00bc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:25.146 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a6877640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b6280 0x7fa3a013f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:25.146 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a6877640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a013f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:25.146 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a6877640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a013fe60 con 0x7fa3a0148110 2023-12-22T08:40:25.146 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a6877640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00bcac0 con 0x7fa3a00b53f0 2023-12-22T08:40:25.146 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a6877640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0140840 con 0x7fa3a00b6280 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a4e14640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a013f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a4e14640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a013f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47358/0 (socket says 172.21.15.31:47358) 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa3a4e14640 1 -- 172.21.15.31:0/3785369611 learned_addr learned my addr 172.21.15.31:0/3785369611 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa39ffff640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a00b53f0 0x7fa3a00bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.141+0000 7fa39f7fe640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b6280 0x7fa3a013f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa3a4e14640 1 -- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b6280 msgr2=0x7fa3a013f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa3a4e14640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b6280 0x7fa3a013f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa3a4e14640 1 -- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a00b53f0 msgr2=0x7fa3a00bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa3a4e14640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a00b53f0 0x7fa3a00bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa3a4e14640 1 -- 172.21.15.31:0/3785369611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa398009b30 con 0x7fa3a0148110 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa39ffff640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a00b53f0 0x7fa3a00bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa39f7fe640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b6280 0x7fa3a013f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa3a4e14640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a013f810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa398036040 tx=0x7fa398004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:25.147 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa39cff9640 1 -- 172.21.15.31:0/3785369611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398009510 con 0x7fa3a0148110 2023-12-22T08:40:25.148 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa39cff9640 1 -- 172.21.15.31:0/3785369611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39803e450 con 0x7fa3a0148110 2023-12-22T08:40:25.148 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a014ba50 con 0x7fa3a0148110 2023-12-22T08:40:25.148 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa39cff9640 1 -- 172.21.15.31:0/3785369611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39803e800 con 0x7fa3a0148110 2023-12-22T08:40:25.148 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a01400f0 con 0x7fa3a0148110 2023-12-22T08:40:25.148 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa39cff9640 1 -- 172.21.15.31:0/3785369611 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa39803ec60 con 0x7fa3a0148110 2023-12-22T08:40:25.148 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.142+0000 7fa39cff9640 1 -- 172.21.15.31:0/3785369611 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa398048ae0 con 0x7fa3a0148110 2023-12-22T08:40:25.148 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.143+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a0067020 con 0x7fa3a0148110 2023-12-22T08:40:25.148 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.145+0000 7fa39cff9640 1 -- 172.21.15.31:0/3785369611 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fa398043020 con 0x7fa3a0148110 2023-12-22T08:40:25.210 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.207+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3a00b5c60 con 0x7fa3a0148110 2023-12-22T08:40:25.210 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.208+0000 7fa39cff9640 1 -- 172.21.15.31:0/3785369611 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa398048400 con 0x7fa3a0148110 2023-12-22T08:40:25.211 INFO:teuthology.misc.health.smithi031.stdout: 2023-12-22T08:40:25.211 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":10,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:23.986727+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:25.212 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 msgr2=0x7fa3a013f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:25.212 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a013f810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa398036040 tx=0x7fa398004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:25.212 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 shutdown_connections 2023-12-22T08:40:25.212 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3a0148110 0x7fa3a013f810 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:25.212 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3a00b6280 0x7fa3a013f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:25.212 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 --2- 172.21.15.31:0/3785369611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3a00b53f0 0x7fa3a00bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:25.212 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 >> 172.21.15.31:0/3785369611 conn(0x7fa3a00c05b0 msgr2=0x7fa3a01470f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:25.212 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 shutdown_connections 2023-12-22T08:40:25.213 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:25.209+0000 7fa3a6877640 1 -- 172.21.15.31:0/3785369611 wait complete. 2023-12-22T08:40:25.220 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-22T08:40:25.334 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:25.332+0000 7f7e7101c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-22T08:40:25.487 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:25.484+0000 7f44f6e17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-22T08:40:25.608 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:25.606+0000 7f7e7101c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-22T08:40:25.658 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:25.656+0000 7f7e7101c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-22T08:40:25.760 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:25.758+0000 7f7e7101c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-22T08:40:25.774 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:25.771+0000 7f44f6e17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-22T08:40:25.829 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:25.827+0000 7f44f6e17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-22T08:40:25.934 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-12-22T08:40:25.932+0000 7f44f6e17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-22T08:40:26.787 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:26.784+0000 7f7e1219d640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-22T08:40:26.787 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-22T08:40:26.785+0000 7f7e1219d640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-22T08:40:28.093 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-12-22T08:40:28.091+0000 7f04ae9e2500 -1 osd.0 0 log_to_monitors true 2023-12-22T08:40:28.097 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-22T08:40:28.095+0000 7fe54e103500 -1 osd.4 0 log_to_monitors true 2023-12-22T08:40:28.142 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-22T08:40:28.140+0000 7fa1bb9e2500 -1 osd.5 0 log_to_monitors true 2023-12-22T08:40:28.151 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-12-22T08:40:28.149+0000 7f0605018500 -1 osd.1 0 log_to_monitors true 2023-12-22T08:40:28.170 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-22T08:40:28.168+0000 7fe0ff413500 -1 osd.6 0 log_to_monitors true 2023-12-22T08:40:28.172 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-12-22T08:40:28.170+0000 7f61fc20f500 -1 osd.3 0 log_to_monitors true 2023-12-22T08:40:28.177 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-12-22T08:40:28.175+0000 7f26f802a500 -1 osd.2 0 log_to_monitors true 2023-12-22T08:40:28.189 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-22T08:40:28.186+0000 7f4517225500 -1 osd.7 0 log_to_monitors true 2023-12-22T08:40:31.851 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-22T08:40:31.849+0000 7fe54986b640 -1 osd.4 0 waiting for initial osdmap 2023-12-22T08:40:31.860 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-22T08:40:31.858+0000 7fe541e9c640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:40:31.877 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-22T08:40:31.875+0000 7f45122ce640 -1 osd.7 0 waiting for initial osdmap 2023-12-22T08:40:31.883 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-12-22T08:40:31.881+0000 7f26f4613640 -1 osd.2 0 waiting for initial osdmap 2023-12-22T08:40:31.886 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-22T08:40:31.884+0000 7f450a8ff640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:40:31.890 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-22T08:40:31.888+0000 7fe0fa4a8640 -1 osd.6 0 waiting for initial osdmap 2023-12-22T08:40:31.893 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-12-22T08:40:31.891+0000 7f26eb409640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:40:31.898 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-22T08:40:31.896+0000 7fa1b714c640 -1 osd.5 0 waiting for initial osdmap 2023-12-22T08:40:31.904 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-22T08:40:31.902+0000 7fe0f2ad9640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:40:31.910 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-22T08:40:31.908+0000 7fa1af77d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:40:31.947 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-12-22T08:40:31.945+0000 7f04aa14c640 -1 osd.0 0 waiting for initial osdmap 2023-12-22T08:40:31.961 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-12-22T08:40:31.959+0000 7f04a277d640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:40:31.970 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-12-22T08:40:31.968+0000 7f0601a8b640 -1 osd.1 0 waiting for initial osdmap 2023-12-22T08:40:31.992 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-12-22T08:40:31.990+0000 7f05f8881640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:40:31.993 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-12-22T08:40:31.991+0000 7f61f73b8640 -1 osd.3 0 waiting for initial osdmap 2023-12-22T08:40:32.012 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-12-22T08:40:32.010+0000 7f61ef9e9640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T08:40:32.027 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:32.119 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.117+0000 7f41b7857640 1 Processor -- start 2023-12-22T08:40:32.119 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.117+0000 7f41b7857640 1 -- start start 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.117+0000 7f41b7857640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b00b6280 0x7f41b014e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.117+0000 7f41b7857640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f41b01482e0 0x7f41b00bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.117+0000 7f41b7857640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b00baf30 con 0x7f41b00b53f0 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b7857640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b00b6a00 con 0x7f41b01482e0 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b7857640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b014e5c0 con 0x7f41b00b6280 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b55f3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b00b6280 0x7f41b014e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b5df4640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f41b01482e0 0x7f41b00bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b4df2640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f41b00b53f0 0x7f41b0147bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:56580/0 (socket says 172.21.15.31:56580) 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b4df2640 1 -- 172.21.15.31:0/3695302753 learned_addr learned my addr 172.21.15.31:0/3695302753 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41a3fff640 1 -- 172.21.15.31:0/3695302753 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388215167 0 0) 0x7f41b00baf30 con 0x7f41b00b53f0 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41a3fff640 1 -- 172.21.15.31:0/3695302753 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f419c003520 con 0x7f41b00b53f0 2023-12-22T08:40:32.121 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b5df4640 1 -- 172.21.15.31:0/3695302753 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b00b6280 msgr2=0x7f41b014e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:32.122 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b5df4640 1 --2- 172.21.15.31:0/3695302753 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b00b6280 0x7f41b014e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.122 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b5df4640 1 -- 172.21.15.31:0/3695302753 >> v1:172.21.15.69:6789/0 conn(0x7f41b00b53f0 legacy=0x7f41b0147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.122 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b5df4640 1 -- 172.21.15.31:0/3695302753 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b014e880 con 0x7f41b01482e0 2023-12-22T08:40:32.122 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.118+0000 7f41b55f3640 1 --2- 172.21.15.31:0/3695302753 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b00b6280 0x7f41b014e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:32.123 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.119+0000 7f41b5df4640 1 --2- 172.21.15.31:0/3695302753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b01482e0 0x7f41b00bb3c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009d90 tx=0x7f41a802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e54ef20daebb55d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:32.123 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.119+0000 7f41a3fff640 1 -- 172.21.15.31:0/3695302753 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a802cc50 con 0x7f41b01482e0 2023-12-22T08:40:32.123 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.119+0000 7f41a3fff640 1 -- 172.21.15.31:0/3695302753 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a802cdb0 con 0x7f41b01482e0 2023-12-22T08:40:32.123 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.119+0000 7f41a3fff640 1 -- 172.21.15.31:0/3695302753 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a8034660 con 0x7f41b01482e0 2023-12-22T08:40:32.123 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.120+0000 7f41b7857640 1 -- 172.21.15.31:0/3695302753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b01482e0 msgr2=0x7f41b00bb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.120+0000 7f41b7857640 1 --2- 172.21.15.31:0/3695302753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b01482e0 0x7f41b00bb3c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f41a8009d90 tx=0x7f41a802bea0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.120+0000 7f41b7857640 1 -- 172.21.15.31:0/3695302753 shutdown_connections 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.120+0000 7f41b7857640 1 --2- 172.21.15.31:0/3695302753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b01482e0 0x7f41b00bb3c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.120+0000 7f41b7857640 1 --2- 172.21.15.31:0/3695302753 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b00b6280 0x7f41b014e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.120+0000 7f41b7857640 1 -- 172.21.15.31:0/3695302753 >> 172.21.15.31:0/3695302753 conn(0x7f41b00c05b0 msgr2=0x7f41b00c09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.120+0000 7f41b7857640 1 -- 172.21.15.31:0/3695302753 shutdown_connections 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.120+0000 7f41b7857640 1 -- 172.21.15.31:0/3695302753 wait complete. 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.121+0000 7f41b7857640 1 Processor -- start 2023-12-22T08:40:32.124 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.121+0000 7f41b7857640 1 -- start start 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.121+0000 7f41b7857640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b00b53f0 0x7f41b014d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.121+0000 7f41b7857640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b00b6280 0x7f41b013ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.121+0000 7f41b7857640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b01482e0 0x7f41b013f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.121+0000 7f41b7857640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b0141880 con 0x7f41b00b6280 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.121+0000 7f41b7857640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b014d8d0 con 0x7f41b00b53f0 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.121+0000 7f41b7857640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b0140200 con 0x7f41b01482e0 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b00b6280 0x7f41b013ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b00b6280 0x7f41b013ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47408/0 (socket says 172.21.15.31:47408) 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 -- 172.21.15.31:0/2146455074 learned_addr learned my addr 172.21.15.31:0/2146455074 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b55f3640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b00b53f0 0x7f41b014d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.127 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b5df4640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b01482e0 0x7f41b013f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 -- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b01482e0 msgr2=0x7f41b013f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b01482e0 0x7f41b013f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 -- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b00b53f0 msgr2=0x7f41b014d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b00b53f0 0x7f41b014d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 -- 172.21.15.31:0/2146455074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4009400 con 0x7f41b00b6280 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b55f3640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b00b53f0 0x7f41b014d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b4df2640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b00b6280 0x7f41b013ef20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c500 tx=0x7f41ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41a1ffb640 1 -- 172.21.15.31:0/2146455074 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac005ce0 con 0x7f41b00b6280 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41a1ffb640 1 -- 172.21.15.31:0/2146455074 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac005e40 con 0x7f41b00b6280 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a8009a70 con 0x7f41b00b6280 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.122+0000 7f41a1ffb640 1 -- 172.21.15.31:0/2146455074 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac007330 con 0x7f41b00b6280 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.123+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b01407c0 con 0x7f41b00b6280 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.124+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b004e8d0 con 0x7f41b00b6280 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.124+0000 7f41a1ffb640 1 -- 172.21.15.31:0/2146455074 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 88551+0+0 (secure 0 0 0) 0x7f41ac007490 con 0x7f41b00b6280 2023-12-22T08:40:32.128 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.124+0000 7f41a1ffb640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f419406a3a0 0x7f419406c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:32.129 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.124+0000 7f41a1ffb640 1 -- 172.21.15.31:0/2146455074 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f41ac087040 con 0x7f41b00b6280 2023-12-22T08:40:32.129 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.124+0000 7f41b55f3640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f419406a3a0 0x7f419406c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:32.129 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.125+0000 7f41b55f3640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f419406a3a0 0x7f419406c860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f41a4011380 tx=0x7f41a4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:32.131 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.129+0000 7f41a1ffb640 1 -- 172.21.15.31:0/2146455074 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f41ac053600 con 0x7f41b00b6280 2023-12-22T08:40:32.308 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.306+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41b0143500 con 0x7f41b00b6280 2023-12-22T08:40:32.309 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.306+0000 7f41a1ffb640 1 -- 172.21.15.31:0/2146455074 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f41ac017020 con 0x7f41b00b6280 2023-12-22T08:40:32.309 INFO:teuthology.misc.health.smithi031.stdout: 2023-12-22T08:40:32.309 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":12,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:29.787013+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:32.311 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f419406a3a0 msgr2=0x7f419406c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.311 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f419406a3a0 0x7f419406c860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f41a4011380 tx=0x7f41a4009190 comp rx=0 tx=0).stop 2023-12-22T08:40:32.311 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b00b6280 msgr2=0x7f41b013ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:32.311 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b00b6280 0x7f41b013ef20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c500 tx=0x7f41ac00c9c0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.312 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 shutdown_connections 2023-12-22T08:40:32.312 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f419406a3a0 0x7f419406c860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.312 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41b01482e0 0x7f41b013f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.312 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41b00b6280 0x7f41b013ef20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.312 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 --2- 172.21.15.31:0/2146455074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41b00b53f0 0x7f41b014d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:32.312 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 >> 172.21.15.31:0/2146455074 conn(0x7f41b00c05b0 msgr2=0x7f41b01479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:32.312 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 shutdown_connections 2023-12-22T08:40:32.312 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:32.308+0000 7f41b7857640 1 -- 172.21.15.31:0/2146455074 wait complete. 2023-12-22T08:40:32.320 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-22T08:40:39.128 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:39.231 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.228+0000 7f31ee430640 1 Processor -- start 2023-12-22T08:40:39.231 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.228+0000 7f31ee430640 1 -- start start 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31ee430640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e806a390 0x7f31e8070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31ee430640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31e8148050 0x7f31e8141810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31ee430640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e8071c30 con 0x7f31e8141d50 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31ee430640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80714f0 con 0x7f31e8148050 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31ee430640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80717d0 con 0x7f31e806a390 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31e77fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31e8148050 0x7f31e8141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31e77fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31e8148050 0x7f31e8141810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52794/0 (socket says 172.21.15.31:52794) 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31e77fe640 1 -- 172.21.15.31:0/2667145487 learned_addr learned my addr 172.21.15.31:0/2667145487 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31e7fff640 1 --2- 172.21.15.31:0/2667145487 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e806a390 0x7f31e8070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31e77fe640 1 -- 172.21.15.31:0/2667145487 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e806a390 msgr2=0x7f31e8070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31e77fe640 1 --2- 172.21.15.31:0/2667145487 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e806a390 0x7f31e8070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.233 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31e77fe640 1 -- 172.21.15.31:0/2667145487 >> v1:172.21.15.69:6789/0 conn(0x7f31e8141d50 legacy=0x7f31e814ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.234 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.229+0000 7f31e77fe640 1 -- 172.21.15.31:0/2667145487 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8147b30 con 0x7f31e8148050 2023-12-22T08:40:39.234 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.230+0000 7f31e77fe640 1 --2- 172.21.15.31:0/2667145487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e8148050 0x7f31e8141810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31d800bb10 tx=0x7f31d802e1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad2b1c2d1e0f84 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.234 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.230+0000 7f31e6ffd640 1 -- 172.21.15.31:0/2667145487 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8036440 con 0x7f31e8148050 2023-12-22T08:40:39.234 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.230+0000 7f31e6ffd640 1 -- 172.21.15.31:0/2667145487 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d80365a0 con 0x7f31e8148050 2023-12-22T08:40:39.234 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.230+0000 7f31e6ffd640 1 -- 172.21.15.31:0/2667145487 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8036930 con 0x7f31e8148050 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.231+0000 7f31ee430640 1 -- 172.21.15.31:0/2667145487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e8148050 msgr2=0x7f31e8141810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.231+0000 7f31ee430640 1 --2- 172.21.15.31:0/2667145487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e8148050 0x7f31e8141810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31d800bb10 tx=0x7f31d802e1f0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.231+0000 7f31ee430640 1 -- 172.21.15.31:0/2667145487 shutdown_connections 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.231+0000 7f31ee430640 1 --2- 172.21.15.31:0/2667145487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e8148050 0x7f31e8141810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.231+0000 7f31ee430640 1 --2- 172.21.15.31:0/2667145487 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e806a390 0x7f31e8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.231+0000 7f31ee430640 1 -- 172.21.15.31:0/2667145487 >> 172.21.15.31:0/2667145487 conn(0x7f31e80bc3b0 msgr2=0x7f31e80bc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.231+0000 7f31ee430640 1 -- 172.21.15.31:0/2667145487 shutdown_connections 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.231+0000 7f31ee430640 1 -- 172.21.15.31:0/2667145487 wait complete. 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.232+0000 7f31ee430640 1 Processor -- start 2023-12-22T08:40:39.235 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.232+0000 7f31ee430640 1 -- start start 2023-12-22T08:40:39.237 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31ee430640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e806a390 0x7f31e8149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.237 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31ee430640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e8141d50 0x7f31e80b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.237 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31ee430640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e8148050 0x7f31e814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.237 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31ee430640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8149cc0 con 0x7f31e806a390 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31ee430640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8148a70 con 0x7f31e8148050 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31ee430640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80b4800 con 0x7f31e8141d50 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31e7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e806a390 0x7f31e8149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31e7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e806a390 0x7f31e8149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52804/0 (socket says 172.21.15.31:52804) 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31e7fff640 1 -- 172.21.15.31:0/1051430728 learned_addr learned my addr 172.21.15.31:0/1051430728 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31e77fe640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e8141d50 0x7f31e80b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31ec9cd640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e8148050 0x7f31e814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31e7fff640 1 -- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e8141d50 msgr2=0x7f31e80b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31e7fff640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e8141d50 0x7f31e80b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.233+0000 7f31e7fff640 1 -- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e8148050 msgr2=0x7f31e814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.234+0000 7f31e7fff640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e8148050 0x7f31e814a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.234+0000 7f31e7fff640 1 -- 172.21.15.31:0/1051430728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d800b770 con 0x7f31e806a390 2023-12-22T08:40:39.238 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.234+0000 7f31e7fff640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e806a390 0x7f31e8149780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31d000e900 tx=0x7f31d000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.239 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.234+0000 7f31e4ff9640 1 -- 172.21.15.31:0/1051430728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0009660 con 0x7f31e806a390 2023-12-22T08:40:39.239 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.234+0000 7f31e4ff9640 1 -- 172.21.15.31:0/1051430728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000ca00 con 0x7f31e806a390 2023-12-22T08:40:39.239 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.234+0000 7f31e4ff9640 1 -- 172.21.15.31:0/1051430728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000cd70 con 0x7f31e806a390 2023-12-22T08:40:39.239 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.234+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e80b6560 con 0x7f31e806a390 2023-12-22T08:40:39.239 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.234+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e80b60d0 con 0x7f31e806a390 2023-12-22T08:40:39.239 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.235+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e80b6320 con 0x7f31e806a390 2023-12-22T08:40:39.240 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.235+0000 7f31e4ff9640 1 -- 172.21.15.31:0/1051430728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f31d0013470 con 0x7f31e806a390 2023-12-22T08:40:39.240 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.236+0000 7f31e4ff9640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f31c806a460 0x7f31c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.240 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.236+0000 7f31e4ff9640 1 -- 172.21.15.31:0/1051430728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31d0088ba0 con 0x7f31e806a390 2023-12-22T08:40:39.240 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.236+0000 7f31e77fe640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f31c806a460 0x7f31c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.240 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.236+0000 7f31e77fe640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f31c806a460 0x7f31c806c920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31d8038000 tx=0x7f31d8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.243 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.241+0000 7f31e4ff9640 1 -- 172.21.15.31:0/1051430728 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f31e80b6320 con 0x7f31e806a390 2023-12-22T08:40:39.420 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.417+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31e80b6320 con 0x7f31e806a390 2023-12-22T08:40:39.420 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.418+0000 7f31e4ff9640 1 -- 172.21.15.31:0/1051430728 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f31e80b6320 con 0x7f31e806a390 2023-12-22T08:40:39.421 INFO:teuthology.misc.health.smithi031.stdout: 2023-12-22T08:40:39.421 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":16,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:35.859706+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:39.422 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f31c806a460 msgr2=0x7f31c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f31c806a460 0x7f31c806c920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31d8038000 tx=0x7f31d8032000 comp rx=0 tx=0).stop 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e806a390 msgr2=0x7f31e8149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e806a390 0x7f31e8149780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31d000e900 tx=0x7f31d000edc0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 shutdown_connections 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f31c806a460 0x7f31c806c920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e8148050 0x7f31e814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f31e8141d50 0x7f31e80b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 --2- 172.21.15.31:0/1051430728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31e806a390 0x7f31e8149780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 >> 172.21.15.31:0/1051430728 conn(0x7f31e80bc3b0 msgr2=0x7f31e80b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 shutdown_connections 2023-12-22T08:40:39.423 INFO:teuthology.misc.health.smithi031.stderr:2023-12-22T08:40:39.420+0000 7f31ee430640 1 -- 172.21.15.31:0/1051430728 wait complete. 2023-12-22T08:40:39.432 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-22T08:40:39.432 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-22T08:40:39.432 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:40:39.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:40:39.435 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:40:39.435 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:40:39.435 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:40:39.437 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:40:39.437 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:40:39.437 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:40:39.439 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:40:39.440 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-22T08:40:39.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:39.517 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-12-22T08:40:39.517 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-12-22T08:40:39.524 INFO:tasks.ceph.mds.b.smithi069.stdout:starting mds.b at 2023-12-22T08:40:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.549+0000 7f8a1598b640 1 Processor -- start 2023-12-22T08:40:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.549+0000 7f8a1598b640 1 -- start start 2023-12-22T08:40:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a1598b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a1598b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8a100ba000 0x7f8a101554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a1598b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a100bb310 con 0x7f8a1006a6d0 2023-12-22T08:40:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a1598b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100bf960 con 0x7f8a100ba000 2023-12-22T08:40:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0effd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8a1006a6d0 0x7f8a1014acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58946/0 (socket says 172.21.15.31:58946) 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0effd640 1 -- 172.21.15.31:0/663484164 learned_addr learned my addr 172.21.15.31:0/663484164 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a1598b640 1 -- 172.21.15.31:0/663484164 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100bb5b0 con 0x7f8a100ba550 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0f7fe640 1 --2- 172.21.15.31:0/663484164 >> v2:172.21.15.69:3300/0 conn(0x7f8a100ba000 0x7f8a101554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0e7fc640 1 --2- 172.21.15.31:0/663484164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0dffb640 1 -- 172.21.15.31:0/663484164 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563158256 0 0) 0x7f8a100bb310 con 0x7f8a1006a6d0 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0dffb640 1 -- 172.21.15.31:0/663484164 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f8003520 con 0x7f8a1006a6d0 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0dffb640 1 -- 172.21.15.31:0/663484164 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2962453535 0 0) 0x7f89f8003520 con 0x7f8a1006a6d0 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0e7fc640 1 -- 172.21.15.31:0/663484164 >> v2:172.21.15.69:3300/0 conn(0x7f8a100ba000 msgr2=0x7f8a101554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0e7fc640 1 --2- 172.21.15.31:0/663484164 >> v2:172.21.15.69:3300/0 conn(0x7f8a100ba000 0x7f8a101554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0e7fc640 1 -- 172.21.15.31:0/663484164 >> v1:172.21.15.31:6789/0 conn(0x7f8a1006a6d0 legacy=0x7f8a1014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.550+0000 7f8a0e7fc640 1 -- 172.21.15.31:0/663484164 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100c0120 con 0x7f8a100ba550 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.551+0000 7f8a0e7fc640 1 --2- 172.21.15.31:0/663484164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b9ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a040097a0 tx=0x7f8a0402b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f568cdf511b3b5af server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.551+0000 7f8a0dffb640 1 -- 172.21.15.31:0/663484164 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00001650 con 0x7f8a100ba550 2023-12-22T08:40:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.551+0000 7f8a0dffb640 1 -- 172.21.15.31:0/663484164 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0402e050 con 0x7f8a100ba550 2023-12-22T08:40:39.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.551+0000 7f8a0dffb640 1 -- 172.21.15.31:0/663484164 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04030710 con 0x7f8a100ba550 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.552+0000 7f8a1598b640 1 -- 172.21.15.31:0/663484164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 msgr2=0x7f8a100b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.552+0000 7f8a1598b640 1 --2- 172.21.15.31:0/663484164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b9ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a040097a0 tx=0x7f8a0402b790 comp rx=0 tx=0).stop 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.552+0000 7f8a1598b640 1 -- 172.21.15.31:0/663484164 shutdown_connections 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.552+0000 7f8a1598b640 1 --2- 172.21.15.31:0/663484164 >> v2:172.21.15.69:3300/0 conn(0x7f8a100ba000 0x7f8a101554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.552+0000 7f8a1598b640 1 --2- 172.21.15.31:0/663484164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b9ac0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.552+0000 7f8a1598b640 1 -- 172.21.15.31:0/663484164 >> 172.21.15.31:0/663484164 conn(0x7f8a100c0350 msgr2=0x7f8a100c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.552+0000 7f8a1598b640 1 -- 172.21.15.31:0/663484164 shutdown_connections 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.552+0000 7f8a1598b640 1 -- 172.21.15.31:0/663484164 wait complete. 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.553+0000 7f8a1598b640 1 Processor -- start 2023-12-22T08:40:39.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.553+0000 7f8a1598b640 1 -- start start 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a1598b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a1006a6d0 0x7f8a1009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a1598b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a100ba000 0x7f8a100997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a1598b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a0effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a1006a6d0 0x7f8a1009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a0effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a1006a6d0 0x7f8a1009a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52854/0 (socket says 172.21.15.31:52854) 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a0effd640 1 -- 172.21.15.31:0/3768655442 learned_addr learned my addr 172.21.15.31:0/3768655442 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1009af10 con 0x7f8a1006a6d0 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100b5bf0 con 0x7f8a100ba000 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100b5ed0 con 0x7f8a100ba550 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a0f7fe640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.554+0000 7f8a0e7fc640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a100ba000 0x7f8a100997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f8a0effd640 1 -- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 msgr2=0x7f8a100b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f8a0effd640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f8a0effd640 1 -- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a100ba000 msgr2=0x7f8a100997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f8a0effd640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a100ba000 0x7f8a100997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f8a0effd640 1 -- 172.21.15.31:0/3768655442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04009400 con 0x7f8a1006a6d0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f8a0effd640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a1006a6d0 0x7f8a1009a9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c780 tx=0x7f8a0000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f89f7fff640 1 -- 172.21.15.31:0/3768655442 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000072d0 con 0x7f8a1006a6d0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f89f7fff640 1 -- 172.21.15.31:0/3768655442 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00007430 con 0x7f8a1006a6d0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f89f7fff640 1 -- 172.21.15.31:0/3768655442 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a000047e0 con 0x7f8a1006a6d0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a100b61b0 con 0x7f8a1006a6d0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.555+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a10099d10 con 0x7f8a1006a6d0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.556+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a100b63a0 con 0x7f8a1006a6d0 2023-12-22T08:40:39.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.557+0000 7f89f7fff640 1 -- 172.21.15.31:0/3768655442 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a00004940 con 0x7f8a1006a6d0 2023-12-22T08:40:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.557+0000 7f89f7fff640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f89fc06a430 0x7f89fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.557+0000 7f89f7fff640 1 -- 172.21.15.31:0/3768655442 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8a000878c0 con 0x7f8a1006a6d0 2023-12-22T08:40:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.557+0000 7f8a0e7fc640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f89fc06a430 0x7f89fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.558+0000 7f8a0e7fc640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f89fc06a430 0x7f89fc06c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a04034000 tx=0x7f8a0402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.561+0000 7f89f7fff640 1 -- 172.21.15.31:0/3768655442 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a00053340 con 0x7f8a1006a6d0 2023-12-22T08:40:39.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.736+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a10073a40 con 0x7f8a1006a6d0 2023-12-22T08:40:39.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.737+0000 7f89f7fff640 1 -- 172.21.15.31:0/3768655442 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f8a00018020 con 0x7f8a1006a6d0 2023-12-22T08:40:39.740 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:39.740 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:35.859706+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f89fc06a430 msgr2=0x7f89fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f89fc06a430 0x7f89fc06c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a04034000 tx=0x7f8a0402f000 comp rx=0 tx=0).stop 2023-12-22T08:40:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a1006a6d0 msgr2=0x7f8a1009a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a1006a6d0 0x7f8a1009a9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c780 tx=0x7f8a0000cc40 comp rx=0 tx=0).stop 2023-12-22T08:40:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 shutdown_connections 2023-12-22T08:40:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f89fc06a430 0x7f89fc06c8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8a100ba550 0x7f8a100b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a100ba000 0x7f8a100997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 --2- 172.21.15.31:0/3768655442 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a1006a6d0 0x7f8a1009a9d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 >> 172.21.15.31:0/3768655442 conn(0x7f8a100c0350 msgr2=0x7f8a100a14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 shutdown_connections 2023-12-22T08:40:39.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.739+0000 7f8a1598b640 1 -- 172.21.15.31:0/3768655442 wait complete. 2023-12-22T08:40:39.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:39.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:39.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.859+0000 7efd0df84640 1 Processor -- start 2023-12-22T08:40:39.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.859+0000 7efd0df84640 1 -- start start 2023-12-22T08:40:39.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd0df84640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efd08144d80 0x7efd080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd0df84640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0814ab10 con 0x7efd080b77d0 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd0df84640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0806c2f0 con 0x7efd080b8690 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd0df84640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd080ba620 con 0x7efd08144d80 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd07fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efd080b77d0 0x7efd0814afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58954/0 (socket says 172.21.15.31:58954) 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd07fff640 1 -- 172.21.15.31:0/874339033 learned_addr learned my addr 172.21.15.31:0/874339033 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd06ffd640 1 --2- 172.21.15.31:0/874339033 >> v2:172.21.15.69:3300/0 conn(0x7efd08144d80 0x7efd080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224457979 0 0) 0x7efd0814ab10 con 0x7efd080b77d0 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf0003520 con 0x7efd080b77d0 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3954539808 0 0) 0x7efcf0003520 con 0x7efd080b77d0 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 >> v2:172.21.15.69:3300/0 conn(0x7efd08144d80 msgr2=0x7efd080b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 --2- 172.21.15.31:0/874339033 >> v2:172.21.15.69:3300/0 conn(0x7efd08144d80 0x7efd080b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 >> v1:172.21.15.69:6789/0 conn(0x7efd080b8690 legacy=0x7efd08144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd080b9e60 con 0x7efd080b77d0 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7efd00001670 con 0x7efd080b77d0 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 >> v1:172.21.15.31:6789/0 conn(0x7efd080b77d0 legacy=0x7efd0814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf0003970 0x7efcf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf00047c0 0x7efcf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf0005180 0x7efcf000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd080ba620 con 0x7efcf0003970 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf000c120 con 0x7efcf0005180 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf000c2e0 con 0x7efcf00047c0 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd077fe640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf0003970 0x7efcf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd07fff640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf0005180 0x7efcf000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.860+0000 7efd06ffd640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf00047c0 0x7efcf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd077fe640 1 -- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf00047c0 msgr2=0x7efcf0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd077fe640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf00047c0 0x7efcf0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd077fe640 1 -- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf0005180 msgr2=0x7efcf000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:39.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd077fe640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcf0005180 0x7efcf000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd077fe640 1 -- 172.21.15.31:0/874339033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0003520 con 0x7efcf0003970 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd07fff640 1 -- 172.21.15.31:0/874339033 reap_dead start 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd06ffd640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf00047c0 0x7efcf0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd077fe640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf0003970 0x7efcf0003d90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcf8001e50 tx=0x7efcf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c56b31a8ecab48 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.861+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8003b70 con 0x7efcf0003970 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf8003cd0 con 0x7efcf0003970 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd067fc640 1 -- 172.21.15.31:0/874339033 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8005310 con 0x7efcf0003970 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd0df84640 1 -- 172.21.15.31:0/874339033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf0003970 msgr2=0x7efcf0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd0df84640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf0003970 0x7efcf0003d90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcf8001e50 tx=0x7efcf00057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd0df84640 1 -- 172.21.15.31:0/874339033 shutdown_connections 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd0df84640 1 --2- 172.21.15.31:0/874339033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf0003970 0x7efcf0003d90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd0df84640 1 -- 172.21.15.31:0/874339033 >> 172.21.15.31:0/874339033 conn(0x7efd0806b6a0 msgr2=0x7efd0806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd0df84640 1 -- 172.21.15.31:0/874339033 shutdown_connections 2023-12-22T08:40:39.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.862+0000 7efd0df84640 1 -- 172.21.15.31:0/874339033 wait complete. 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.863+0000 7efd0df84640 1 Processor -- start 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.863+0000 7efd0df84640 1 -- start start 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd0df84640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf0003970 0x7efd0813f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd0df84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0814d380 0x7efd080bf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd0df84640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd0814d800 0x7efd08141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd0df84640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0813ebd0 con 0x7efd0814d380 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd0df84640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0814ede0 con 0x7efd0814d800 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd0df84640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd081dfde0 con 0x7efcf0003970 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0814d380 0x7efd080bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0814d380 0x7efd080bf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52882/0 (socket says 172.21.15.31:52882) 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 -- 172.21.15.31:0/389994992 learned_addr learned my addr 172.21.15.31:0/389994992 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd07fff640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd0814d800 0x7efd08141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 -- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf0003970 msgr2=0x7efd0813f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd077fe640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf0003970 0x7efd0813f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf0003970 0x7efd0813f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 -- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd0814d800 msgr2=0x7efd08141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd0814d800 0x7efd08141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 -- 172.21.15.31:0/389994992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0813fb80 con 0x7efd0814d380 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd07fff640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd0814d800 0x7efd08141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.864+0000 7efd06ffd640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0814d380 0x7efd080bf430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efcfc011510 tx=0x7efcfc0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.865+0000 7efceffff640 1 -- 172.21.15.31:0/389994992 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc015870 con 0x7efd0814d380 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.865+0000 7efceffff640 1 -- 172.21.15.31:0/389994992 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc0159d0 con 0x7efd0814d380 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.865+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd081e0060 con 0x7efd0814d380 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.865+0000 7efceffff640 1 -- 172.21.15.31:0/389994992 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc015d80 con 0x7efd0814d380 2023-12-22T08:40:39.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.865+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd081e0620 con 0x7efd0814d380 2023-12-22T08:40:39.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.866+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08073a40 con 0x7efd0814d380 2023-12-22T08:40:39.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.866+0000 7efceffff640 1 -- 172.21.15.31:0/389994992 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efcfc01d400 con 0x7efd0814d380 2023-12-22T08:40:39.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.866+0000 7efceffff640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efcf406a430 0x7efcf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:39.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.866+0000 7efceffff640 1 -- 172.21.15.31:0/389994992 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efcfc088d00 con 0x7efd0814d380 2023-12-22T08:40:39.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.867+0000 7efd077fe640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efcf406a430 0x7efcf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:39.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.867+0000 7efd077fe640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efcf406a430 0x7efcf406c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efcf8034000 tx=0x7efcf8009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:39.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:39.871+0000 7efceffff640 1 -- 172.21.15.31:0/389994992 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efcfc054640 con 0x7efd0814d380 2023-12-22T08:40:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.048+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd08142eb0 con 0x7efd0814d380 2023-12-22T08:40:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.048+0000 7efceffff640 1 -- 172.21.15.31:0/389994992 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcfc057c60 con 0x7efd0814d380 2023-12-22T08:40:40.051 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:40:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efcf406a430 msgr2=0x7efcf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efcf406a430 0x7efcf406c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efcf8034000 tx=0x7efcf8009030 comp rx=0 tx=0).stop 2023-12-22T08:40:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0814d380 msgr2=0x7efd080bf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0814d380 0x7efd080bf430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efcfc011510 tx=0x7efcfc0119d0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 shutdown_connections 2023-12-22T08:40:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efcf406a430 0x7efcf406c8f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd0814d800 0x7efd08141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd0814d380 0x7efd080bf430 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 --2- 172.21.15.31:0/389994992 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcf0003970 0x7efd0813f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 >> 172.21.15.31:0/389994992 conn(0x7efd0806b6a0 msgr2=0x7efd08142290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 shutdown_connections 2023-12-22T08:40:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.050+0000 7efd0df84640 1 -- 172.21.15.31:0/389994992 wait complete. 2023-12-22T08:40:40.063 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:40.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.166+0000 7f7de1300640 1 Processor -- start 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.166+0000 7f7de1300640 1 -- start start 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.166+0000 7f7de1300640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7ddc1544e0 0x7f7ddc1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.166+0000 7f7de1300640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc0bb310 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.166+0000 7f7de1300640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc0bf960 con 0x7f7ddc0ba550 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.166+0000 7f7de1300640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc0bb5b0 con 0x7f7ddc1544e0 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7ddaffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7ddc06a6d0 0x7f7ddc14acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58964/0 (socket says 172.21.15.31:58964) 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7ddaffd640 1 -- 172.21.15.31:0/4081829847 learned_addr learned my addr 172.21.15.31:0/4081829847 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7ddb7fe640 1 --2- 172.21.15.31:0/4081829847 >> v2:172.21.15.69:3300/0 conn(0x7f7ddc1544e0 0x7f7ddc1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7dda7fc640 1 -- 172.21.15.31:0/4081829847 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804001757 0 0) 0x7f7ddc0bb310 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7dda7fc640 1 -- 172.21.15.31:0/4081829847 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dbc003520 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7dda7fc640 1 -- 172.21.15.31:0/4081829847 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560746623 0 0) 0x7f7ddc0bf960 con 0x7f7ddc0ba550 2023-12-22T08:40:40.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7dda7fc640 1 -- 172.21.15.31:0/4081829847 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ddc0bb310 con 0x7f7ddc0ba550 2023-12-22T08:40:40.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7ddb7fe640 1 -- 172.21.15.31:0/4081829847 >> v1:172.21.15.69:6789/0 conn(0x7f7ddc0ba550 legacy=0x7f7ddc0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7ddb7fe640 1 -- 172.21.15.31:0/4081829847 >> v1:172.21.15.31:6789/0 conn(0x7f7ddc06a6d0 legacy=0x7f7ddc14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.167+0000 7f7ddb7fe640 1 -- 172.21.15.31:0/4081829847 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0c0120 con 0x7f7ddc1544e0 2023-12-22T08:40:40.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.168+0000 7f7ddb7fe640 1 --2- 172.21.15.31:0/4081829847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 0x7f7ddc1568d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009d90 tx=0x7f7dd402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8cc8e82f810f534 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.168+0000 7f7dda7fc640 1 -- 172.21.15.31:0/4081829847 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd402cd00 con 0x7f7ddc1544e0 2023-12-22T08:40:40.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.168+0000 7f7dda7fc640 1 -- 172.21.15.31:0/4081829847 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd402ce60 con 0x7f7ddc1544e0 2023-12-22T08:40:40.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.168+0000 7f7dda7fc640 1 -- 172.21.15.31:0/4081829847 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4034640 con 0x7f7ddc1544e0 2023-12-22T08:40:40.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.169+0000 7f7de1300640 1 -- 172.21.15.31:0/4081829847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 msgr2=0x7f7ddc1568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.169+0000 7f7de1300640 1 --2- 172.21.15.31:0/4081829847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 0x7f7ddc1568d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009d90 tx=0x7f7dd402bf50 comp rx=0 tx=0).stop 2023-12-22T08:40:40.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.169+0000 7f7de1300640 1 -- 172.21.15.31:0/4081829847 shutdown_connections 2023-12-22T08:40:40.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.169+0000 7f7de1300640 1 --2- 172.21.15.31:0/4081829847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 0x7f7ddc1568d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.169+0000 7f7de1300640 1 -- 172.21.15.31:0/4081829847 >> 172.21.15.31:0/4081829847 conn(0x7f7ddc0c0350 msgr2=0x7f7ddc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:40.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.169+0000 7f7de1300640 1 -- 172.21.15.31:0/4081829847 shutdown_connections 2023-12-22T08:40:40.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.169+0000 7f7de1300640 1 -- 172.21.15.31:0/4081829847 wait complete. 2023-12-22T08:40:40.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7de1300640 1 Processor -- start 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7de1300640 1 -- start start 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7de1300640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ddc06a6d0 0x7f7ddc147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7de1300640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ddc0ba550 0x7f7ddc1480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7de1300640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 0x7f7ddc149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7de1300640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1485e0 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7de1300640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0b8780 con 0x7f7ddc1544e0 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7de1300640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1468c0 con 0x7f7ddc0ba550 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7ddaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ddc06a6d0 0x7f7ddc147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7ddaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ddc06a6d0 0x7f7ddc147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52890/0 (socket says 172.21.15.31:52890) 2023-12-22T08:40:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.170+0000 7f7ddaffd640 1 -- 172.21.15.31:0/1380607807 learned_addr learned my addr 172.21.15.31:0/1380607807 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7dd27fc640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ddc0ba550 0x7f7ddc1480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7ddb7fe640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 0x7f7ddc149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7ddaffd640 1 -- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ddc0ba550 msgr2=0x7f7ddc1480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7ddaffd640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ddc0ba550 0x7f7ddc1480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7ddaffd640 1 -- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 msgr2=0x7f7ddc149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7ddaffd640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 0x7f7ddc149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7ddaffd640 1 -- 172.21.15.31:0/1380607807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4009a70 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7ddb7fe640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 0x7f7ddc149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7dd27fc640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ddc0ba550 0x7f7ddc1480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7ddaffd640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ddc06a6d0 0x7f7ddc147680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c500 tx=0x7f7dc400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7dd3fff640 1 -- 172.21.15.31:0/1380607807 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4005ce0 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7dd3fff640 1 -- 172.21.15.31:0/1380607807 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc4005e40 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc146ba0 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7dd3fff640 1 -- 172.21.15.31:0/1380607807 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40072f0 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.171+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc146f30 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.172+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc147370 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.173+0000 7f7dd3fff640 1 -- 172.21.15.31:0/1380607807 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7dc4007450 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.173+0000 7f7dd3fff640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7dc006a430 0x7f7dc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.173+0000 7f7dd3fff640 1 -- 172.21.15.31:0/1380607807 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7dc4087a60 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.173+0000 7f7dd27fc640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7dc006a430 0x7f7dc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.174+0000 7f7dd27fc640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7dc006a430 0x7f7dc006c8f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0b3800 tx=0x7f7dcc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.177+0000 7f7dd3fff640 1 -- 172.21.15.31:0/1380607807 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7dc4056f70 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.390+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ddc14b390 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.390+0000 7f7dd3fff640 1 -- 172.21.15.31:0/1380607807 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f7dc4017500 con 0x7f7ddc06a6d0 2023-12-22T08:40:40.393 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:40.393 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-22T08:40:40.394 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7dc006a430 msgr2=0x7f7dc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7dc006a430 0x7f7dc006c8f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0b3800 tx=0x7f7dcc009040 comp rx=0 tx=0).stop 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ddc06a6d0 msgr2=0x7f7ddc147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ddc06a6d0 0x7f7ddc147680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c500 tx=0x7f7dc400c9c0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 shutdown_connections 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7dc006a430 0x7f7dc006c8f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ddc1544e0 0x7f7ddc149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ddc0ba550 0x7f7ddc1480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 --2- 172.21.15.31:0/1380607807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ddc06a6d0 0x7f7ddc147680 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 >> 172.21.15.31:0/1380607807 conn(0x7f7ddc0c0350 msgr2=0x7f7ddc0a1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 shutdown_connections 2023-12-22T08:40:40.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:40.392+0000 7f7de1300640 1 -- 172.21.15.31:0/1380607807 wait complete. 2023-12-22T08:40:42.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:42.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.521+0000 7ff54a91b640 1 Processor -- start 2023-12-22T08:40:42.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.521+0000 7ff54a91b640 1 -- start start 2023-12-22T08:40:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff54a91b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5440ba550 0x7ff5440b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff54a91b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff5440ba000 0x7ff5441554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff54a91b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5440bb310 con 0x7ff54406a6d0 2023-12-22T08:40:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff54a91b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5440bf960 con 0x7ff5440ba000 2023-12-22T08:40:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff54a91b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440bb5b0 con 0x7ff5440ba550 2023-12-22T08:40:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff543fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff54406a6d0 0x7ff54414acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58980/0 (socket says 172.21.15.31:58980) 2023-12-22T08:40:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff548eb8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff5440ba000 0x7ff5441554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff543fff640 1 -- 172.21.15.31:0/2744231689 learned_addr learned my addr 172.21.15.31:0/2744231689 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff5437fe640 1 --2- 172.21.15.31:0/2744231689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5440ba550 0x7ff5440b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff548eb8640 1 -- 172.21.15.31:0/2744231689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5440ba550 msgr2=0x7ff5440b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff548eb8640 1 --2- 172.21.15.31:0/2744231689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5440ba550 0x7ff5440b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff548eb8640 1 -- 172.21.15.31:0/2744231689 >> v1:172.21.15.31:6789/0 conn(0x7ff54406a6d0 legacy=0x7ff54414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff548eb8640 1 -- 172.21.15.31:0/2744231689 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440c0120 con 0x7ff5440ba000 2023-12-22T08:40:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.522+0000 7ff5437fe640 1 --2- 172.21.15.31:0/2744231689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5440ba550 0x7ff5440b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.523+0000 7ff548eb8640 1 --2- 172.21.15.31:0/2744231689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba000 0x7ff5441554e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009d90 tx=0x7ff53c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c7750e6a90a1be server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.523+0000 7ff542ffd640 1 -- 172.21.15.31:0/2744231689 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c02cc50 con 0x7ff5440ba000 2023-12-22T08:40:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.523+0000 7ff542ffd640 1 -- 172.21.15.31:0/2744231689 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c02cdb0 con 0x7ff5440ba000 2023-12-22T08:40:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.523+0000 7ff542ffd640 1 -- 172.21.15.31:0/2744231689 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c034660 con 0x7ff5440ba000 2023-12-22T08:40:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.524+0000 7ff54a91b640 1 -- 172.21.15.31:0/2744231689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba000 msgr2=0x7ff5441554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.524+0000 7ff54a91b640 1 --2- 172.21.15.31:0/2744231689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba000 0x7ff5441554e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009d90 tx=0x7ff53c02bea0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.524+0000 7ff54a91b640 1 -- 172.21.15.31:0/2744231689 shutdown_connections 2023-12-22T08:40:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.524+0000 7ff54a91b640 1 --2- 172.21.15.31:0/2744231689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba000 0x7ff5441554e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.524+0000 7ff54a91b640 1 --2- 172.21.15.31:0/2744231689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5440ba550 0x7ff5440b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.524+0000 7ff54a91b640 1 -- 172.21.15.31:0/2744231689 >> 172.21.15.31:0/2744231689 conn(0x7ff5440c0350 msgr2=0x7ff5440c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.524+0000 7ff54a91b640 1 -- 172.21.15.31:0/2744231689 shutdown_connections 2023-12-22T08:40:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.524+0000 7ff54a91b640 1 -- 172.21.15.31:0/2744231689 wait complete. 2023-12-22T08:40:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.525+0000 7ff54a91b640 1 Processor -- start 2023-12-22T08:40:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.525+0000 7ff54a91b640 1 -- start start 2023-12-22T08:40:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff54a91b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff54406a6d0 0x7ff5441d5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff54a91b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5440ba000 0x7ff5441d41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff54a91b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba550 0x7ff5441493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff54a91b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440beca0 con 0x7ff5440ba550 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff54a91b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5441d5a20 con 0x7ff5440ba000 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff54a91b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440b59b0 con 0x7ff54406a6d0 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff548eb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba550 0x7ff5441493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff548eb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba550 0x7ff5441493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52910/0 (socket says 172.21.15.31:52910) 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff548eb8640 1 -- 172.21.15.31:0/3124545913 learned_addr learned my addr 172.21.15.31:0/3124545913 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff543fff640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff54406a6d0 0x7ff5441d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.526+0000 7ff5437fe640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5440ba000 0x7ff5441d41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff548eb8640 1 -- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff54406a6d0 msgr2=0x7ff5441d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff548eb8640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff54406a6d0 0x7ff5441d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff548eb8640 1 -- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5440ba000 msgr2=0x7ff5441d41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff548eb8640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5440ba000 0x7ff5441d41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff548eb8640 1 -- 172.21.15.31:0/3124545913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c009a70 con 0x7ff5440ba550 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff5437fe640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5440ba000 0x7ff5441d41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff548eb8640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba550 0x7ff5441493a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009d90 tx=0x7ff53c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff540ff9640 1 -- 172.21.15.31:0/3124545913 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c040650 con 0x7ff5440ba550 2023-12-22T08:40:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff540ff9640 1 -- 172.21.15.31:0/3124545913 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c0407d0 con 0x7ff5440ba550 2023-12-22T08:40:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5440b5c90 con 0x7ff5440ba550 2023-12-22T08:40:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff540ff9640 1 -- 172.21.15.31:0/3124545913 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c040b80 con 0x7ff5440ba550 2023-12-22T08:40:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.527+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5440b3860 con 0x7ff5440ba550 2023-12-22T08:40:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.528+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5440a5990 con 0x7ff5440ba550 2023-12-22T08:40:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.529+0000 7ff540ff9640 1 -- 172.21.15.31:0/3124545913 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff53c040ce0 con 0x7ff5440ba550 2023-12-22T08:40:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.529+0000 7ff540ff9640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff52406a430 0x7ff52406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.529+0000 7ff540ff9640 1 -- 172.21.15.31:0/3124545913 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff53c0ab3a0 con 0x7ff5440ba550 2023-12-22T08:40:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.529+0000 7ff543fff640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff52406a430 0x7ff52406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.530+0000 7ff543fff640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff52406a430 0x7ff52406c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff52c005880 tx=0x7ff52c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.533+0000 7ff540ff9640 1 -- 172.21.15.31:0/3124545913 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff53c076cc0 con 0x7ff5440ba550 2023-12-22T08:40:42.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.743+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5440b6150 con 0x7ff5440ba550 2023-12-22T08:40:42.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.743+0000 7ff540ff9640 1 -- 172.21.15.31:0/3124545913 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2765 (secure 0 0 0) 0x7ff53c07a2e0 con 0x7ff5440ba550 2023-12-22T08:40:42.746 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:42.746 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-22T08:40:42.747 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff52406a430 msgr2=0x7ff52406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff52406a430 0x7ff52406c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff52c005880 tx=0x7ff52c009040 comp rx=0 tx=0).stop 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba550 msgr2=0x7ff5441493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba550 0x7ff5441493a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009d90 tx=0x7ff53c004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 shutdown_connections 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff52406a430 0x7ff52406c8f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5440ba550 0x7ff5441493a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5440ba000 0x7ff5441d41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 --2- 172.21.15.31:0/3124545913 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff54406a6d0 0x7ff5441d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 >> 172.21.15.31:0/3124545913 conn(0x7ff5440c0350 msgr2=0x7ff5440be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:42.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 shutdown_connections 2023-12-22T08:40:42.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.745+0000 7ff54a91b640 1 -- 172.21.15.31:0/3124545913 wait complete. 2023-12-22T08:40:42.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:42.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.862+0000 7f7e40f77640 1 Processor -- start 2023-12-22T08:40:42.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.862+0000 7f7e40f77640 1 -- start start 2023-12-22T08:40:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.862+0000 7f7e40f77640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 0x7f7e3c14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.862+0000 7f7e40f77640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e3c14b1f0 0x7f7e3c0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.862+0000 7f7e40f77640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c0bb310 con 0x7f7e3c0ba550 2023-12-22T08:40:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.862+0000 7f7e40f77640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c0bf960 con 0x7f7e3c14b1f0 2023-12-22T08:40:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.862+0000 7f7e40f77640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0bb5b0 con 0x7f7e3c06a6d0 2023-12-22T08:40:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.862+0000 7f7e33fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e3c14b1f0 0x7f7e3c0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.863+0000 7f7e33fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e3c14b1f0 0x7f7e3c0b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52914/0 (socket says 172.21.15.31:52914) 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.863+0000 7f7e33fff640 1 -- 172.21.15.31:0/2767214856 learned_addr learned my addr 172.21.15.31:0/2767214856 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.863+0000 7f7e3a59c640 1 --2- 172.21.15.31:0/2767214856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 0x7f7e3c14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.863+0000 7f7e33fff640 1 -- 172.21.15.31:0/2767214856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 msgr2=0x7f7e3c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.863+0000 7f7e33fff640 1 --2- 172.21.15.31:0/2767214856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 0x7f7e3c14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.863+0000 7f7e33fff640 1 -- 172.21.15.31:0/2767214856 >> v1:172.21.15.69:6789/0 conn(0x7f7e3c0ba550 legacy=0x7f7e3c14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.863+0000 7f7e33fff640 1 -- 172.21.15.31:0/2767214856 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0c0120 con 0x7f7e3c14b1f0 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e33fff640 1 --2- 172.21.15.31:0/2767214856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c14b1f0 0x7f7e3c0b9ac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009870 tx=0x7f7e2402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639f1f4db9056355 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e39d9b640 1 -- 172.21.15.31:0/2767214856 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24030840 con 0x7f7e3c14b1f0 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e39d9b640 1 -- 172.21.15.31:0/2767214856 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e240309a0 con 0x7f7e3c14b1f0 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e39d9b640 1 -- 172.21.15.31:0/2767214856 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24030d30 con 0x7f7e3c14b1f0 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e40f77640 1 -- 172.21.15.31:0/2767214856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c14b1f0 msgr2=0x7f7e3c0b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e40f77640 1 --2- 172.21.15.31:0/2767214856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c14b1f0 0x7f7e3c0b9ac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009870 tx=0x7f7e2402b980 comp rx=0 tx=0).stop 2023-12-22T08:40:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e40f77640 1 -- 172.21.15.31:0/2767214856 shutdown_connections 2023-12-22T08:40:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e40f77640 1 --2- 172.21.15.31:0/2767214856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c14b1f0 0x7f7e3c0b9ac0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e40f77640 1 --2- 172.21.15.31:0/2767214856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 0x7f7e3c14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e40f77640 1 -- 172.21.15.31:0/2767214856 >> 172.21.15.31:0/2767214856 conn(0x7f7e3c0c0350 msgr2=0x7f7e3c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e40f77640 1 -- 172.21.15.31:0/2767214856 shutdown_connections 2023-12-22T08:40:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.864+0000 7f7e40f77640 1 -- 172.21.15.31:0/2767214856 wait complete. 2023-12-22T08:40:42.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e40f77640 1 Processor -- start 2023-12-22T08:40:42.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e40f77640 1 -- start start 2023-12-22T08:40:42.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e40f77640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 0x7f7e3c14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e40f77640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c0ba550 0x7f7e3c1dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e40f77640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c14b1f0 0x7f7e3c09e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e40f77640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c14ebd0 con 0x7f7e3c0ba550 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e40f77640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c1e42c0 con 0x7f7e3c14b1f0 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e40f77640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c1e3500 con 0x7f7e3c06a6d0 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e33fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c0ba550 0x7f7e3c1dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e33fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c0ba550 0x7f7e3c1dfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52930/0 (socket says 172.21.15.31:52930) 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e33fff640 1 -- 172.21.15.31:0/1778849163 learned_addr learned my addr 172.21.15.31:0/1778849163 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e3ad9d640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c14b1f0 0x7f7e3c09e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.866+0000 7f7e3a59c640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 0x7f7e3c14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e33fff640 1 -- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 msgr2=0x7f7e3c14e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e33fff640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 0x7f7e3c14e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e33fff640 1 -- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c14b1f0 msgr2=0x7f7e3c09e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e33fff640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c14b1f0 0x7f7e3c09e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:42.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e33fff640 1 -- 172.21.15.31:0/1778849163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e240094d0 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e33fff640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c0ba550 0x7f7e3c1dfe10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000c00 tx=0x7f7e24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e32ffd640 1 -- 172.21.15.31:0/1778849163 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24039a90 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e32ffd640 1 -- 172.21.15.31:0/1778849163 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e24039bf0 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c1e37e0 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e32ffd640 1 -- 172.21.15.31:0/1778849163 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24043410 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.867+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c1e3da0 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.868+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c073a40 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.869+0000 7f7e32ffd640 1 -- 172.21.15.31:0/1778849163 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e2402f390 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.869+0000 7f7e32ffd640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e1c06a430 0x7f7e1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.869+0000 7f7e32ffd640 1 -- 172.21.15.31:0/1778849163 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e240aa6e0 con 0x7f7e3c0ba550 2023-12-22T08:40:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.869+0000 7f7e3a59c640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e1c06a430 0x7f7e1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.870+0000 7f7e3a59c640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e1c06a430 0x7f7e1c06c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c006fd0 tx=0x7f7e2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:42.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:42.873+0000 7f7e32ffd640 1 -- 172.21.15.31:0/1778849163 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e240760d0 con 0x7f7e3c0ba550 2023-12-22T08:40:43.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.049+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e3c06b0d0 con 0x7f7e3c0ba550 2023-12-22T08:40:43.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.050+0000 7f7e32ffd640 1 -- 172.21.15.31:0/1778849163 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f7e240796f0 con 0x7f7e3c0ba550 2023-12-22T08:40:43.052 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:43.052 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:35.859706+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:43.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e1c06a430 msgr2=0x7f7e1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e1c06a430 0x7f7e1c06c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c006fd0 tx=0x7f7e2c008040 comp rx=0 tx=0).stop 2023-12-22T08:40:43.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c0ba550 msgr2=0x7f7e3c1dfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c0ba550 0x7f7e3c1dfe10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000c00 tx=0x7f7e24004730 comp rx=0 tx=0).stop 2023-12-22T08:40:43.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 shutdown_connections 2023-12-22T08:40:43.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e1c06a430 0x7f7e1c06c8f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c14b1f0 0x7f7e3c09e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c0ba550 0x7f7e3c1dfe10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 --2- 172.21.15.31:0/1778849163 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e3c06a6d0 0x7f7e3c14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.051+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 >> 172.21.15.31:0/1778849163 conn(0x7f7e3c0c0350 msgr2=0x7f7e3c0be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.052+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 shutdown_connections 2023-12-22T08:40:43.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.052+0000 7f7e40f77640 1 -- 172.21.15.31:0/1778849163 wait complete. 2023-12-22T08:40:43.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:43.065 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.171+0000 7fb1fa4b6640 1 Processor -- start 2023-12-22T08:40:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.171+0000 7fb1fa4b6640 1 -- start start 2023-12-22T08:40:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.171+0000 7fb1fa4b6640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b8690 0x7fb1f40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.171+0000 7fb1fa4b6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1f40b77d0 0x7fb1f4144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.171+0000 7fb1fa4b6640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f414ab10 con 0x7fb1f4144bb0 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.171+0000 7fb1fa4b6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f406c2f0 con 0x7fb1f40b77d0 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.171+0000 7fb1fa4b6640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40ba620 con 0x7fb1f40b8690 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.172+0000 7fb1f37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1f40b77d0 0x7fb1f4144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.172+0000 7fb1f37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1f40b77d0 0x7fb1f4144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52940/0 (socket says 172.21.15.31:52940) 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.172+0000 7fb1f37fe640 1 -- 172.21.15.31:0/3434267517 learned_addr learned my addr 172.21.15.31:0/3434267517 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.172+0000 7fb1f3fff640 1 --2- 172.21.15.31:0/3434267517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b8690 0x7fb1f40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.172+0000 7fb1f37fe640 1 -- 172.21.15.31:0/3434267517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b8690 msgr2=0x7fb1f40b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.172+0000 7fb1f37fe640 1 --2- 172.21.15.31:0/3434267517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b8690 0x7fb1f40b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.172+0000 7fb1f37fe640 1 -- 172.21.15.31:0/3434267517 >> v1:172.21.15.69:6789/0 conn(0x7fb1f4144bb0 legacy=0x7fb1f414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.172+0000 7fb1f37fe640 1 -- 172.21.15.31:0/3434267517 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40b9e60 con 0x7fb1f40b77d0 2023-12-22T08:40:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1f37fe640 1 --2- 172.21.15.31:0/3434267517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b77d0 0x7fb1f4144670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009870 tx=0x7fb1e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a4ca77013ec7cb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1f2ffd640 1 -- 172.21.15.31:0/3434267517 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8031640 con 0x7fb1f40b77d0 2023-12-22T08:40:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1f2ffd640 1 -- 172.21.15.31:0/3434267517 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e80317a0 con 0x7fb1f40b77d0 2023-12-22T08:40:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1f2ffd640 1 -- 172.21.15.31:0/3434267517 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8031b30 con 0x7fb1f40b77d0 2023-12-22T08:40:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/3434267517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b77d0 msgr2=0x7fb1f4144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/3434267517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b77d0 0x7fb1f4144670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009870 tx=0x7fb1e802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/3434267517 shutdown_connections 2023-12-22T08:40:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/3434267517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b77d0 0x7fb1f4144670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/3434267517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b8690 0x7fb1f40b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/3434267517 >> 172.21.15.31:0/3434267517 conn(0x7fb1f406b6a0 msgr2=0x7fb1f406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/3434267517 shutdown_connections 2023-12-22T08:40:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.173+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/3434267517 wait complete. 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.174+0000 7fb1fa4b6640 1 Processor -- start 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1fa4b6640 1 -- start start 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1fa4b6640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b77d0 0x7fb1f4146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1fa4b6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b8690 0x7fb1f4149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1fa4b6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f4144bb0 0x7fb1f41457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1fa4b6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4149a00 con 0x7fb1f40b8690 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1fa4b6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4149ce0 con 0x7fb1f4144bb0 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1fa4b6640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4149fc0 con 0x7fb1f40b77d0 2023-12-22T08:40:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1f37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b8690 0x7fb1f4149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1f37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b8690 0x7fb1f4149150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52944/0 (socket says 172.21.15.31:52944) 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1f37fe640 1 -- 172.21.15.31:0/901740816 learned_addr learned my addr 172.21.15.31:0/901740816 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1f3fff640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b77d0 0x7fb1f4146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.175+0000 7fb1f8a53640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f4144bb0 0x7fb1f41457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f37fe640 1 -- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b77d0 msgr2=0x7fb1f4146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f37fe640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b77d0 0x7fb1f4146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f37fe640 1 -- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f4144bb0 msgr2=0x7fb1f41457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f37fe640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f4144bb0 0x7fb1f41457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f37fe640 1 -- 172.21.15.31:0/901740816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80094d0 con 0x7fb1f40b8690 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f37fe640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b8690 0x7fb1f4149150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8000c00 tx=0x7fb1e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f0ff9640 1 -- 172.21.15.31:0/901740816 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e803a930 con 0x7fb1f40b8690 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f0ff9640 1 -- 172.21.15.31:0/901740816 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e803aa90 con 0x7fb1f40b8690 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1f0ff9640 1 -- 172.21.15.31:0/901740816 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e803ae40 con 0x7fb1f40b8690 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f414a2a0 con 0x7fb1f40b8690 2023-12-22T08:40:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.176+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f413e4b0 con 0x7fb1f40b8690 2023-12-22T08:40:43.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.177+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f4073a40 con 0x7fb1f40b8690 2023-12-22T08:40:43.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.177+0000 7fb1f0ff9640 1 -- 172.21.15.31:0/901740816 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb1e802f050 con 0x7fb1f40b8690 2023-12-22T08:40:43.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.178+0000 7fb1f0ff9640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb1e006a460 0x7fb1e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.178+0000 7fb1f0ff9640 1 -- 172.21.15.31:0/901740816 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb1e80aa1d0 con 0x7fb1f40b8690 2023-12-22T08:40:43.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.178+0000 7fb1f3fff640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb1e006a460 0x7fb1e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.178+0000 7fb1f3fff640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb1e006a460 0x7fb1e006c920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009b40 tx=0x7fb1e4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.182+0000 7fb1f0ff9640 1 -- 172.21.15.31:0/901740816 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb1e8075c50 con 0x7fb1f40b8690 2023-12-22T08:40:43.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.357+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1f4069e70 con 0x7fb1f40b8690 2023-12-22T08:40:43.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.357+0000 7fb1f0ff9640 1 -- 172.21.15.31:0/901740816 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1e8079270 con 0x7fb1f40b8690 2023-12-22T08:40:43.360 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:40:43.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb1e006a460 msgr2=0x7fb1e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb1e006a460 0x7fb1e006c920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009b40 tx=0x7fb1e4009190 comp rx=0 tx=0).stop 2023-12-22T08:40:43.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b8690 msgr2=0x7fb1f4149150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b8690 0x7fb1f4149150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8000c00 tx=0x7fb1e80046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 shutdown_connections 2023-12-22T08:40:43.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb1e006a460 0x7fb1e006c920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f4144bb0 0x7fb1f41457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f40b8690 0x7fb1f4149150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 --2- 172.21.15.31:0/901740816 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1f40b77d0 0x7fb1f4146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 >> 172.21.15.31:0/901740816 conn(0x7fb1f406b6a0 msgr2=0x7fb1f40bb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 shutdown_connections 2023-12-22T08:40:43.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.359+0000 7fb1fa4b6640 1 -- 172.21.15.31:0/901740816 wait complete. 2023-12-22T08:40:43.372 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:40:43.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.475+0000 7fb848300640 1 Processor -- start 2023-12-22T08:40:43.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.475+0000 7fb848300640 1 -- start start 2023-12-22T08:40:43.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb848300640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400b8340 0x7fb84014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb848300640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb8400bacf0 0x7fb8400ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb848300640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb840140f40 0x7fb8401413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb848300640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb840141910 con 0x7fb840140f40 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb848300640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84014af40 con 0x7fb8400bacf0 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb848300640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400b7ee0 con 0x7fb8400b8340 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb84689d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb840140f40 0x7fb8401413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb84689d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb840140f40 0x7fb8401413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52960/0 (socket says 172.21.15.31:52960) 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.476+0000 7fb84689d640 1 -- 172.21.15.31:0/2077199928 learned_addr learned my addr 172.21.15.31:0/2077199928 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84609c640 1 --2- 172.21.15.31:0/2077199928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400b8340 0x7fb84014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84589b640 1 --2- 172.21.15.31:0/2077199928 >> v2:172.21.15.69:3300/0 conn(0x7fb8400bacf0 0x7fb8400ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84689d640 1 -- 172.21.15.31:0/2077199928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400b8340 msgr2=0x7fb84014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84689d640 1 --2- 172.21.15.31:0/2077199928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400b8340 0x7fb84014b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84689d640 1 -- 172.21.15.31:0/2077199928 >> v2:172.21.15.69:3300/0 conn(0x7fb8400bacf0 msgr2=0x7fb8400ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84689d640 1 --2- 172.21.15.31:0/2077199928 >> v2:172.21.15.69:3300/0 conn(0x7fb8400bacf0 0x7fb8400ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84689d640 1 -- 172.21.15.31:0/2077199928 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8401450a0 con 0x7fb840140f40 2023-12-22T08:40:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84589b640 1 --2- 172.21.15.31:0/2077199928 >> v2:172.21.15.69:3300/0 conn(0x7fb8400bacf0 0x7fb8400ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84689d640 1 --2- 172.21.15.31:0/2077199928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb8401413d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb84006c6f0 tx=0x7fb83802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917b94604aa8a62b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84509a640 1 -- 172.21.15.31:0/2077199928 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83802cb00 con 0x7fb840140f40 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84509a640 1 -- 172.21.15.31:0/2077199928 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83802cc60 con 0x7fb840140f40 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.477+0000 7fb84509a640 1 -- 172.21.15.31:0/2077199928 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380343f0 con 0x7fb840140f40 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 -- 172.21.15.31:0/2077199928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 msgr2=0x7fb8401413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 --2- 172.21.15.31:0/2077199928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb8401413d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb84006c6f0 tx=0x7fb83802bf60 comp rx=0 tx=0).stop 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 -- 172.21.15.31:0/2077199928 shutdown_connections 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 --2- 172.21.15.31:0/2077199928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb8401413d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 --2- 172.21.15.31:0/2077199928 >> v2:172.21.15.69:3300/0 conn(0x7fb8400bacf0 0x7fb8400ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 --2- 172.21.15.31:0/2077199928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400b8340 0x7fb84014b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 -- 172.21.15.31:0/2077199928 >> 172.21.15.31:0/2077199928 conn(0x7fb8400c0370 msgr2=0x7fb8400c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 -- 172.21.15.31:0/2077199928 shutdown_connections 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.478+0000 7fb848300640 1 -- 172.21.15.31:0/2077199928 wait complete. 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.479+0000 7fb848300640 1 Processor -- start 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.479+0000 7fb848300640 1 -- start start 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb848300640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8400b8340 0x7fb84014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb848300640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400bacf0 0x7fb8401e2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb848300640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb840139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb848300640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84014cd10 con 0x7fb840140f40 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb848300640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84014dfc0 con 0x7fb8400b8340 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb848300640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8401e3190 con 0x7fb8400bacf0 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84689d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb840139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84689d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb840139180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52976/0 (socket says 172.21.15.31:52976) 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84689d640 1 -- 172.21.15.31:0/714848352 learned_addr learned my addr 172.21.15.31:0/714848352 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84609c640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8400b8340 0x7fb84014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84589b640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400bacf0 0x7fb8401e2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84689d640 1 -- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400bacf0 msgr2=0x7fb8401e2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84689d640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400bacf0 0x7fb8401e2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84689d640 1 -- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8400b8340 msgr2=0x7fb84014bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84689d640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8400b8340 0x7fb84014bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.480+0000 7fb84689d640 1 -- 172.21.15.31:0/714848352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009b30 con 0x7fb840140f40 2023-12-22T08:40:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.481+0000 7fb84689d640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb840139180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb838036040 tx=0x7fb838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.482+0000 7fb836ffd640 1 -- 172.21.15.31:0/714848352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838009510 con 0x7fb840140f40 2023-12-22T08:40:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.482+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84014c290 con 0x7fb840140f40 2023-12-22T08:40:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.482+0000 7fb836ffd640 1 -- 172.21.15.31:0/714848352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83803e450 con 0x7fb840140f40 2023-12-22T08:40:43.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.482+0000 7fb836ffd640 1 -- 172.21.15.31:0/714848352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83803e800 con 0x7fb840140f40 2023-12-22T08:40:43.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.482+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84014c570 con 0x7fb840140f40 2023-12-22T08:40:43.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.483+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8400b9620 con 0x7fb840140f40 2023-12-22T08:40:43.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.483+0000 7fb836ffd640 1 -- 172.21.15.31:0/714848352 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb83803e960 con 0x7fb840140f40 2023-12-22T08:40:43.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.484+0000 7fb836ffd640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb82406a430 0x7fb82406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.484+0000 7fb836ffd640 1 -- 172.21.15.31:0/714848352 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb8380ab280 con 0x7fb840140f40 2023-12-22T08:40:43.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.484+0000 7fb84609c640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb82406a430 0x7fb82406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.485+0000 7fb84609c640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb82406a430 0x7fb82406c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb83c003610 tx=0x7fb83c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.488+0000 7fb836ffd640 1 -- 172.21.15.31:0/714848352 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb838076c80 con 0x7fb840140f40 2023-12-22T08:40:43.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.665+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb84014dab0 con 0x7fb840140f40 2023-12-22T08:40:43.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.666+0000 7fb836ffd640 1 -- 172.21.15.31:0/714848352 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb84014dab0 con 0x7fb840140f40 2023-12-22T08:40:43.668 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:43.668 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-12-22T08:40:43.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:40:43.669 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-12-22T08:40:43.669 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-12-22T08:40:43.669 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:40:43.669 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-12-22T08:40:43.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.667+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb82406a430 msgr2=0x7fb82406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.667+0000 7fb848300640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb82406a430 0x7fb82406c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb83c003610 tx=0x7fb83c008040 comp rx=0 tx=0).stop 2023-12-22T08:40:43.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.667+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 msgr2=0x7fb840139180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.667+0000 7fb848300640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb840139180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb838036040 tx=0x7fb838004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:43.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.668+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 shutdown_connections 2023-12-22T08:40:43.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.668+0000 7fb848300640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb82406a430 0x7fb82406c8f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.668+0000 7fb848300640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb840140f40 0x7fb840139180 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.668+0000 7fb848300640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8400bacf0 0x7fb8401e2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.668+0000 7fb848300640 1 --2- 172.21.15.31:0/714848352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8400b8340 0x7fb84014bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.668+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 >> 172.21.15.31:0/714848352 conn(0x7fb8400c0370 msgr2=0x7fb8400bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.668+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 shutdown_connections 2023-12-22T08:40:43.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.668+0000 7fb848300640 1 -- 172.21.15.31:0/714848352 wait complete. 2023-12-22T08:40:43.680 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:40:43.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:40:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.788+0000 7f939eb27640 1 Processor -- start 2023-12-22T08:40:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.788+0000 7f939eb27640 1 -- start start 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939eb27640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b81f0 0x7f939814e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939eb27640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93980b77c0 0x7f939814e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939eb27640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93980b6f30 con 0x7f9398144ff0 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939eb27640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93980b96a0 con 0x7f93980b77c0 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939eb27640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93980bc740 con 0x7f93980b81f0 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939d0c4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93980b77c0 0x7f939814e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939d0c4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93980b77c0 0x7f939814e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52990/0 (socket says 172.21.15.31:52990) 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939d0c4640 1 -- 172.21.15.31:0/2199962789 learned_addr learned my addr 172.21.15.31:0/2199962789 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f9397fff640 1 --2- 172.21.15.31:0/2199962789 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b81f0 0x7f939814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939d0c4640 1 -- 172.21.15.31:0/2199962789 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b81f0 msgr2=0x7f939814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939d0c4640 1 --2- 172.21.15.31:0/2199962789 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b81f0 0x7f939814e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939d0c4640 1 -- 172.21.15.31:0/2199962789 >> v1:172.21.15.69:6789/0 conn(0x7f9398144ff0 legacy=0x7f93980bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.789+0000 7f939d0c4640 1 -- 172.21.15.31:0/2199962789 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980b8c50 con 0x7f93980b77c0 2023-12-22T08:40:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.790+0000 7f939d0c4640 1 --2- 172.21.15.31:0/2199962789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b77c0 0x7f939814e6d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9380009870 tx=0x7f938002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8980c610a5e264 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.790+0000 7f93977fe640 1 -- 172.21.15.31:0/2199962789 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380030840 con 0x7f93980b77c0 2023-12-22T08:40:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.790+0000 7f93977fe640 1 -- 172.21.15.31:0/2199962789 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93800309a0 con 0x7f93980b77c0 2023-12-22T08:40:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.790+0000 7f93977fe640 1 -- 172.21.15.31:0/2199962789 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380030d30 con 0x7f93980b77c0 2023-12-22T08:40:43.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.791+0000 7f939eb27640 1 -- 172.21.15.31:0/2199962789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b77c0 msgr2=0x7f939814e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.791+0000 7f939eb27640 1 --2- 172.21.15.31:0/2199962789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b77c0 0x7f939814e6d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9380009870 tx=0x7f938002b980 comp rx=0 tx=0).stop 2023-12-22T08:40:43.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.791+0000 7f939eb27640 1 -- 172.21.15.31:0/2199962789 shutdown_connections 2023-12-22T08:40:43.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.791+0000 7f939eb27640 1 --2- 172.21.15.31:0/2199962789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b77c0 0x7f939814e6d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.791+0000 7f939eb27640 1 --2- 172.21.15.31:0/2199962789 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b81f0 0x7f939814e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.791+0000 7f939eb27640 1 -- 172.21.15.31:0/2199962789 >> 172.21.15.31:0/2199962789 conn(0x7f9398071610 msgr2=0x7f93980719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.791+0000 7f939eb27640 1 -- 172.21.15.31:0/2199962789 shutdown_connections 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.791+0000 7f939eb27640 1 -- 172.21.15.31:0/2199962789 wait complete. 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.792+0000 7f939eb27640 1 Processor -- start 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.792+0000 7f939eb27640 1 -- start start 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939eb27640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b77c0 0x7f939814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939eb27640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b81f0 0x7f93981df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939eb27640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9398144ff0 0x7f93980c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939eb27640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980c11e0 con 0x7f93980b81f0 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939eb27640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9398149ce0 con 0x7f9398144ff0 2023-12-22T08:40:43.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939eb27640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9398149fa0 con 0x7f93980b77c0 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b81f0 0x7f93981df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b81f0 0x7f93981df9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52996/0 (socket says 172.21.15.31:52996) 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 -- 172.21.15.31:0/1573274306 learned_addr learned my addr 172.21.15.31:0/1573274306 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939c8c3640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b77c0 0x7f939814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939d0c4640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9398144ff0 0x7f93980c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 -- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b77c0 msgr2=0x7f939814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b77c0 0x7f939814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 -- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9398144ff0 msgr2=0x7f93980c0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9398144ff0 0x7f93980c0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 -- 172.21.15.31:0/1573274306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800094d0 con 0x7f93980b81f0 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f9397fff640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b81f0 0x7f93981df9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f938800d800 tx=0x7f938800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f93957fa640 1 -- 172.21.15.31:0/1573274306 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800b6c0 con 0x7f93980b81f0 2023-12-22T08:40:43.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f93957fa640 1 -- 172.21.15.31:0/1573274306 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938800b820 con 0x7f93980b81f0 2023-12-22T08:40:43.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9398148250 con 0x7f93980b81f0 2023-12-22T08:40:43.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.793+0000 7f93957fa640 1 -- 172.21.15.31:0/1573274306 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800bbb0 con 0x7f93980b81f0 2023-12-22T08:40:43.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.794+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9398148810 con 0x7f93980b81f0 2023-12-22T08:40:43.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.794+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93980b89d0 con 0x7f93980b81f0 2023-12-22T08:40:43.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.795+0000 7f93957fa640 1 -- 172.21.15.31:0/1573274306 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f938800bd10 con 0x7f93980b81f0 2023-12-22T08:40:43.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.795+0000 7f93957fa640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f937806a460 0x7f937806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:43.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.795+0000 7f93957fa640 1 -- 172.21.15.31:0/1573274306 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9388088ae0 con 0x7f93980b81f0 2023-12-22T08:40:43.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.796+0000 7f939c8c3640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f937806a460 0x7f937806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:43.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.796+0000 7f939c8c3640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f937806a460 0x7f937806c920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93900012e0 tx=0x7f9390009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:43.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.800+0000 7f93957fa640 1 -- 172.21.15.31:0/1573274306 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9388054410 con 0x7f93980b81f0 2023-12-22T08:40:43.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:43.975+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9398148640 con 0x7f93980b81f0 2023-12-22T08:40:44.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.487+0000 7f93957fa640 1 -- 172.21.15.31:0/1573274306 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9388057a30 con 0x7f93980b81f0 2023-12-22T08:40:44.490 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-12-22T08:40:44.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.492+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f937806a460 msgr2=0x7f937806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.492+0000 7f939eb27640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f937806a460 0x7f937806c920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93900012e0 tx=0x7f9390009040 comp rx=0 tx=0).stop 2023-12-22T08:40:44.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.492+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b81f0 msgr2=0x7f93981df9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.492+0000 7f939eb27640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b81f0 0x7f93981df9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f938800d800 tx=0x7f938800dcc0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.493+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 shutdown_connections 2023-12-22T08:40:44.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.493+0000 7f939eb27640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f937806a460 0x7f937806c920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.493+0000 7f939eb27640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9398144ff0 0x7f93980c0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.493+0000 7f939eb27640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93980b81f0 0x7f93981df9c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.493+0000 7f939eb27640 1 --2- 172.21.15.31:0/1573274306 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93980b77c0 0x7f939814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.493+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 >> 172.21.15.31:0/1573274306 conn(0x7f9398071610 msgr2=0x7f93981466d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:44.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.493+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 shutdown_connections 2023-12-22T08:40:44.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.493+0000 7f939eb27640 1 -- 172.21.15.31:0/1573274306 wait complete. 2023-12-22T08:40:44.510 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:40:44.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.625+0000 7fa4c6d92640 1 Processor -- start 2023-12-22T08:40:44.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4c6d92640 1 -- start start 2023-12-22T08:40:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4c6d92640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4c0142f20 0x7fa4c00b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4c6d92640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa4c00b94b0 0x7fa4c0153280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4c6d92640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c01498f0 con 0x7fa4c00a0cc0 2023-12-22T08:40:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4c6d92640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c00b37e0 con 0x7fa4c0142f20 2023-12-22T08:40:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4c6d92640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c0148fc0 con 0x7fa4c00b94b0 2023-12-22T08:40:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4c4b2e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4c0142f20 0x7fa4c00b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4bffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa4c00a0cc0 0x7fa4c00b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58994/0 (socket says 172.21.15.31:58994) 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4c4b2e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4c0142f20 0x7fa4c00b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53004/0 (socket says 172.21.15.31:53004) 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.626+0000 7fa4bffff640 1 -- 172.21.15.31:0/418715440 learned_addr learned my addr 172.21.15.31:0/418715440 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.627+0000 7fa4c532f640 1 --2- 172.21.15.31:0/418715440 >> v2:172.21.15.69:3300/0 conn(0x7fa4c00b94b0 0x7fa4c0153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.627+0000 7fa4c4b2e640 1 -- 172.21.15.31:0/418715440 >> v2:172.21.15.69:3300/0 conn(0x7fa4c00b94b0 msgr2=0x7fa4c0153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.627+0000 7fa4c4b2e640 1 --2- 172.21.15.31:0/418715440 >> v2:172.21.15.69:3300/0 conn(0x7fa4c00b94b0 0x7fa4c0153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.627+0000 7fa4c4b2e640 1 -- 172.21.15.31:0/418715440 >> v1:172.21.15.31:6789/0 conn(0x7fa4c00a0cc0 legacy=0x7fa4c00b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.627+0000 7fa4c4b2e640 1 -- 172.21.15.31:0/418715440 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c01492a0 con 0x7fa4c0142f20 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.627+0000 7fa4bf7fe640 1 -- 172.21.15.31:0/418715440 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397150049 0 0) 0x7fa4c01498f0 con 0x7fa4c00a0cc0 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.627+0000 7fa4c4b2e640 1 --2- 172.21.15.31:0/418715440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c00b4290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0067020 tx=0x7fa4b402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d2a162f979070c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4bf7fe640 1 -- 172.21.15.31:0/418715440 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4030610 con 0x7fa4c0142f20 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4bf7fe640 1 -- 172.21.15.31:0/418715440 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b4030770 con 0x7fa4c0142f20 2023-12-22T08:40:44.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4bf7fe640 1 -- 172.21.15.31:0/418715440 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4030b00 con 0x7fa4c0142f20 2023-12-22T08:40:44.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4c6d92640 1 -- 172.21.15.31:0/418715440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 msgr2=0x7fa4c00b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/418715440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c00b4290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0067020 tx=0x7fa4b402b960 comp rx=0 tx=0).stop 2023-12-22T08:40:44.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4c6d92640 1 -- 172.21.15.31:0/418715440 shutdown_connections 2023-12-22T08:40:44.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/418715440 >> v2:172.21.15.69:3300/0 conn(0x7fa4c00b94b0 0x7fa4c0153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/418715440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c00b4290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4c6d92640 1 -- 172.21.15.31:0/418715440 >> 172.21.15.31:0/418715440 conn(0x7fa4c00be1e0 msgr2=0x7fa4c00be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:44.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4c6d92640 1 -- 172.21.15.31:0/418715440 shutdown_connections 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.628+0000 7fa4c6d92640 1 -- 172.21.15.31:0/418715440 wait complete. 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.629+0000 7fa4c6d92640 1 Processor -- start 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.629+0000 7fa4c6d92640 1 -- start start 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c6d92640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4c00a0cc0 0x7fa4c00a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c6d92640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4c00b94b0 0x7fa4c01de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c6d92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c0148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c6d92640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01de430 con 0x7fa4c0142f20 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c6d92640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0147ea0 con 0x7fa4c00b94b0 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c6d92640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0148c30 con 0x7fa4c00a0cc0 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c532f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c0148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c532f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c0148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53014/0 (socket says 172.21.15.31:53014) 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c532f640 1 -- 172.21.15.31:0/940650368 learned_addr learned my addr 172.21.15.31:0/940650368 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4c4b2e640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4c00a0cc0 0x7fa4c00a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.630+0000 7fa4bffff640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4c00b94b0 0x7fa4c01de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4c532f640 1 -- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4c00a0cc0 msgr2=0x7fa4c00a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4c532f640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4c00a0cc0 0x7fa4c00a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4c532f640 1 -- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4c00b94b0 msgr2=0x7fa4c01de8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4c532f640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4c00b94b0 0x7fa4c01de8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4c532f640 1 -- 172.21.15.31:0/940650368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b4009400 con 0x7fa4c0142f20 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4c532f640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c0148530 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8007e70 tx=0x7fa4b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4bd7fa640 1 -- 172.21.15.31:0/940650368 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8014620 con 0x7fa4c0142f20 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4bd7fa640 1 -- 172.21.15.31:0/940650368 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b80147a0 con 0x7fa4c0142f20 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4bd7fa640 1 -- 172.21.15.31:0/940650368 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8014b50 con 0x7fa4c0142f20 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c01ddde0 con 0x7fa4c0142f20 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.631+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c0148110 con 0x7fa4c0142f20 2023-12-22T08:40:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.632+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c0066e90 con 0x7fa4c0142f20 2023-12-22T08:40:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.632+0000 7fa4bd7fa640 1 -- 172.21.15.31:0/940650368 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa4b8014cb0 con 0x7fa4c0142f20 2023-12-22T08:40:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.633+0000 7fa4bd7fa640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa4a406a430 0x7fa4a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.633+0000 7fa4bd7fa640 1 -- 172.21.15.31:0/940650368 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa4b8089060 con 0x7fa4c0142f20 2023-12-22T08:40:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.633+0000 7fa4c4b2e640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa4a406a430 0x7fa4a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.633+0000 7fa4c4b2e640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa4a406a430 0x7fa4a406c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4036000 tx=0x7fa4b403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.637+0000 7fa4bd7fa640 1 -- 172.21.15.31:0/940650368 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa4b8054830 con 0x7fa4c0142f20 2023-12-22T08:40:44.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:44.813+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa4c0148df0 con 0x7fa4c0142f20 2023-12-22T08:40:45.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.493+0000 7fa4bd7fa640 1 -- 172.21.15.31:0/940650368 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa4b8057e50 con 0x7fa4c0142f20 2023-12-22T08:40:45.496 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-12-22T08:40:45.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.498+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa4a406a430 msgr2=0x7fa4a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.498+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa4a406a430 0x7fa4a406c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4036000 tx=0x7fa4b403b040 comp rx=0 tx=0).stop 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.498+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 msgr2=0x7fa4c0148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.498+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c0148530 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8007e70 tx=0x7fa4b800e4b0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.499+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 shutdown_connections 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.499+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa4a406a430 0x7fa4a406c8f0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4036000 tx=0x7fa4b403b040 comp rx=0 tx=0).stop 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.499+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4c0142f20 0x7fa4c0148530 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.499+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4c00b94b0 0x7fa4c01de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.499+0000 7fa4c6d92640 1 --2- 172.21.15.31:0/940650368 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4c00a0cc0 0x7fa4c00a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.499+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 >> 172.21.15.31:0/940650368 conn(0x7fa4c00be1e0 msgr2=0x7fa4c0140740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:45.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.500+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 shutdown_connections 2023-12-22T08:40:45.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.500+0000 7fa4c6d92640 1 -- 172.21.15.31:0/940650368 wait complete. 2023-12-22T08:40:45.524 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:40:45.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:45.571 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:45.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:40:45.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.636+0000 7fd1e6195640 1 Processor -- start 2023-12-22T08:40:45.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.636+0000 7fd1e6195640 1 -- start start 2023-12-22T08:40:45.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1e6195640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e00b6770 0x7fd1e006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1e6195640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1e006b930 0x7fd1e00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1e6195640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1e006dbc0 0x7fd1e00b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1e6195640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e0071b90 con 0x7fd1e006b930 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1e6195640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e01486a0 con 0x7fd1e006dbc0 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1e6195640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00b6ff0 con 0x7fd1e00b6770 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1deffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1e006b930 0x7fd1e00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1deffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1e006b930 0x7fd1e00b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54054/0 (socket says 172.21.15.31:54054) 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1deffd640 1 -- 172.21.15.31:0/408229609 learned_addr learned my addr 172.21.15.31:0/408229609 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1dffff640 1 --2- 172.21.15.31:0/408229609 >> v2:172.21.15.69:3300/0 conn(0x7fd1e006dbc0 0x7fd1e00b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1df7fe640 1 --2- 172.21.15.31:0/408229609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e00b6770 0x7fd1e006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1deffd640 1 -- 172.21.15.31:0/408229609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e00b6770 msgr2=0x7fd1e006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1deffd640 1 --2- 172.21.15.31:0/408229609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e00b6770 0x7fd1e006d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1deffd640 1 -- 172.21.15.31:0/408229609 >> v2:172.21.15.69:3300/0 conn(0x7fd1e006dbc0 msgr2=0x7fd1e00b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:45.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1deffd640 1 --2- 172.21.15.31:0/408229609 >> v2:172.21.15.69:3300/0 conn(0x7fd1e006dbc0 0x7fd1e00b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1deffd640 1 -- 172.21.15.31:0/408229609 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0147d70 con 0x7fd1e006b930 2023-12-22T08:40:45.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.637+0000 7fd1df7fe640 1 --2- 172.21.15.31:0/408229609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e00b6770 0x7fd1e006d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:45.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.638+0000 7fd1deffd640 1 --2- 172.21.15.31:0/408229609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006b930 0x7fd1e00b78d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00b4ea0 tx=0x7fd1d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8e01505fbaf08a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:45.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.638+0000 7fd1de7fc640 1 -- 172.21.15.31:0/408229609 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4031870 con 0x7fd1e006b930 2023-12-22T08:40:45.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.638+0000 7fd1de7fc640 1 -- 172.21.15.31:0/408229609 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d40319d0 con 0x7fd1e006b930 2023-12-22T08:40:45.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.638+0000 7fd1de7fc640 1 -- 172.21.15.31:0/408229609 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4031d60 con 0x7fd1e006b930 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 -- 172.21.15.31:0/408229609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006b930 msgr2=0x7fd1e00b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 --2- 172.21.15.31:0/408229609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006b930 0x7fd1e00b78d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00b4ea0 tx=0x7fd1d402b910 comp rx=0 tx=0).stop 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 -- 172.21.15.31:0/408229609 shutdown_connections 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 --2- 172.21.15.31:0/408229609 >> v2:172.21.15.69:3300/0 conn(0x7fd1e006dbc0 0x7fd1e00b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 --2- 172.21.15.31:0/408229609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006b930 0x7fd1e00b78d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 --2- 172.21.15.31:0/408229609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e00b6770 0x7fd1e006d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 -- 172.21.15.31:0/408229609 >> 172.21.15.31:0/408229609 conn(0x7fd1e006ae10 msgr2=0x7fd1e006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 -- 172.21.15.31:0/408229609 shutdown_connections 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.639+0000 7fd1e6195640 1 -- 172.21.15.31:0/408229609 wait complete. 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.640+0000 7fd1e6195640 1 Processor -- start 2023-12-22T08:40:45.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.640+0000 7fd1e6195640 1 -- start start 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1e6195640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006dbc0 0x7fd1e00a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1e6195640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1e00b6770 0x7fd1e013f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1e6195640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e013f680 0x7fd1e00aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1e6195640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00a90c0 con 0x7fd1e006dbc0 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1e6195640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01e39a0 con 0x7fd1e00b6770 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1e6195640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e013e6f0 con 0x7fd1e013f680 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006dbc0 0x7fd1e00a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006dbc0 0x7fd1e00a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54068/0 (socket says 172.21.15.31:54068) 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 -- 172.21.15.31:0/3660097058 learned_addr learned my addr 172.21.15.31:0/3660097058 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1deffd640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1e00b6770 0x7fd1e013f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1dffff640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e013f680 0x7fd1e00aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 -- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e013f680 msgr2=0x7fd1e00aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e013f680 0x7fd1e00aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 -- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1e00b6770 msgr2=0x7fd1e013f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1e00b6770 0x7fd1e013f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 -- 172.21.15.31:0/3660097058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40094d0 con 0x7fd1e006dbc0 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1df7fe640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006dbc0 0x7fd1e00a8b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c820 tx=0x7fd1d000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1c7fff640 1 -- 172.21.15.31:0/3660097058 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0007a30 con 0x7fd1e006dbc0 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1c7fff640 1 -- 172.21.15.31:0/3660097058 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0007b90 con 0x7fd1e006dbc0 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.641+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e00baff0 con 0x7fd1e006dbc0 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.642+0000 7fd1c7fff640 1 -- 172.21.15.31:0/3660097058 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d000ce10 con 0x7fd1e006dbc0 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.642+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e013e960 con 0x7fd1e006dbc0 2023-12-22T08:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.643+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e00b0480 con 0x7fd1e006dbc0 2023-12-22T08:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.643+0000 7fd1c7fff640 1 -- 172.21.15.31:0/3660097058 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1d00113f0 con 0x7fd1e006dbc0 2023-12-22T08:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.643+0000 7fd1c7fff640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1cc06a430 0x7fd1cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.643+0000 7fd1c7fff640 1 -- 172.21.15.31:0/3660097058 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd1d00888b0 con 0x7fd1e006dbc0 2023-12-22T08:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.644+0000 7fd1deffd640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1cc06a430 0x7fd1cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.644+0000 7fd1deffd640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1cc06a430 0x7fd1cc06c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4036000 tx=0x7fd1d403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:45.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.648+0000 7fd1c7fff640 1 -- 172.21.15.31:0/3660097058 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd1d0053fb0 con 0x7fd1e006dbc0 2023-12-22T08:40:45.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.861+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd1e013ed80 con 0x7fd1e006dbc0 2023-12-22T08:40:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.866+0000 7fd1c7fff640 1 -- 172.21.15.31:0/3660097058 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd1d001f0c0 con 0x7fd1e006dbc0 2023-12-22T08:40:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.870+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1cc06a430 msgr2=0x7fd1cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.870+0000 7fd1e6195640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1cc06a430 0x7fd1cc06c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4036000 tx=0x7fd1d403c040 comp rx=0 tx=0).stop 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006dbc0 msgr2=0x7fd1e00a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:45.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006dbc0 0x7fd1e00a8b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c820 tx=0x7fd1d000cce0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 shutdown_connections 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1cc06a430 0x7fd1cc06c8f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1e013f680 0x7fd1e00aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1e00b6770 0x7fd1e013f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 --2- 172.21.15.31:0/3660097058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e006dbc0 0x7fd1e00a8b80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 >> 172.21.15.31:0/3660097058 conn(0x7fd1e006ae10 msgr2=0x7fd1e00b78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:45.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 shutdown_connections 2023-12-22T08:40:45.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:45.871+0000 7fd1e6195640 1 -- 172.21.15.31:0/3660097058 wait complete. 2023-12-22T08:40:45.896 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:46.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.039+0000 7fa0674e7640 1 Processor -- start 2023-12-22T08:40:46.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.039+0000 7fa0674e7640 1 -- start start 2023-12-22T08:40:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa0674e7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa0674e7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600bb310 con 0x7fa06006a6d0 2023-12-22T08:40:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa0674e7640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600bf960 con 0x7fa0600ba000 2023-12-22T08:40:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa0674e7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600bb5b0 con 0x7fa0600ba550 2023-12-22T08:40:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa065283640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa06006a6d0 0x7fa06014acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47834/0 (socket says 172.21.15.31:47834) 2023-12-22T08:40:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa065283640 1 -- 172.21.15.31:0/3811579563 learned_addr learned my addr 172.21.15.31:0/3811579563 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa064a82640 1 --2- 172.21.15.31:0/3811579563 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa057fff640 1 -- 172.21.15.31:0/3811579563 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444675732 0 0) 0x7fa0600bb310 con 0x7fa06006a6d0 2023-12-22T08:40:46.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa057fff640 1 -- 172.21.15.31:0/3811579563 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04c003520 con 0x7fa06006a6d0 2023-12-22T08:40:46.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa057fff640 1 -- 172.21.15.31:0/3811579563 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339735317 0 0) 0x7fa0600bf960 con 0x7fa0600ba000 2023-12-22T08:40:46.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa057fff640 1 -- 172.21.15.31:0/3811579563 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0600bb310 con 0x7fa0600ba000 2023-12-22T08:40:46.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa064a82640 1 -- 172.21.15.31:0/3811579563 >> v1:172.21.15.69:6789/0 conn(0x7fa0600ba000 legacy=0x7fa0601554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa064a82640 1 -- 172.21.15.31:0/3811579563 >> v1:172.21.15.31:6789/0 conn(0x7fa06006a6d0 legacy=0x7fa06014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.040+0000 7fa064a82640 1 -- 172.21.15.31:0/3811579563 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600c0120 con 0x7fa0600ba550 2023-12-22T08:40:46.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.041+0000 7fa064a82640 1 --2- 172.21.15.31:0/3811579563 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b9ac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0500097d0 tx=0x7fa05002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fde61bb224ba574 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.041+0000 7fa057fff640 1 -- 172.21.15.31:0/3811579563 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050031890 con 0x7fa0600ba550 2023-12-22T08:40:46.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.041+0000 7fa057fff640 1 -- 172.21.15.31:0/3811579563 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0500319f0 con 0x7fa0600ba550 2023-12-22T08:40:46.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.041+0000 7fa057fff640 1 -- 172.21.15.31:0/3811579563 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050031d60 con 0x7fa0600ba550 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.042+0000 7fa0674e7640 1 -- 172.21.15.31:0/3811579563 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 msgr2=0x7fa0600b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.042+0000 7fa0674e7640 1 --2- 172.21.15.31:0/3811579563 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b9ac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0500097d0 tx=0x7fa05002b930 comp rx=0 tx=0).stop 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.042+0000 7fa0674e7640 1 -- 172.21.15.31:0/3811579563 shutdown_connections 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.042+0000 7fa0674e7640 1 --2- 172.21.15.31:0/3811579563 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b9ac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.042+0000 7fa0674e7640 1 -- 172.21.15.31:0/3811579563 >> 172.21.15.31:0/3811579563 conn(0x7fa0600c0350 msgr2=0x7fa0600c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.042+0000 7fa0674e7640 1 -- 172.21.15.31:0/3811579563 shutdown_connections 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.042+0000 7fa0674e7640 1 -- 172.21.15.31:0/3811579563 wait complete. 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.043+0000 7fa0674e7640 1 Processor -- start 2023-12-22T08:40:46.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.043+0000 7fa0674e7640 1 -- start start 2023-12-22T08:40:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa0674e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa06006a6d0 0x7fa0600a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa0674e7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0600ba000 0x7fa0600b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa0674e7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa0674e7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601d4c70 con 0x7fa06006a6d0 2023-12-22T08:40:46.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa0674e7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600a54b0 con 0x7fa0600ba000 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa0674e7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0601d1180 con 0x7fa0600ba550 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa06006a6d0 0x7fa0600a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa06006a6d0 0x7fa0600a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54072/0 (socket says 172.21.15.31:54072) 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 -- 172.21.15.31:0/3662222160 learned_addr learned my addr 172.21.15.31:0/3662222160 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa064a82640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0600ba000 0x7fa0600b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065a84640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 -- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 msgr2=0x7fa0600b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 -- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0600ba000 msgr2=0x7fa0600b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0600ba000 0x7fa0600b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 -- 172.21.15.31:0/3662222160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009400 con 0x7fa06006a6d0 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa064a82640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0600ba000 0x7fa0600b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:46.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa065283640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa06006a6d0 0x7fa0600a4f70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c530 tx=0x7fa05800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa055ffb640 1 -- 172.21.15.31:0/3662222160 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058005ce0 con 0x7fa06006a6d0 2023-12-22T08:40:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa055ffb640 1 -- 172.21.15.31:0/3662222160 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa058005e40 con 0x7fa06006a6d0 2023-12-22T08:40:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.044+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0601d1370 con 0x7fa06006a6d0 2023-12-22T08:40:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.045+0000 7fa055ffb640 1 -- 172.21.15.31:0/3662222160 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058007270 con 0x7fa06006a6d0 2023-12-22T08:40:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.045+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0601d18c0 con 0x7fa06006a6d0 2023-12-22T08:40:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.046+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600a0520 con 0x7fa06006a6d0 2023-12-22T08:40:46.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.046+0000 7fa055ffb640 1 -- 172.21.15.31:0/3662222160 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa0580073d0 con 0x7fa06006a6d0 2023-12-22T08:40:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.046+0000 7fa055ffb640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa04406a430 0x7fa04406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.047+0000 7fa055ffb640 1 -- 172.21.15.31:0/3662222160 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa058087d30 con 0x7fa06006a6d0 2023-12-22T08:40:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.047+0000 7fa064a82640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa04406a430 0x7fa04406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.047+0000 7fa064a82640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa04406a430 0x7fa04406c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa050036000 tx=0x7fa05003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.051+0000 7fa055ffb640 1 -- 172.21.15.31:0/3662222160 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa058053460 con 0x7fa06006a6d0 2023-12-22T08:40:46.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.228+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa060073a40 con 0x7fa06006a6d0 2023-12-22T08:40:46.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.229+0000 7fa055ffb640 1 -- 172.21.15.31:0/3662222160 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7fa058017090 con 0x7fa06006a6d0 2023-12-22T08:40:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:46.232 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:45.862505+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:46.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa04406a430 msgr2=0x7fa04406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa04406a430 0x7fa04406c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa050036000 tx=0x7fa05003c040 comp rx=0 tx=0).stop 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa06006a6d0 msgr2=0x7fa0600a4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa06006a6d0 0x7fa0600a4f70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa05800c530 tx=0x7fa05800c9f0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 shutdown_connections 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa04406a430 0x7fa04406c8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0600ba550 0x7fa0600b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0600ba000 0x7fa0600b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 --2- 172.21.15.31:0/3662222160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa06006a6d0 0x7fa0600a4f70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 >> 172.21.15.31:0/3662222160 conn(0x7fa0600c0350 msgr2=0x7fa06009fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 shutdown_connections 2023-12-22T08:40:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.231+0000 7fa0674e7640 1 -- 172.21.15.31:0/3662222160 wait complete. 2023-12-22T08:40:46.244 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:46.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.347+0000 7fa1f0573640 1 Processor -- start 2023-12-22T08:40:46.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.347+0000 7fa1f0573640 1 -- start start 2023-12-22T08:40:46.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1f0573640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1e80ba550 0x7fa1e80b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1f0573640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e80bb310 con 0x7fa1e806a6d0 2023-12-22T08:40:46.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1f0573640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e80bf960 con 0x7fa1e80ba000 2023-12-22T08:40:46.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1f0573640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e80bb5b0 con 0x7fa1e80ba550 2023-12-22T08:40:46.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1edb0e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1e80ba550 0x7fa1e80b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1edb0e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1e80ba550 0x7fa1e80b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54084/0 (socket says 172.21.15.31:54084) 2023-12-22T08:40:46.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1edb0e640 1 -- 172.21.15.31:0/3040939279 learned_addr learned my addr 172.21.15.31:0/3040939279 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:46.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1ee30f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa1e806a6d0 0x7fa1e814acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47850/0 (socket says 172.21.15.31:47850) 2023-12-22T08:40:46.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1edb0e640 1 -- 172.21.15.31:0/3040939279 >> v1:172.21.15.69:6789/0 conn(0x7fa1e80ba000 legacy=0x7fa1e81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:46.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1edb0e640 1 -- 172.21.15.31:0/3040939279 >> v1:172.21.15.31:6789/0 conn(0x7fa1e806a6d0 legacy=0x7fa1e814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.348+0000 7fa1edb0e640 1 -- 172.21.15.31:0/3040939279 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e80c0120 con 0x7fa1e80ba550 2023-12-22T08:40:46.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1edb0e640 1 --2- 172.21.15.31:0/3040939279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e80ba550 0x7fa1e80b9ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009870 tx=0x7fa1d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac1ffeb820ae044 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1ed30d640 1 -- 172.21.15.31:0/3040939279 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8030860 con 0x7fa1e80ba550 2023-12-22T08:40:46.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1ed30d640 1 -- 172.21.15.31:0/3040939279 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d80309c0 con 0x7fa1e80ba550 2023-12-22T08:40:46.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1ed30d640 1 -- 172.21.15.31:0/3040939279 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8030d50 con 0x7fa1e80ba550 2023-12-22T08:40:46.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1f0573640 1 -- 172.21.15.31:0/3040939279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e80ba550 msgr2=0x7fa1e80b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1f0573640 1 --2- 172.21.15.31:0/3040939279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e80ba550 0x7fa1e80b9ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009870 tx=0x7fa1d802b9a0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1f0573640 1 -- 172.21.15.31:0/3040939279 shutdown_connections 2023-12-22T08:40:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1f0573640 1 --2- 172.21.15.31:0/3040939279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e80ba550 0x7fa1e80b9ac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1f0573640 1 -- 172.21.15.31:0/3040939279 >> 172.21.15.31:0/3040939279 conn(0x7fa1e80c0350 msgr2=0x7fa1e80c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.349+0000 7fa1f0573640 1 -- 172.21.15.31:0/3040939279 shutdown_connections 2023-12-22T08:40:46.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.350+0000 7fa1f0573640 1 -- 172.21.15.31:0/3040939279 wait complete. 2023-12-22T08:40:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1f0573640 1 Processor -- start 2023-12-22T08:40:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1f0573640 1 -- start start 2023-12-22T08:40:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1f0573640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e806a6d0 0x7fa1e814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1f0573640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e80ba000 0x7fa1e81e0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1f0573640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1e80ba550 0x7fa1e81e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1f0573640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e814eef0 con 0x7fa1e806a6d0 2023-12-22T08:40:46.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1f0573640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e80a1ba0 con 0x7fa1e80ba000 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1f0573640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e81dfba0 con 0x7fa1e80ba550 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1ee30f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e806a6d0 0x7fa1e814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1ee30f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e806a6d0 0x7fa1e814e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54086/0 (socket says 172.21.15.31:54086) 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1ee30f640 1 -- 172.21.15.31:0/752150150 learned_addr learned my addr 172.21.15.31:0/752150150 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.351+0000 7fa1edb0e640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e80ba000 0x7fa1e81e0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1eeb10640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1e80ba550 0x7fa1e81e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1ee30f640 1 -- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1e80ba550 msgr2=0x7fa1e81e05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1ee30f640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1e80ba550 0x7fa1e81e05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1ee30f640 1 -- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e80ba000 msgr2=0x7fa1e81e0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1ee30f640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e80ba000 0x7fa1e81e0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1ee30f640 1 -- 172.21.15.31:0/752150150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80094d0 con 0x7fa1e806a6d0 2023-12-22T08:40:46.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1edb0e640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e80ba000 0x7fa1e81e0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1ee30f640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e806a6d0 0x7fa1e814e9b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400c4d0 tx=0x7fa1e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1deffd640 1 -- 172.21.15.31:0/752150150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4007480 con 0x7fa1e806a6d0 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1deffd640 1 -- 172.21.15.31:0/752150150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e40075e0 con 0x7fa1e806a6d0 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e80a5c30 con 0x7fa1e806a6d0 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1deffd640 1 -- 172.21.15.31:0/752150150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40049e0 con 0x7fa1e806a6d0 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.352+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e806b980 con 0x7fa1e806a6d0 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.353+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e8073a40 con 0x7fa1e806a6d0 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.353+0000 7fa1deffd640 1 -- 172.21.15.31:0/752150150 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1e4004b40 con 0x7fa1e806a6d0 2023-12-22T08:40:46.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.354+0000 7fa1deffd640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa1cc06a430 0x7fa1cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.354+0000 7fa1deffd640 1 -- 172.21.15.31:0/752150150 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1e4087e60 con 0x7fa1e806a6d0 2023-12-22T08:40:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.354+0000 7fa1edb0e640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa1cc06a430 0x7fa1cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.354+0000 7fa1edb0e640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa1cc06a430 0x7fa1cc06c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8036000 tx=0x7fa1d803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.358+0000 7fa1deffd640 1 -- 172.21.15.31:0/752150150 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa1e4053450 con 0x7fa1e806a6d0 2023-12-22T08:40:46.540 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-12-22T08:40:46.538+0000 7ff5b3bc6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:40:46.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.539+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1e80a62d0 con 0x7fa1e806a6d0 2023-12-22T08:40:46.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.540+0000 7fa1deffd640 1 -- 172.21.15.31:0/752150150 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7fa1e4056a70 con 0x7fa1e806a6d0 2023-12-22T08:40:46.543 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:46.543 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:45.862505+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa1cc06a430 msgr2=0x7fa1cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa1cc06a430 0x7fa1cc06c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8036000 tx=0x7fa1d803b040 comp rx=0 tx=0).stop 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e806a6d0 msgr2=0x7fa1e814e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e806a6d0 0x7fa1e814e9b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400c4d0 tx=0x7fa1e400c990 comp rx=0 tx=0).stop 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 shutdown_connections 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa1cc06a430 0x7fa1cc06c8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1e80ba550 0x7fa1e81e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1e80ba000 0x7fa1e81e0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 --2- 172.21.15.31:0/752150150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1e806a6d0 0x7fa1e814e9b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 >> 172.21.15.31:0/752150150 conn(0x7fa1e80c0350 msgr2=0x7fa1e80b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:46.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 shutdown_connections 2023-12-22T08:40:46.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.542+0000 7fa1f0573640 1 -- 172.21.15.31:0/752150150 wait complete. 2023-12-22T08:40:46.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:40:46.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.661+0000 7f99b4700640 1 Processor -- start 2023-12-22T08:40:46.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.661+0000 7f99b4700640 1 -- start start 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b4700640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f99ac0b8690 0x7f99ac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b4700640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b77d0 0x7f99ac144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b4700640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99ac144bb0 0x7f99ac14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b4700640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac14ab10 con 0x7f99ac144bb0 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b4700640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac06c2f0 con 0x7f99ac0b8690 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b4700640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0ba620 con 0x7f99ac0b77d0 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b2c9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99ac144bb0 0x7f99ac14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b2c9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99ac144bb0 0x7f99ac14afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54094/0 (socket says 172.21.15.31:54094) 2023-12-22T08:40:46.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b2c9d640 1 -- 172.21.15.31:0/3939276699 learned_addr learned my addr 172.21.15.31:0/3939276699 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:46.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b249c640 1 --2- 172.21.15.31:0/3939276699 >> v2:172.21.15.69:3300/0 conn(0x7f99ac0b8690 0x7f99ac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b1c9b640 1 --2- 172.21.15.31:0/3939276699 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b77d0 0x7f99ac144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b2c9d640 1 -- 172.21.15.31:0/3939276699 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b77d0 msgr2=0x7f99ac144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:46.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b2c9d640 1 --2- 172.21.15.31:0/3939276699 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b77d0 0x7f99ac144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b2c9d640 1 -- 172.21.15.31:0/3939276699 >> v2:172.21.15.69:3300/0 conn(0x7f99ac0b8690 msgr2=0x7f99ac0b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:46.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b2c9d640 1 --2- 172.21.15.31:0/3939276699 >> v2:172.21.15.69:3300/0 conn(0x7f99ac0b8690 0x7f99ac0b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b2c9d640 1 -- 172.21.15.31:0/3939276699 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0b9e60 con 0x7f99ac144bb0 2023-12-22T08:40:46.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.662+0000 7f99b1c9b640 1 --2- 172.21.15.31:0/3939276699 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b77d0 0x7f99ac144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:46.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.663+0000 7f99b2c9d640 1 --2- 172.21.15.31:0/3939276699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac14afa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99ac06aca0 tx=0x7f999c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43200dc0ce88fcd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.663+0000 7f99b149a640 1 -- 172.21.15.31:0/3939276699 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c02c9e0 con 0x7f99ac144bb0 2023-12-22T08:40:46.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.663+0000 7f99b149a640 1 -- 172.21.15.31:0/3939276699 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c02cb40 con 0x7f99ac144bb0 2023-12-22T08:40:46.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.663+0000 7f99b149a640 1 -- 172.21.15.31:0/3939276699 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0343f0 con 0x7f99ac144bb0 2023-12-22T08:40:46.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 -- 172.21.15.31:0/3939276699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 msgr2=0x7f99ac14afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 --2- 172.21.15.31:0/3939276699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac14afa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99ac06aca0 tx=0x7f999c02be40 comp rx=0 tx=0).stop 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 -- 172.21.15.31:0/3939276699 shutdown_connections 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 --2- 172.21.15.31:0/3939276699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac14afa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 --2- 172.21.15.31:0/3939276699 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b77d0 0x7f99ac144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 --2- 172.21.15.31:0/3939276699 >> v2:172.21.15.69:3300/0 conn(0x7f99ac0b8690 0x7f99ac0b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 -- 172.21.15.31:0/3939276699 >> 172.21.15.31:0/3939276699 conn(0x7f99ac06b6a0 msgr2=0x7f99ac06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 -- 172.21.15.31:0/3939276699 shutdown_connections 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.664+0000 7f99b4700640 1 -- 172.21.15.31:0/3939276699 wait complete. 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b4700640 1 Processor -- start 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b4700640 1 -- start start 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b4700640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99ac0b77d0 0x7f99ac13bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b4700640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b8690 0x7f99ac147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b4700640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b4700640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac13c3e0 con 0x7f99ac144bb0 2023-12-22T08:40:46.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b4700640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac148e50 con 0x7f99ac0b77d0 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b4700640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac145650 con 0x7f99ac0b8690 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.665+0000 7f99b2c9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b2c9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac13fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54106/0 (socket says 172.21.15.31:54106) 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b2c9d640 1 -- 172.21.15.31:0/159009719 learned_addr learned my addr 172.21.15.31:0/159009719 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b249c640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99ac0b77d0 0x7f99ac13bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b1c9b640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b8690 0x7f99ac147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b2c9d640 1 -- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b8690 msgr2=0x7f99ac147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b2c9d640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b8690 0x7f99ac147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b2c9d640 1 -- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99ac0b77d0 msgr2=0x7f99ac13bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b2c9d640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99ac0b77d0 0x7f99ac13bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b2c9d640 1 -- 172.21.15.31:0/159009719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c009b30 con 0x7f99ac144bb0 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b1c9b640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b8690 0x7f99ac147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b2c9d640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac13fb60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f999c036040 tx=0x7f999c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99aaffd640 1 -- 172.21.15.31:0/159009719 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c009510 con 0x7f99ac144bb0 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99aaffd640 1 -- 172.21.15.31:0/159009719 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c03e450 con 0x7f99ac144bb0 2023-12-22T08:40:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac1490f0 con 0x7f99ac144bb0 2023-12-22T08:40:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99aaffd640 1 -- 172.21.15.31:0/159009719 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c03e800 con 0x7f99ac144bb0 2023-12-22T08:40:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.666+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac1496b0 con 0x7f99ac144bb0 2023-12-22T08:40:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.667+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac073a40 con 0x7f99ac144bb0 2023-12-22T08:40:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.667+0000 7f99aaffd640 1 -- 172.21.15.31:0/159009719 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f999c03e960 con 0x7f99ac144bb0 2023-12-22T08:40:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.668+0000 7f99aaffd640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f999806a430 0x7f999806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.668+0000 7f99aaffd640 1 -- 172.21.15.31:0/159009719 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f999c0ab650 con 0x7f99ac144bb0 2023-12-22T08:40:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.668+0000 7f99b249c640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f999806a430 0x7f999806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.669+0000 7f99b249c640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f999806a430 0x7f999806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009b40 tx=0x7f99a4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:46.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.672+0000 7f99aaffd640 1 -- 172.21.15.31:0/159009719 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f999c076bb0 con 0x7f99ac144bb0 2023-12-22T08:40:46.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:46.886+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f99ac0b8d90 con 0x7f99ac144bb0 2023-12-22T08:40:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.867+0000 7f99aaffd640 1 -- 172.21.15.31:0/159009719 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f999c07a1d0 con 0x7f99ac144bb0 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f999806a430 msgr2=0x7f999806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f999806a430 0x7f999806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009b40 tx=0x7f99a4009190 comp rx=0 tx=0).stop 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 msgr2=0x7f99ac13fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac13fb60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f999c036040 tx=0x7f999c004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 shutdown_connections 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f999806a430 0x7f999806c8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99ac144bb0 0x7f99ac13fb60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99ac0b8690 0x7f99ac147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 --2- 172.21.15.31:0/159009719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99ac0b77d0 0x7f99ac13bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 >> 172.21.15.31:0/159009719 conn(0x7f99ac06b6a0 msgr2=0x7f99ac06ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 shutdown_connections 2023-12-22T08:40:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.870+0000 7f99b4700640 1 -- 172.21.15.31:0/159009719 wait complete. 2023-12-22T08:40:47.886 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:40:47.886 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:40:48.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.999+0000 7f3cbe626640 1 Processor -- start 2023-12-22T08:40:48.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.999+0000 7f3cbe626640 1 -- start start 2023-12-22T08:40:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.999+0000 7f3cbe626640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3cb814c200 0x7f3cb81538e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.999+0000 7f3cbe626640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb8072370 con 0x7f3cb8065b80 2023-12-22T08:40:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.999+0000 7f3cbe626640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb80bb980 con 0x7f3cb814b680 2023-12-22T08:40:48.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.999+0000 7f3cbe626640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80bc680 con 0x7f3cb814c200 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.999+0000 7f3cb7fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3cb8065b80 0x7f3cb80b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47856/0 (socket says 172.21.15.31:47856) 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:47.999+0000 7f3cb7fff640 1 -- 172.21.15.31:0/2220196734 learned_addr learned my addr 172.21.15.31:0/2220196734 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13417968 0 0) 0x7f3cac001110 con 0x7f3cb8065b80 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca0003520 con 0x7f3cb8065b80 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cbcbc3640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3cb814c200 0x7f3cb81538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 742340614 0 0) 0x7f3ca0003520 con 0x7f3cb8065b80 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3cb814c200 msgr2=0x7f3cb81538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3cb814c200 0x7f3cb81538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 >> v1:172.21.15.69:6789/0 conn(0x7f3cb814b680 legacy=0x7f3cb814baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8072120 con 0x7f3cb8065b80 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f3cac001800 con 0x7f3cb8065b80 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 >> v1:172.21.15.31:6789/0 conn(0x7f3cb8065b80 legacy=0x7f3cb80b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca00039a0 0x7f3ca0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca00047c0 0x7f3ca0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3cb814c200 0x7f3ca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca000ba30 con 0x7f3ca00047c0 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca000bb70 con 0x7f3ca00039a0 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca000bd30 con 0x7f3cb814c200 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb77fe640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca00047c0 0x7f3ca0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb7fff640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca00039a0 0x7f3ca0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cbcbc3640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3cb814c200 0x7f3ca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb77fe640 1 -- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3cb814c200 msgr2=0x7f3ca0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb77fe640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3cb814c200 0x7f3ca0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb77fe640 1 -- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca00039a0 msgr2=0x7f3ca0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb77fe640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca00039a0 0x7f3ca0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.000+0000 7f3cb77fe640 1 -- 172.21.15.31:0/2220196734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca0003520 con 0x7f3ca00047c0 2023-12-22T08:40:48.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.001+0000 7f3cb77fe640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca00047c0 0x7f3ca0004c40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8001720 tx=0x7f3ca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bfe0e1af8e120c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.001+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80052d0 con 0x7f3ca00047c0 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.001+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca802e050 con 0x7f3ca00047c0 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.001+0000 7f3cb6ffd640 1 -- 172.21.15.31:0/2220196734 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80035f0 con 0x7f3ca00047c0 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.002+0000 7f3cbe626640 1 -- 172.21.15.31:0/2220196734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca00047c0 msgr2=0x7f3ca0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.002+0000 7f3cbe626640 1 --2- 172.21.15.31:0/2220196734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca00047c0 0x7f3ca0004c40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8001720 tx=0x7f3ca00057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.002+0000 7f3cbcbc3640 1 -- 172.21.15.31:0/2220196734 reap_dead start 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.002+0000 7f3cbe626640 1 -- 172.21.15.31:0/2220196734 shutdown_connections 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.002+0000 7f3cbe626640 1 -- 172.21.15.31:0/2220196734 >> 172.21.15.31:0/2220196734 conn(0x7f3cb80b9250 msgr2=0x7f3cb80b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.002+0000 7f3cbe626640 1 -- 172.21.15.31:0/2220196734 shutdown_connections 2023-12-22T08:40:48.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.002+0000 7f3cbe626640 1 -- 172.21.15.31:0/2220196734 wait complete. 2023-12-22T08:40:48.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.003+0000 7f3cbe626640 1 Processor -- start 2023-12-22T08:40:48.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.003+0000 7f3cbe626640 1 -- start start 2023-12-22T08:40:48.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbe626640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00047c0 0x7f3cb809cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbe626640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cb8146410 0x7f3cb8146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbe626640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb81449d0 0x7f3cb8144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbe626640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb81481b0 con 0x7f3cb81449d0 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbe626640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb809d140 con 0x7f3cb8146410 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbe626640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80b69b0 con 0x7f3ca00047c0 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb81449d0 0x7f3cb8144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb81449d0 0x7f3cb8144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54132/0 (socket says 172.21.15.31:54132) 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 -- 172.21.15.31:0/469809173 learned_addr learned my addr 172.21.15.31:0/469809173 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cb7fff640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00047c0 0x7f3cb809cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cb77fe640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cb8146410 0x7f3cb8146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 -- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00047c0 msgr2=0x7f3cb809cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00047c0 0x7f3cb809cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 -- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cb8146410 msgr2=0x7f3cb8146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cb8146410 0x7f3cb8146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 -- 172.21.15.31:0/469809173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb809b890 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cb7fff640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00047c0 0x7f3cb809cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cb77fe640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cb8146410 0x7f3cb8146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.004+0000 7f3cbcbc3640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb81449d0 0x7f3cb8144e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8067970 tx=0x7f3cb000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.005+0000 7f3cb4ff9640 1 -- 172.21.15.31:0/469809173 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000e040 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.005+0000 7f3cb4ff9640 1 -- 172.21.15.31:0/469809173 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000f040 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.005+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb809d610 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.005+0000 7f3cb4ff9640 1 -- 172.21.15.31:0/469809173 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0015670 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.005+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb8145950 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.006+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb8073a40 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.006+0000 7f3cb4ff9640 1 -- 172.21.15.31:0/469809173 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3cb00157d0 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.007+0000 7f3cb4ff9640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ca406a460 0x7f3ca406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.007+0000 7f3cb4ff9640 1 -- 172.21.15.31:0/469809173 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cb00890d0 con 0x7f3cb81449d0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.007+0000 7f3cb7fff640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ca406a460 0x7f3ca406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.007+0000 7f3cb7fff640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ca406a460 0x7f3ca406c920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3cac000fb0 tx=0x7f3cac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:48.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.011+0000 7f3cb4ff9640 1 -- 172.21.15.31:0/469809173 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3cb0054630 con 0x7f3cb81449d0 2023-12-22T08:40:48.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.223+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3cb806dee0 con 0x7f3cb81449d0 2023-12-22T08:40:48.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.869+0000 7f3cb4ff9640 1 -- 172.21.15.31:0/469809173 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3cb0057c50 con 0x7f3cb81449d0 2023-12-22T08:40:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ca406a460 msgr2=0x7f3ca406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ca406a460 0x7f3ca406c920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3cac000fb0 tx=0x7f3cac009040 comp rx=0 tx=0).stop 2023-12-22T08:40:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb81449d0 msgr2=0x7f3cb8144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb81449d0 0x7f3cb8144e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8067970 tx=0x7f3cb000f580 comp rx=0 tx=0).stop 2023-12-22T08:40:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 shutdown_connections 2023-12-22T08:40:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ca406a460 0x7f3ca406c920 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb81449d0 0x7f3cb8144e50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cb8146410 0x7f3cb8146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 --2- 172.21.15.31:0/469809173 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00047c0 0x7f3cb809cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:48.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 >> 172.21.15.31:0/469809173 conn(0x7f3cb80b9250 msgr2=0x7f3cb80731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:48.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 shutdown_connections 2023-12-22T08:40:48.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.872+0000 7f3cbe626640 1 -- 172.21.15.31:0/469809173 wait complete. 2023-12-22T08:40:48.888 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:40:48.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:48.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.997+0000 7f54c4210640 1 Processor -- start 2023-12-22T08:40:48.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.997+0000 7f54c4210640 1 -- start start 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c4210640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc0ba550 0x7f54bc0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c4210640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0bb310 con 0x7f54bc0ba000 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c4210640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0bf960 con 0x7f54bc06a6d0 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c4210640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0bb5b0 con 0x7f54bc0ba550 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c27ad640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f54bc0ba000 0x7f54bc1554e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47872/0 (socket says 172.21.15.31:47872) 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c27ad640 1 -- 172.21.15.31:0/2586690310 learned_addr learned my addr 172.21.15.31:0/2586690310 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786626844 0 0) 0x7f54bc0bb310 con 0x7f54bc0ba000 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c17ab640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc0ba550 0x7f54bc0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a8003520 con 0x7f54bc0ba000 2023-12-22T08:40:49.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 782962569 0 0) 0x7f54a8003520 con 0x7f54bc0ba000 2023-12-22T08:40:49.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc0ba550 msgr2=0x7f54bc0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc0ba550 0x7f54bc0b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 >> v1:172.21.15.69:6789/0 conn(0x7f54bc06a6d0 legacy=0x7f54bc14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0c0120 con 0x7f54bc0ba000 2023-12-22T08:40:49.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f54b40019f0 con 0x7f54bc0ba000 2023-12-22T08:40:49.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 >> v1:172.21.15.31:6789/0 conn(0x7f54bc0ba000 legacy=0x7f54bc1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a80039a0 0x7f54a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc0ba550 0x7f54a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8004d00 0x7f54a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0bb5b0 con 0x7f54a8004d00 2023-12-22T08:40:49.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a800ba30 con 0x7f54a80039a0 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.998+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a800bbf0 con 0x7f54bc0ba550 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.999+0000 7f54c27ad640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8004d00 0x7f54a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.999+0000 7f54c17ab640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc0ba550 0x7f54a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.999+0000 7f54c1fac640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a80039a0 0x7f54a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.999+0000 7f54c27ad640 1 -- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc0ba550 msgr2=0x7f54a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.999+0000 7f54c27ad640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc0ba550 0x7f54a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.999+0000 7f54c27ad640 1 -- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a80039a0 msgr2=0x7f54a8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.999+0000 7f54c27ad640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a80039a0 0x7f54a8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:48.999+0000 7f54c27ad640 1 -- 172.21.15.31:0/2586690310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8003520 con 0x7f54a8004d00 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c27ad640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8004d00 0x7f54a8005180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54b400a7f0 tx=0x7f54a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ce35c1751ff090 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40072d0 con 0x7f54a8004d00 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b402f070 con 0x7f54a8004d00 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c0faa640 1 -- 172.21.15.31:0/2586690310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4007690 con 0x7f54a8004d00 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c4210640 1 -- 172.21.15.31:0/2586690310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8004d00 msgr2=0x7f54a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c4210640 1 --2- 172.21.15.31:0/2586690310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a8004d00 0x7f54a8005180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54b400a7f0 tx=0x7f54a80057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c27ad640 1 -- 172.21.15.31:0/2586690310 reap_dead start 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c4210640 1 -- 172.21.15.31:0/2586690310 shutdown_connections 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c4210640 1 -- 172.21.15.31:0/2586690310 >> 172.21.15.31:0/2586690310 conn(0x7f54bc0c0350 msgr2=0x7f54bc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c4210640 1 -- 172.21.15.31:0/2586690310 shutdown_connections 2023-12-22T08:40:49.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.000+0000 7f54c4210640 1 -- 172.21.15.31:0/2586690310 wait complete. 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.001+0000 7f54c4210640 1 Processor -- start 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.001+0000 7f54c4210640 1 -- start start 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c4210640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a8004d00 0x7f54bc14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c4210640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54bc1e39e0 0x7f54bc1e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c4210640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc1d3f80 0x7f54bc1d4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c4210640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1e43a0 con 0x7f54bc1e39e0 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c4210640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc09a330 con 0x7f54a8004d00 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c4210640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc1d6f10 con 0x7f54bc1d3f80 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c17ab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54bc1e39e0 0x7f54bc1e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c17ab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54bc1e39e0 0x7f54bc1e3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54152/0 (socket says 172.21.15.31:54152) 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c17ab640 1 -- 172.21.15.31:0/3805857594 learned_addr learned my addr 172.21.15.31:0/3805857594 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:49.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c1fac640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a8004d00 0x7f54bc14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c17ab640 1 -- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc1d3f80 msgr2=0x7f54bc1d4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c27ad640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc1d3f80 0x7f54bc1d4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c17ab640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc1d3f80 0x7f54bc1d4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c17ab640 1 -- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a8004d00 msgr2=0x7f54bc14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c17ab640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a8004d00 0x7f54bc14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c17ab640 1 -- 172.21.15.31:0/3805857594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc1d71f0 con 0x7f54bc1e39e0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c1fac640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a8004d00 0x7f54bc14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.002+0000 7f54c27ad640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc1d3f80 0x7f54bc1d4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.003+0000 7f54c17ab640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54bc1e39e0 0x7f54bc1e3e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54ac011910 tx=0x7f54ac011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.003+0000 7f54b27fc640 1 -- 172.21.15.31:0/3805857594 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac009590 con 0x7f54bc1e39e0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.003+0000 7f54b27fc640 1 -- 172.21.15.31:0/3805857594 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac004240 con 0x7f54bc1e39e0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.003+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc1d74d0 con 0x7f54bc1e39e0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.003+0000 7f54b27fc640 1 -- 172.21.15.31:0/3805857594 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00f8e0 con 0x7f54bc1e39e0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.003+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc1d7a90 con 0x7f54bc1e39e0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.004+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc1d7c50 con 0x7f54bc1e39e0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.004+0000 7f54b27fc640 1 -- 172.21.15.31:0/3805857594 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f54ac00fa40 con 0x7f54bc1e39e0 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.004+0000 7f54b27fc640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f54a006a430 0x7f54a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.005+0000 7f54b27fc640 1 -- 172.21.15.31:0/3805857594 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54ac088ff0 con 0x7f54bc1e39e0 2023-12-22T08:40:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.005+0000 7f54c1fac640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f54a006a430 0x7f54a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.005+0000 7f54c1fac640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f54a006a430 0x7f54a006c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54b80035f0 tx=0x7f54b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.009+0000 7f54b27fc640 1 -- 172.21.15.31:0/3805857594 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f54ac0bbc80 con 0x7f54bc1e39e0 2023-12-22T08:40:49.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.220+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54bc073a40 con 0x7f54bc1e39e0 2023-12-22T08:40:49.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.221+0000 7f54b27fc640 1 -- 172.21.15.31:0/3805857594 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f54ac019090 con 0x7f54bc1e39e0 2023-12-22T08:40:49.224 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:49.224 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:40:45.862817+0000","modified":"2023-12-22T08:40:48.867080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:49.224 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f54a006a430 msgr2=0x7f54a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f54a006a430 0x7f54a006c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54b80035f0 tx=0x7f54b8009040 comp rx=0 tx=0).stop 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54bc1e39e0 msgr2=0x7f54bc1e3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54bc1e39e0 0x7f54bc1e3e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54ac011910 tx=0x7f54ac011dd0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 shutdown_connections 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f54a006a430 0x7f54a006c8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54bc1d3f80 0x7f54bc1d4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54bc1e39e0 0x7f54bc1e3e60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 --2- 172.21.15.31:0/3805857594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54a8004d00 0x7f54bc14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 >> 172.21.15.31:0/3805857594 conn(0x7f54bc0c0350 msgr2=0x7f54bc0a52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 shutdown_connections 2023-12-22T08:40:49.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.223+0000 7f54c4210640 1 -- 172.21.15.31:0/3805857594 wait complete. 2023-12-22T08:40:49.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:49.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.339+0000 7f1c654d5640 1 Processor -- start 2023-12-22T08:40:49.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.340+0000 7f1c654d5640 1 -- start start 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.340+0000 7f1c654d5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.340+0000 7f1c654d5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c600bb310 con 0x7f1c600ba550 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.340+0000 7f1c654d5640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c600bf960 con 0x7f1c6006a6d0 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.340+0000 7f1c654d5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600bb5b0 con 0x7f1c601544e0 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.340+0000 7f1c5e7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1c600ba550 0x7f1c600b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47880/0 (socket says 172.21.15.31:47880) 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.340+0000 7f1c5e7fc640 1 -- 172.21.15.31:0/3746698993 learned_addr learned my addr 172.21.15.31:0/3746698993 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5f7fe640 1 --2- 172.21.15.31:0/3746698993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5dffb640 1 -- 172.21.15.31:0/3746698993 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293038281 0 0) 0x7f1c600bb310 con 0x7f1c600ba550 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5dffb640 1 -- 172.21.15.31:0/3746698993 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c4c003520 con 0x7f1c600ba550 2023-12-22T08:40:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5dffb640 1 -- 172.21.15.31:0/3746698993 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514826899 0 0) 0x7f1c600bf960 con 0x7f1c6006a6d0 2023-12-22T08:40:49.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5dffb640 1 -- 172.21.15.31:0/3746698993 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c600bb310 con 0x7f1c6006a6d0 2023-12-22T08:40:49.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5dffb640 1 -- 172.21.15.31:0/3746698993 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1162854762 0 0) 0x7f1c4c003520 con 0x7f1c600ba550 2023-12-22T08:40:49.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5f7fe640 1 -- 172.21.15.31:0/3746698993 >> v1:172.21.15.69:6789/0 conn(0x7f1c6006a6d0 legacy=0x7f1c6014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5f7fe640 1 -- 172.21.15.31:0/3746698993 >> v1:172.21.15.31:6789/0 conn(0x7f1c600ba550 legacy=0x7f1c600b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.341+0000 7f1c5f7fe640 1 -- 172.21.15.31:0/3746698993 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600c0120 con 0x7f1c601544e0 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c5f7fe640 1 --2- 172.21.15.31:0/3746698993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601568d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009dc0 tx=0x7f1c5002bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa9e1e26db267f7b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c5dffb640 1 -- 172.21.15.31:0/3746698993 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c48001670 con 0x7f1c601544e0 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c5dffb640 1 -- 172.21.15.31:0/3746698993 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5002c910 con 0x7f1c601544e0 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c5dffb640 1 -- 172.21.15.31:0/3746698993 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5002cc80 con 0x7f1c601544e0 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c654d5640 1 -- 172.21.15.31:0/3746698993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 msgr2=0x7f1c601568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c654d5640 1 --2- 172.21.15.31:0/3746698993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601568d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009dc0 tx=0x7f1c5002bde0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c654d5640 1 -- 172.21.15.31:0/3746698993 shutdown_connections 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c654d5640 1 --2- 172.21.15.31:0/3746698993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601568d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c654d5640 1 -- 172.21.15.31:0/3746698993 >> 172.21.15.31:0/3746698993 conn(0x7f1c600c0350 msgr2=0x7f1c600c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c654d5640 1 -- 172.21.15.31:0/3746698993 shutdown_connections 2023-12-22T08:40:49.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.342+0000 7f1c654d5640 1 -- 172.21.15.31:0/3746698993 wait complete. 2023-12-22T08:40:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c654d5640 1 Processor -- start 2023-12-22T08:40:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c654d5640 1 -- start start 2023-12-22T08:40:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c654d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6006a6d0 0x7f1c60147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c654d5640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c600ba550 0x7f1c60147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c654d5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c654d5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60147580 con 0x7f1c6006a6d0 2023-12-22T08:40:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c654d5640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c601dfa20 con 0x7f1c600ba550 2023-12-22T08:40:49.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c654d5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c601486d0 con 0x7f1c601544e0 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c5effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6006a6d0 0x7f1c60147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c5effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6006a6d0 0x7f1c60147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54160/0 (socket says 172.21.15.31:54160) 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c5effd640 1 -- 172.21.15.31:0/4111612885 learned_addr learned my addr 172.21.15.31:0/4111612885 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c5e7fc640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c600ba550 0x7f1c60147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.344+0000 7f1c5f7fe640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c5effd640 1 -- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 msgr2=0x7f1c601440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c5effd640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c5effd640 1 -- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c600ba550 msgr2=0x7f1c60147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c5effd640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c600ba550 0x7f1c60147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c5effd640 1 -- 172.21.15.31:0/4111612885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50009a70 con 0x7f1c6006a6d0 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c5effd640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6006a6d0 0x7f1c60147ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800c490 tx=0x7f1c5800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c577fe640 1 -- 172.21.15.31:0/4111612885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c580052d0 con 0x7f1c6006a6d0 2023-12-22T08:40:49.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c577fe640 1 -- 172.21.15.31:0/4111612885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c58005430 con 0x7f1c6006a6d0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c601dfcc0 con 0x7f1c6006a6d0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c577fe640 1 -- 172.21.15.31:0/4111612885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58012870 con 0x7f1c6006a6d0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.345+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c601e0280 con 0x7f1c6006a6d0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.346+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6014ae50 con 0x7f1c6006a6d0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.346+0000 7f1c577fe640 1 -- 172.21.15.31:0/4111612885 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c580129d0 con 0x7f1c6006a6d0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.347+0000 7f1c577fe640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1c4006a430 0x7f1c4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.347+0000 7f1c577fe640 1 -- 172.21.15.31:0/4111612885 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c58088390 con 0x7f1c6006a6d0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.347+0000 7f1c5e7fc640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1c4006a430 0x7f1c4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.348+0000 7f1c5e7fc640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1c4006a430 0x7f1c4006c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c600bacd0 tx=0x7f1c48001150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.351+0000 7f1c577fe640 1 -- 172.21.15.31:0/4111612885 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1c58053a20 con 0x7f1c6006a6d0 2023-12-22T08:40:49.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.527+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c600a62d0 con 0x7f1c6006a6d0 2023-12-22T08:40:49.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.528+0000 7f1c577fe640 1 -- 172.21.15.31:0/4111612885 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f1c58057040 con 0x7f1c6006a6d0 2023-12-22T08:40:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:49.530 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:49.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1c4006a430 msgr2=0x7f1c4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1c4006a430 0x7f1c4006c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c600bacd0 tx=0x7f1c48001150 comp rx=0 tx=0).stop 2023-12-22T08:40:49.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6006a6d0 msgr2=0x7f1c60147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6006a6d0 0x7f1c60147ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800c490 tx=0x7f1c5800c950 comp rx=0 tx=0).stop 2023-12-22T08:40:49.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 shutdown_connections 2023-12-22T08:40:49.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1c4006a430 0x7f1c4006c8f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c601544e0 0x7f1c601440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c600ba550 0x7f1c60147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 --2- 172.21.15.31:0/4111612885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6006a6d0 0x7f1c60147ff0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 >> 172.21.15.31:0/4111612885 conn(0x7f1c600c0350 msgr2=0x7f1c600a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 shutdown_connections 2023-12-22T08:40:49.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.530+0000 7f1c654d5640 1 -- 172.21.15.31:0/4111612885 wait complete. 2023-12-22T08:40:49.543 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:40:49.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.646+0000 7ff5ce70a640 1 Processor -- start 2023-12-22T08:40:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.646+0000 7ff5ce70a640 1 -- start start 2023-12-22T08:40:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5ce70a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c806a6d0 0x7ff5c814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5ce70a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c80bb310 con 0x7ff5c814b1f0 2023-12-22T08:40:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5ce70a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c80bf960 con 0x7ff5c80ba550 2023-12-22T08:40:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5ce70a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80bb5b0 con 0x7ff5c806a6d0 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c77fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff5c814b1f0 0x7ff5c80b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47884/0 (socket says 172.21.15.31:47884) 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c77fe640 1 -- 172.21.15.31:0/637640168 learned_addr learned my addr 172.21.15.31:0/637640168 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c7fff640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c806a6d0 0x7ff5c814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208687625 0 0) 0x7ff5c80bb310 con 0x7ff5c814b1f0 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b0003520 con 0x7ff5c814b1f0 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1822253355 0 0) 0x7ff5b0003520 con 0x7ff5c814b1f0 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c806a6d0 msgr2=0x7ff5c814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c6ffd640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c806a6d0 0x7ff5c814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.647+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 >> v1:172.21.15.69:6789/0 conn(0x7ff5c80ba550 legacy=0x7ff5c81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c80c0120 con 0x7ff5c814b1f0 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7ff5bc001670 con 0x7ff5c814b1f0 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 >> v1:172.21.15.31:6789/0 conn(0x7ff5c814b1f0 legacy=0x7ff5c80b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b00039a0 0x7ff5b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c806a6d0 0x7ff5b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5b0004d00 0x7ff5b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80bb5b0 con 0x7ff5b0004d00 2023-12-22T08:40:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b000ba30 con 0x7ff5b00039a0 2023-12-22T08:40:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b000bbf0 con 0x7ff5c806a6d0 2023-12-22T08:40:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5ccca7640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5b0004d00 0x7ff5b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c77fe640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c806a6d0 0x7ff5b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5c7fff640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b00039a0 0x7ff5b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5ccca7640 1 -- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c806a6d0 msgr2=0x7ff5b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5ccca7640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c806a6d0 0x7ff5b00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5ccca7640 1 -- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b00039a0 msgr2=0x7ff5b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5ccca7640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5b00039a0 0x7ff5b0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.648+0000 7ff5ccca7640 1 -- 172.21.15.31:0/637640168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0003520 con 0x7ff5b0004d00 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5ccca7640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5b0004d00 0x7ff5b0005180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80bf580 tx=0x7ff5b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344558ce9896f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0003b70 con 0x7ff5b0004d00 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c0003cd0 con 0x7ff5b0004d00 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5c6ffd640 1 -- 172.21.15.31:0/637640168 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0005310 con 0x7ff5b0004d00 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5ce70a640 1 -- 172.21.15.31:0/637640168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5b0004d00 msgr2=0x7ff5b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5ce70a640 1 --2- 172.21.15.31:0/637640168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5b0004d00 0x7ff5b0005180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80bf580 tx=0x7ff5b00057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5ccca7640 1 -- 172.21.15.31:0/637640168 reap_dead start 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5ce70a640 1 -- 172.21.15.31:0/637640168 shutdown_connections 2023-12-22T08:40:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.649+0000 7ff5ce70a640 1 -- 172.21.15.31:0/637640168 >> 172.21.15.31:0/637640168 conn(0x7ff5c80c0350 msgr2=0x7ff5c80c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.650+0000 7ff5ce70a640 1 -- 172.21.15.31:0/637640168 shutdown_connections 2023-12-22T08:40:49.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.650+0000 7ff5ce70a640 1 -- 172.21.15.31:0/637640168 wait complete. 2023-12-22T08:40:49.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5ce70a640 1 Processor -- start 2023-12-22T08:40:49.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5ce70a640 1 -- start start 2023-12-22T08:40:49.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5ce70a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5c80a56e0 0x7ff5c81d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5ce70a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c80b6ec0 0x7ff5c80b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5ce70a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c81e0960 0x7ff5c80b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5ce70a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81d17f0 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5ce70a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81dfc70 con 0x7ff5c80a56e0 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5ce70a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c80b5ef0 con 0x7ff5c81e0960 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5c77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c80b6ec0 0x7ff5c80b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.651+0000 7ff5c77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c80b6ec0 0x7ff5c80b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54186/0 (socket says 172.21.15.31:54186) 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c77fe640 1 -- 172.21.15.31:0/64600381 learned_addr learned my addr 172.21.15.31:0/64600381 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c7fff640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5c80a56e0 0x7ff5c81d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5ccca7640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c81e0960 0x7ff5c80b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c77fe640 1 -- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c81e0960 msgr2=0x7ff5c80b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c77fe640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c81e0960 0x7ff5c80b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c77fe640 1 -- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5c80a56e0 msgr2=0x7ff5c81d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c77fe640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5c80a56e0 0x7ff5c81d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c77fe640 1 -- 172.21.15.31:0/64600381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c81dfe80 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5ccca7640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c81e0960 0x7ff5c80b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c77fe640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c80b6ec0 0x7ff5c80b59b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0072c0 tx=0x7ff5bc0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c4ff9640 1 -- 172.21.15.31:0/64600381 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00f940 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c4ff9640 1 -- 172.21.15.31:0/64600381 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00fae0 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c81e0160 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5c4ff9640 1 -- 172.21.15.31:0/64600381 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00fe90 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.652+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c80a5ac0 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.653+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c81e0680 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.653+0000 7ff5c4ff9640 1 -- 172.21.15.31:0/64600381 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff5bc01d460 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.654+0000 7ff5c4ff9640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff5b406a460 0x7ff5b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.654+0000 7ff5c4ff9640 1 -- 172.21.15.31:0/64600381 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5bc0889d0 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.654+0000 7ff5c7fff640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff5b406a460 0x7ff5b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.655+0000 7ff5c7fff640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff5b406a460 0x7ff5b406c920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009bc0 tx=0x7ff5b8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:49.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.658+0000 7ff5c4ff9640 1 -- 172.21.15.31:0/64600381 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff5c81e0680 con 0x7ff5c80b6ec0 2023-12-22T08:40:49.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.831+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5c80c1160 con 0x7ff5b406a460 2023-12-22T08:40:49.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.839+0000 7ff5c4ff9640 1 -- 172.21.15.31:0/64600381 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264645 (secure 0 0 0) 0x7ff5b8019070 con 0x7ff5b406a460 2023-12-22T08:40:49.844 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:49.846 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff5b406a460 msgr2=0x7ff5b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff5b406a460 0x7ff5b406c920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009bc0 tx=0x7ff5b8009190 comp rx=0 tx=0).stop 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c80b6ec0 msgr2=0x7ff5c80b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c80b6ec0 0x7ff5c80b59b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0072c0 tx=0x7ff5bc0076c0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 shutdown_connections 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff5b406a460 0x7ff5b406c920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff5c81e0960 0x7ff5c80b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c80b6ec0 0x7ff5c80b59b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 --2- 172.21.15.31:0/64600381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5c80a56e0 0x7ff5c81d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 >> 172.21.15.31:0/64600381 conn(0x7ff5c80c0350 msgr2=0x7ff5c80c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 shutdown_connections 2023-12-22T08:40:49.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.842+0000 7ff5ce70a640 1 -- 172.21.15.31:0/64600381 wait complete. 2023-12-22T08:40:49.855 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-22T08:40:49.783482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218404,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756316,"statfs":{"total":773094113280,"available":772870467584,"internally_reserved":0,"allocated":2854912,"data_stored":1733744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.295603"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398792+0000","last_change":"2023-12-22T08:40:45.883952+0000","last_active":"2023-12-22T08:40:48.398792+0000","last_peered":"2023-12-22T08:40:48.398792+0000","last_clean":"2023-12-22T08:40:48.398792+0000","last_became_active":"2023-12-22T08:40:45.883513+0000","last_became_peered":"2023-12-22T08:40:45.883513+0000","last_unstale":"2023-12-22T08:40:48.398792+0000","last_undegraded":"2023-12-22T08:40:48.398792+0000","last_fullsized":"2023-12-22T08:40:48.398792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:30.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398236+0000","last_change":"2023-12-22T08:40:45.878775+0000","last_active":"2023-12-22T08:40:48.398236+0000","last_peered":"2023-12-22T08:40:48.398236+0000","last_clean":"2023-12-22T08:40:48.398236+0000","last_became_active":"2023-12-22T08:40:45.878528+0000","last_became_peered":"2023-12-22T08:40:45.878528+0000","last_unstale":"2023-12-22T08:40:48.398236+0000","last_undegraded":"2023-12-22T08:40:48.398236+0000","last_fullsized":"2023-12-22T08:40:48.398236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868312+0000","last_change":"2023-12-22T08:40:45.880293+0000","last_active":"2023-12-22T08:40:46.868312+0000","last_peered":"2023-12-22T08:40:46.868312+0000","last_clean":"2023-12-22T08:40:46.868312+0000","last_became_active":"2023-12-22T08:40:45.880038+0000","last_became_peered":"2023-12-22T08:40:45.880038+0000","last_unstale":"2023-12-22T08:40:46.868312+0000","last_undegraded":"2023-12-22T08:40:46.868312+0000","last_fullsized":"2023-12-22T08:40:46.868312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947206+0000","last_change":"2023-12-22T08:40:45.892847+0000","last_active":"2023-12-22T08:40:47.947206+0000","last_peered":"2023-12-22T08:40:47.947206+0000","last_clean":"2023-12-22T08:40:47.947206+0000","last_became_active":"2023-12-22T08:40:45.892443+0000","last_became_peered":"2023-12-22T08:40:45.892443+0000","last_unstale":"2023-12-22T08:40:47.947206+0000","last_undegraded":"2023-12-22T08:40:47.947206+0000","last_fullsized":"2023-12-22T08:40:47.947206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:33.421892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398449+0000","last_change":"2023-12-22T08:40:45.884154+0000","last_active":"2023-12-22T08:40:48.398449+0000","last_peered":"2023-12-22T08:40:48.398449+0000","last_clean":"2023-12-22T08:40:48.398449+0000","last_became_active":"2023-12-22T08:40:45.883879+0000","last_became_peered":"2023-12-22T08:40:45.883879+0000","last_unstale":"2023-12-22T08:40:48.398449+0000","last_undegraded":"2023-12-22T08:40:48.398449+0000","last_fullsized":"2023-12-22T08:40:48.398449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:30.540430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.946964+0000","last_change":"2023-12-22T08:40:45.889896+0000","last_active":"2023-12-22T08:40:47.946964+0000","last_peered":"2023-12-22T08:40:47.946964+0000","last_clean":"2023-12-22T08:40:47.946964+0000","last_became_active":"2023-12-22T08:40:45.888864+0000","last_became_peered":"2023-12-22T08:40:45.888864+0000","last_unstale":"2023-12-22T08:40:47.946964+0000","last_undegraded":"2023-12-22T08:40:47.946964+0000","last_fullsized":"2023-12-22T08:40:47.946964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398256+0000","last_change":"2023-12-22T08:40:45.881811+0000","last_active":"2023-12-22T08:40:48.398256+0000","last_peered":"2023-12-22T08:40:48.398256+0000","last_clean":"2023-12-22T08:40:48.398256+0000","last_became_active":"2023-12-22T08:40:45.881578+0000","last_became_peered":"2023-12-22T08:40:45.881578+0000","last_unstale":"2023-12-22T08:40:48.398256+0000","last_undegraded":"2023-12-22T08:40:48.398256+0000","last_fullsized":"2023-12-22T08:40:48.398256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:16.186426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868647+0000","last_change":"2023-12-22T08:40:45.892116+0000","last_active":"2023-12-22T08:40:46.868647+0000","last_peered":"2023-12-22T08:40:46.868647+0000","last_clean":"2023-12-22T08:40:46.868647+0000","last_became_active":"2023-12-22T08:40:45.891946+0000","last_became_peered":"2023-12-22T08:40:45.891946+0000","last_unstale":"2023-12-22T08:40:46.868647+0000","last_undegraded":"2023-12-22T08:40:46.868647+0000","last_fullsized":"2023-12-22T08:40:46.868647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398786+0000","last_change":"2023-12-22T08:40:45.890365+0000","last_active":"2023-12-22T08:40:48.398786+0000","last_peered":"2023-12-22T08:40:48.398786+0000","last_clean":"2023-12-22T08:40:48.398786+0000","last_became_active":"2023-12-22T08:40:45.890130+0000","last_became_peered":"2023-12-22T08:40:45.890130+0000","last_unstale":"2023-12-22T08:40:48.398786+0000","last_undegraded":"2023-12-22T08:40:48.398786+0000","last_fullsized":"2023-12-22T08:40:48.398786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:13.809967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975214+0000","last_change":"2023-12-22T08:40:45.889288+0000","last_active":"2023-12-22T08:40:47.975214+0000","last_peered":"2023-12-22T08:40:47.975214+0000","last_clean":"2023-12-22T08:40:47.975214+0000","last_became_active":"2023-12-22T08:40:45.889044+0000","last_became_peered":"2023-12-22T08:40:45.889044+0000","last_unstale":"2023-12-22T08:40:47.975214+0000","last_undegraded":"2023-12-22T08:40:47.975214+0000","last_fullsized":"2023-12-22T08:40:47.975214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975064+0000","last_change":"2023-12-22T08:40:45.890399+0000","last_active":"2023-12-22T08:40:47.975064+0000","last_peered":"2023-12-22T08:40:47.975064+0000","last_clean":"2023-12-22T08:40:47.975064+0000","last_became_active":"2023-12-22T08:40:45.890142+0000","last_became_peered":"2023-12-22T08:40:45.890142+0000","last_unstale":"2023-12-22T08:40:47.975064+0000","last_undegraded":"2023-12-22T08:40:47.975064+0000","last_fullsized":"2023-12-22T08:40:47.975064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869515+0000","last_change":"2023-12-22T08:40:45.877838+0000","last_active":"2023-12-22T08:40:46.869515+0000","last_peered":"2023-12-22T08:40:46.869515+0000","last_clean":"2023-12-22T08:40:46.869515+0000","last_became_active":"2023-12-22T08:40:45.877514+0000","last_became_peered":"2023-12-22T08:40:45.877514+0000","last_unstale":"2023-12-22T08:40:46.869515+0000","last_undegraded":"2023-12-22T08:40:46.869515+0000","last_fullsized":"2023-12-22T08:40:46.869515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:05.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868964+0000","last_change":"2023-12-22T08:40:45.891488+0000","last_active":"2023-12-22T08:40:46.868964+0000","last_peered":"2023-12-22T08:40:46.868964+0000","last_clean":"2023-12-22T08:40:46.868964+0000","last_became_active":"2023-12-22T08:40:45.891337+0000","last_became_peered":"2023-12-22T08:40:45.891337+0000","last_unstale":"2023-12-22T08:40:46.868964+0000","last_undegraded":"2023-12-22T08:40:46.868964+0000","last_fullsized":"2023-12-22T08:40:46.868964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868225+0000","last_change":"2023-12-22T08:40:45.878437+0000","last_active":"2023-12-22T08:40:46.868225+0000","last_peered":"2023-12-22T08:40:46.868225+0000","last_clean":"2023-12-22T08:40:46.868225+0000","last_became_active":"2023-12-22T08:40:45.878165+0000","last_became_peered":"2023-12-22T08:40:45.878165+0000","last_unstale":"2023-12-22T08:40:46.868225+0000","last_undegraded":"2023-12-22T08:40:46.868225+0000","last_fullsized":"2023-12-22T08:40:46.868225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398069+0000","last_change":"2023-12-22T08:40:45.878993+0000","last_active":"2023-12-22T08:40:48.398069+0000","last_peered":"2023-12-22T08:40:48.398069+0000","last_clean":"2023-12-22T08:40:48.398069+0000","last_became_active":"2023-12-22T08:40:45.878204+0000","last_became_peered":"2023-12-22T08:40:45.878204+0000","last_unstale":"2023-12-22T08:40:48.398069+0000","last_undegraded":"2023-12-22T08:40:48.398069+0000","last_fullsized":"2023-12-22T08:40:48.398069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.946898+0000","last_change":"2023-12-22T08:40:45.886532+0000","last_active":"2023-12-22T08:40:47.946898+0000","last_peered":"2023-12-22T08:40:47.946898+0000","last_clean":"2023-12-22T08:40:47.946898+0000","last_became_active":"2023-12-22T08:40:45.886207+0000","last_became_peered":"2023-12-22T08:40:45.886207+0000","last_unstale":"2023-12-22T08:40:47.946898+0000","last_undegraded":"2023-12-22T08:40:47.946898+0000","last_fullsized":"2023-12-22T08:40:47.946898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947576+0000","last_change":"2023-12-22T08:40:45.887660+0000","last_active":"2023-12-22T08:40:47.947576+0000","last_peered":"2023-12-22T08:40:47.947576+0000","last_clean":"2023-12-22T08:40:47.947576+0000","last_became_active":"2023-12-22T08:40:45.887406+0000","last_became_peered":"2023-12-22T08:40:45.887406+0000","last_unstale":"2023-12-22T08:40:47.947576+0000","last_undegraded":"2023-12-22T08:40:47.947576+0000","last_fullsized":"2023-12-22T08:40:47.947576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397941+0000","last_change":"2023-12-22T08:40:45.887556+0000","last_active":"2023-12-22T08:40:48.397941+0000","last_peered":"2023-12-22T08:40:48.397941+0000","last_clean":"2023-12-22T08:40:48.397941+0000","last_became_active":"2023-12-22T08:40:45.887294+0000","last_became_peered":"2023-12-22T08:40:45.887294+0000","last_unstale":"2023-12-22T08:40:48.397941+0000","last_undegraded":"2023-12-22T08:40:48.397941+0000","last_fullsized":"2023-12-22T08:40:48.397941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:45.489511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398722+0000","last_change":"2023-12-22T08:40:45.883598+0000","last_active":"2023-12-22T08:40:48.398722+0000","last_peered":"2023-12-22T08:40:48.398722+0000","last_clean":"2023-12-22T08:40:48.398722+0000","last_became_active":"2023-12-22T08:40:45.883319+0000","last_became_peered":"2023-12-22T08:40:45.883319+0000","last_unstale":"2023-12-22T08:40:48.398722+0000","last_undegraded":"2023-12-22T08:40:48.398722+0000","last_fullsized":"2023-12-22T08:40:48.398722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:33.421892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975025+0000","last_change":"2023-12-22T08:40:45.881672+0000","last_active":"2023-12-22T08:40:47.975025+0000","last_peered":"2023-12-22T08:40:47.975025+0000","last_clean":"2023-12-22T08:40:47.975025+0000","last_became_active":"2023-12-22T08:40:45.881403+0000","last_became_peered":"2023-12-22T08:40:45.881403+0000","last_unstale":"2023-12-22T08:40:47.975025+0000","last_undegraded":"2023-12-22T08:40:47.975025+0000","last_fullsized":"2023-12-22T08:40:47.975025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868566+0000","last_change":"2023-12-22T08:40:45.875815+0000","last_active":"2023-12-22T08:40:46.868566+0000","last_peered":"2023-12-22T08:40:46.868566+0000","last_clean":"2023-12-22T08:40:46.868566+0000","last_became_active":"2023-12-22T08:40:45.875552+0000","last_became_peered":"2023-12-22T08:40:45.875552+0000","last_unstale":"2023-12-22T08:40:46.868566+0000","last_undegraded":"2023-12-22T08:40:46.868566+0000","last_fullsized":"2023-12-22T08:40:46.868566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947204+0000","last_change":"2023-12-22T08:40:45.889509+0000","last_active":"2023-12-22T08:40:47.947204+0000","last_peered":"2023-12-22T08:40:47.947204+0000","last_clean":"2023-12-22T08:40:47.947204+0000","last_became_active":"2023-12-22T08:40:45.889147+0000","last_became_peered":"2023-12-22T08:40:45.889147+0000","last_unstale":"2023-12-22T08:40:47.947204+0000","last_undegraded":"2023-12-22T08:40:47.947204+0000","last_fullsized":"2023-12-22T08:40:47.947204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868668+0000","last_change":"2023-12-22T08:40:45.888792+0000","last_active":"2023-12-22T08:40:46.868668+0000","last_peered":"2023-12-22T08:40:46.868668+0000","last_clean":"2023-12-22T08:40:46.868668+0000","last_became_active":"2023-12-22T08:40:45.888190+0000","last_became_peered":"2023-12-22T08:40:45.888190+0000","last_unstale":"2023-12-22T08:40:46.868668+0000","last_undegraded":"2023-12-22T08:40:46.868668+0000","last_fullsized":"2023-12-22T08:40:46.868668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:14:22.484265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947028+0000","last_change":"2023-12-22T08:40:45.893300+0000","last_active":"2023-12-22T08:40:47.947028+0000","last_peered":"2023-12-22T08:40:47.947028+0000","last_clean":"2023-12-22T08:40:47.947028+0000","last_became_active":"2023-12-22T08:40:45.892789+0000","last_became_peered":"2023-12-22T08:40:45.892789+0000","last_unstale":"2023-12-22T08:40:47.947028+0000","last_undegraded":"2023-12-22T08:40:47.947028+0000","last_fullsized":"2023-12-22T08:40:47.947028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:30.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869172+0000","last_change":"2023-12-22T08:40:45.888716+0000","last_active":"2023-12-22T08:40:46.869172+0000","last_peered":"2023-12-22T08:40:46.869172+0000","last_clean":"2023-12-22T08:40:46.869172+0000","last_became_active":"2023-12-22T08:40:45.888164+0000","last_became_peered":"2023-12-22T08:40:45.888164+0000","last_unstale":"2023-12-22T08:40:46.869172+0000","last_undegraded":"2023-12-22T08:40:46.869172+0000","last_fullsized":"2023-12-22T08:40:46.869172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975264+0000","last_change":"2023-12-22T08:40:45.875528+0000","last_active":"2023-12-22T08:40:47.975264+0000","last_peered":"2023-12-22T08:40:47.975264+0000","last_clean":"2023-12-22T08:40:47.975264+0000","last_became_active":"2023-12-22T08:40:45.875275+0000","last_became_peered":"2023-12-22T08:40:45.875275+0000","last_unstale":"2023-12-22T08:40:47.975264+0000","last_undegraded":"2023-12-22T08:40:47.975264+0000","last_fullsized":"2023-12-22T08:40:47.975264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398211+0000","last_change":"2023-12-22T08:40:45.884223+0000","last_active":"2023-12-22T08:40:48.398211+0000","last_peered":"2023-12-22T08:40:48.398211+0000","last_clean":"2023-12-22T08:40:48.398211+0000","last_became_active":"2023-12-22T08:40:45.883970+0000","last_became_peered":"2023-12-22T08:40:45.883970+0000","last_unstale":"2023-12-22T08:40:48.398211+0000","last_undegraded":"2023-12-22T08:40:48.398211+0000","last_fullsized":"2023-12-22T08:40:48.398211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868912+0000","last_change":"2023-12-22T08:40:45.882599+0000","last_active":"2023-12-22T08:40:46.868912+0000","last_peered":"2023-12-22T08:40:46.868912+0000","last_clean":"2023-12-22T08:40:46.868912+0000","last_became_active":"2023-12-22T08:40:45.882327+0000","last_became_peered":"2023-12-22T08:40:45.882327+0000","last_unstale":"2023-12-22T08:40:46.868912+0000","last_undegraded":"2023-12-22T08:40:46.868912+0000","last_fullsized":"2023-12-22T08:40:46.868912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868649+0000","last_change":"2023-12-22T08:40:45.889519+0000","last_active":"2023-12-22T08:40:46.868649+0000","last_peered":"2023-12-22T08:40:46.868649+0000","last_clean":"2023-12-22T08:40:46.868649+0000","last_became_active":"2023-12-22T08:40:45.889215+0000","last_became_peered":"2023-12-22T08:40:45.889215+0000","last_unstale":"2023-12-22T08:40:46.868649+0000","last_undegraded":"2023-12-22T08:40:46.868649+0000","last_fullsized":"2023-12-22T08:40:46.868649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947237+0000","last_change":"2023-12-22T08:40:45.893059+0000","last_active":"2023-12-22T08:40:47.947237+0000","last_peered":"2023-12-22T08:40:47.947237+0000","last_clean":"2023-12-22T08:40:47.947237+0000","last_became_active":"2023-12-22T08:40:45.892669+0000","last_became_peered":"2023-12-22T08:40:45.892669+0000","last_unstale":"2023-12-22T08:40:47.947237+0000","last_undegraded":"2023-12-22T08:40:47.947237+0000","last_fullsized":"2023-12-22T08:40:47.947237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:13.809967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397775+0000","last_change":"2023-12-22T08:40:45.889241+0000","last_active":"2023-12-22T08:40:48.397775+0000","last_peered":"2023-12-22T08:40:48.397775+0000","last_clean":"2023-12-22T08:40:48.397775+0000","last_became_active":"2023-12-22T08:40:45.888986+0000","last_became_peered":"2023-12-22T08:40:45.888986+0000","last_unstale":"2023-12-22T08:40:48.397775+0000","last_undegraded":"2023-12-22T08:40:48.397775+0000","last_fullsized":"2023-12-22T08:40:48.397775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:05.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974913+0000","last_change":"2023-12-22T08:40:45.881924+0000","last_active":"2023-12-22T08:40:47.974913+0000","last_peered":"2023-12-22T08:40:47.974913+0000","last_clean":"2023-12-22T08:40:47.974913+0000","last_became_active":"2023-12-22T08:40:45.880927+0000","last_became_peered":"2023-12-22T08:40:45.880927+0000","last_unstale":"2023-12-22T08:40:47.974913+0000","last_undegraded":"2023-12-22T08:40:47.974913+0000","last_fullsized":"2023-12-22T08:40:47.974913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868974+0000","last_change":"2023-12-22T08:40:45.878836+0000","last_active":"2023-12-22T08:40:46.868974+0000","last_peered":"2023-12-22T08:40:46.868974+0000","last_clean":"2023-12-22T08:40:46.868974+0000","last_became_active":"2023-12-22T08:40:45.878561+0000","last_became_peered":"2023-12-22T08:40:45.878561+0000","last_unstale":"2023-12-22T08:40:46.868974+0000","last_undegraded":"2023-12-22T08:40:46.868974+0000","last_fullsized":"2023-12-22T08:40:46.868974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:26.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869042+0000","last_change":"2023-12-22T08:40:45.512780+0000","last_active":"2023-12-22T08:40:46.869042+0000","last_peered":"2023-12-22T08:40:46.869042+0000","last_clean":"2023-12-22T08:40:46.869042+0000","last_became_active":"2023-12-22T08:40:45.512502+0000","last_became_peered":"2023-12-22T08:40:45.512502+0000","last_unstale":"2023-12-22T08:40:46.869042+0000","last_undegraded":"2023-12-22T08:40:46.869042+0000","last_fullsized":"2023-12-22T08:40:46.869042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:27.751410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868831+0000","last_change":"2023-12-22T08:40:45.876753+0000","last_active":"2023-12-22T08:40:46.868831+0000","last_peered":"2023-12-22T08:40:46.868831+0000","last_clean":"2023-12-22T08:40:46.868831+0000","last_became_active":"2023-12-22T08:40:45.876192+0000","last_became_peered":"2023-12-22T08:40:45.876192+0000","last_unstale":"2023-12-22T08:40:46.868831+0000","last_undegraded":"2023-12-22T08:40:46.868831+0000","last_fullsized":"2023-12-22T08:40:46.868831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974998+0000","last_change":"2023-12-22T08:40:45.509309+0000","last_active":"2023-12-22T08:40:47.974998+0000","last_peered":"2023-12-22T08:40:47.974998+0000","last_clean":"2023-12-22T08:40:47.974998+0000","last_became_active":"2023-12-22T08:40:45.508805+0000","last_became_peered":"2023-12-22T08:40:45.508805+0000","last_unstale":"2023-12-22T08:40:47.974998+0000","last_undegraded":"2023-12-22T08:40:47.974998+0000","last_fullsized":"2023-12-22T08:40:47.974998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868799+0000","last_change":"2023-12-22T08:40:45.511261+0000","last_active":"2023-12-22T08:40:46.868799+0000","last_peered":"2023-12-22T08:40:46.868799+0000","last_clean":"2023-12-22T08:40:46.868799+0000","last_became_active":"2023-12-22T08:40:45.510991+0000","last_became_peered":"2023-12-22T08:40:45.510991+0000","last_unstale":"2023-12-22T08:40:46.868799+0000","last_undegraded":"2023-12-22T08:40:46.868799+0000","last_fullsized":"2023-12-22T08:40:46.868799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868743+0000","last_change":"2023-12-22T08:40:45.885554+0000","last_active":"2023-12-22T08:40:46.868743+0000","last_peered":"2023-12-22T08:40:46.868743+0000","last_clean":"2023-12-22T08:40:46.868743+0000","last_became_active":"2023-12-22T08:40:45.885316+0000","last_became_peered":"2023-12-22T08:40:45.885316+0000","last_unstale":"2023-12-22T08:40:46.868743+0000","last_undegraded":"2023-12-22T08:40:46.868743+0000","last_fullsized":"2023-12-22T08:40:46.868743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947033+0000","last_change":"2023-12-22T08:40:45.504497+0000","last_active":"2023-12-22T08:40:47.947033+0000","last_peered":"2023-12-22T08:40:47.947033+0000","last_clean":"2023-12-22T08:40:47.947033+0000","last_became_active":"2023-12-22T08:40:45.504227+0000","last_became_peered":"2023-12-22T08:40:45.504227+0000","last_unstale":"2023-12-22T08:40:47.947033+0000","last_undegraded":"2023-12-22T08:40:47.947033+0000","last_fullsized":"2023-12-22T08:40:47.947033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397985+0000","last_change":"2023-12-22T08:40:45.884410+0000","last_active":"2023-12-22T08:40:48.397985+0000","last_peered":"2023-12-22T08:40:48.397985+0000","last_clean":"2023-12-22T08:40:48.397985+0000","last_became_active":"2023-12-22T08:40:45.884074+0000","last_became_peered":"2023-12-22T08:40:45.884074+0000","last_unstale":"2023-12-22T08:40:48.397985+0000","last_undegraded":"2023-12-22T08:40:48.397985+0000","last_fullsized":"2023-12-22T08:40:48.397985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975082+0000","last_change":"2023-12-22T08:40:45.511242+0000","last_active":"2023-12-22T08:40:47.975082+0000","last_peered":"2023-12-22T08:40:47.975082+0000","last_clean":"2023-12-22T08:40:47.975082+0000","last_became_active":"2023-12-22T08:40:45.510960+0000","last_became_peered":"2023-12-22T08:40:45.510960+0000","last_unstale":"2023-12-22T08:40:47.975082+0000","last_undegraded":"2023-12-22T08:40:47.975082+0000","last_fullsized":"2023-12-22T08:40:47.975082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947286+0000","last_change":"2023-12-22T08:40:45.888628+0000","last_active":"2023-12-22T08:40:47.947286+0000","last_peered":"2023-12-22T08:40:47.947286+0000","last_clean":"2023-12-22T08:40:47.947286+0000","last_became_active":"2023-12-22T08:40:45.888351+0000","last_became_peered":"2023-12-22T08:40:45.888351+0000","last_unstale":"2023-12-22T08:40:47.947286+0000","last_undegraded":"2023-12-22T08:40:47.947286+0000","last_fullsized":"2023-12-22T08:40:47.947286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:16.186426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947394+0000","last_change":"2023-12-22T08:40:45.507232+0000","last_active":"2023-12-22T08:40:47.947394+0000","last_peered":"2023-12-22T08:40:47.947394+0000","last_clean":"2023-12-22T08:40:47.947394+0000","last_became_active":"2023-12-22T08:40:45.506953+0000","last_became_peered":"2023-12-22T08:40:45.506953+0000","last_unstale":"2023-12-22T08:40:47.947394+0000","last_undegraded":"2023-12-22T08:40:47.947394+0000","last_fullsized":"2023-12-22T08:40:47.947394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868557+0000","last_change":"2023-12-22T08:40:45.890659+0000","last_active":"2023-12-22T08:40:46.868557+0000","last_peered":"2023-12-22T08:40:46.868557+0000","last_clean":"2023-12-22T08:40:46.868557+0000","last_became_active":"2023-12-22T08:40:45.889673+0000","last_became_peered":"2023-12-22T08:40:45.889673+0000","last_unstale":"2023-12-22T08:40:46.868557+0000","last_undegraded":"2023-12-22T08:40:46.868557+0000","last_fullsized":"2023-12-22T08:40:46.868557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398207+0000","last_change":"2023-12-22T08:40:45.507641+0000","last_active":"2023-12-22T08:40:48.398207+0000","last_peered":"2023-12-22T08:40:48.398207+0000","last_clean":"2023-12-22T08:40:48.398207+0000","last_became_active":"2023-12-22T08:40:45.507322+0000","last_became_peered":"2023-12-22T08:40:45.507322+0000","last_unstale":"2023-12-22T08:40:48.398207+0000","last_undegraded":"2023-12-22T08:40:48.398207+0000","last_fullsized":"2023-12-22T08:40:48.398207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:25.292485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869520+0000","last_change":"2023-12-22T08:40:45.877133+0000","last_active":"2023-12-22T08:40:46.869520+0000","last_peered":"2023-12-22T08:40:46.869520+0000","last_clean":"2023-12-22T08:40:46.869520+0000","last_became_active":"2023-12-22T08:40:45.876811+0000","last_became_peered":"2023-12-22T08:40:45.876811+0000","last_unstale":"2023-12-22T08:40:46.869520+0000","last_undegraded":"2023-12-22T08:40:46.869520+0000","last_fullsized":"2023-12-22T08:40:46.869520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:45.181460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975130+0000","last_change":"2023-12-22T08:40:45.515520+0000","last_active":"2023-12-22T08:40:47.975130+0000","last_peered":"2023-12-22T08:40:47.975130+0000","last_clean":"2023-12-22T08:40:47.975130+0000","last_became_active":"2023-12-22T08:40:45.515191+0000","last_became_peered":"2023-12-22T08:40:45.515191+0000","last_unstale":"2023-12-22T08:40:47.975130+0000","last_undegraded":"2023-12-22T08:40:47.975130+0000","last_fullsized":"2023-12-22T08:40:47.975130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398510+0000","last_change":"2023-12-22T08:40:45.884908+0000","last_active":"2023-12-22T08:40:48.398510+0000","last_peered":"2023-12-22T08:40:48.398510+0000","last_clean":"2023-12-22T08:40:48.398510+0000","last_became_active":"2023-12-22T08:40:45.884670+0000","last_became_peered":"2023-12-22T08:40:45.884670+0000","last_unstale":"2023-12-22T08:40:48.398510+0000","last_undegraded":"2023-12-22T08:40:48.398510+0000","last_fullsized":"2023-12-22T08:40:48.398510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:17.567380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868744+0000","last_change":"2023-12-22T08:40:45.509332+0000","last_active":"2023-12-22T08:40:46.868744+0000","last_peered":"2023-12-22T08:40:46.868744+0000","last_clean":"2023-12-22T08:40:46.868744+0000","last_became_active":"2023-12-22T08:40:45.509052+0000","last_became_peered":"2023-12-22T08:40:45.509052+0000","last_unstale":"2023-12-22T08:40:46.868744+0000","last_undegraded":"2023-12-22T08:40:46.868744+0000","last_fullsized":"2023-12-22T08:40:46.868744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:27.751410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868335+0000","last_change":"2023-12-22T08:40:45.875255+0000","last_active":"2023-12-22T08:40:46.868335+0000","last_peered":"2023-12-22T08:40:46.868335+0000","last_clean":"2023-12-22T08:40:46.868335+0000","last_became_active":"2023-12-22T08:40:45.875014+0000","last_became_peered":"2023-12-22T08:40:45.875014+0000","last_unstale":"2023-12-22T08:40:46.868335+0000","last_undegraded":"2023-12-22T08:40:46.868335+0000","last_fullsized":"2023-12-22T08:40:46.868335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947312+0000","last_change":"2023-12-22T08:40:45.513554+0000","last_active":"2023-12-22T08:40:47.947312+0000","last_peered":"2023-12-22T08:40:47.947312+0000","last_clean":"2023-12-22T08:40:47.947312+0000","last_became_active":"2023-12-22T08:40:45.513255+0000","last_became_peered":"2023-12-22T08:40:45.513255+0000","last_unstale":"2023-12-22T08:40:47.947312+0000","last_undegraded":"2023-12-22T08:40:47.947312+0000","last_fullsized":"2023-12-22T08:40:47.947312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398497+0000","last_change":"2023-12-22T08:40:45.886788+0000","last_active":"2023-12-22T08:40:48.398497+0000","last_peered":"2023-12-22T08:40:48.398497+0000","last_clean":"2023-12-22T08:40:48.398497+0000","last_became_active":"2023-12-22T08:40:45.886544+0000","last_became_peered":"2023-12-22T08:40:45.886544+0000","last_unstale":"2023-12-22T08:40:48.398497+0000","last_undegraded":"2023-12-22T08:40:48.398497+0000","last_fullsized":"2023-12-22T08:40:48.398497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974941+0000","last_change":"2023-12-22T08:40:45.508706+0000","last_active":"2023-12-22T08:40:47.974941+0000","last_peered":"2023-12-22T08:40:47.974941+0000","last_clean":"2023-12-22T08:40:47.974941+0000","last_became_active":"2023-12-22T08:40:45.508419+0000","last_became_peered":"2023-12-22T08:40:45.508419+0000","last_unstale":"2023-12-22T08:40:47.974941+0000","last_undegraded":"2023-12-22T08:40:47.974941+0000","last_fullsized":"2023-12-22T08:40:47.974941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974937+0000","last_change":"2023-12-22T08:40:45.881751+0000","last_active":"2023-12-22T08:40:47.974937+0000","last_peered":"2023-12-22T08:40:47.974937+0000","last_clean":"2023-12-22T08:40:47.974937+0000","last_became_active":"2023-12-22T08:40:45.881474+0000","last_became_peered":"2023-12-22T08:40:45.881474+0000","last_unstale":"2023-12-22T08:40:47.974937+0000","last_undegraded":"2023-12-22T08:40:47.974937+0000","last_fullsized":"2023-12-22T08:40:47.974937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397769+0000","last_change":"2023-12-22T08:40:45.505971+0000","last_active":"2023-12-22T08:40:48.397769+0000","last_peered":"2023-12-22T08:40:48.397769+0000","last_clean":"2023-12-22T08:40:48.397769+0000","last_became_active":"2023-12-22T08:40:45.505672+0000","last_became_peered":"2023-12-22T08:40:45.505672+0000","last_unstale":"2023-12-22T08:40:48.397769+0000","last_undegraded":"2023-12-22T08:40:48.397769+0000","last_fullsized":"2023-12-22T08:40:48.397769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398260+0000","last_change":"2023-12-22T08:40:45.879566+0000","last_active":"2023-12-22T08:40:48.398260+0000","last_peered":"2023-12-22T08:40:48.398260+0000","last_clean":"2023-12-22T08:40:48.398260+0000","last_became_active":"2023-12-22T08:40:45.879319+0000","last_became_peered":"2023-12-22T08:40:45.879319+0000","last_unstale":"2023-12-22T08:40:48.398260+0000","last_undegraded":"2023-12-22T08:40:48.398260+0000","last_fullsized":"2023-12-22T08:40:48.398260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:41:59.148169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869645+0000","last_change":"2023-12-22T08:40:45.511686+0000","last_active":"2023-12-22T08:40:46.869645+0000","last_peered":"2023-12-22T08:40:46.869645+0000","last_clean":"2023-12-22T08:40:46.869645+0000","last_became_active":"2023-12-22T08:40:45.511341+0000","last_became_peered":"2023-12-22T08:40:45.511341+0000","last_unstale":"2023-12-22T08:40:46.869645+0000","last_undegraded":"2023-12-22T08:40:46.869645+0000","last_fullsized":"2023-12-22T08:40:46.869645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:34:01.717358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398720+0000","last_change":"2023-12-22T08:40:45.882380+0000","last_active":"2023-12-22T08:40:48.398720+0000","last_peered":"2023-12-22T08:40:48.398720+0000","last_clean":"2023-12-22T08:40:48.398720+0000","last_became_active":"2023-12-22T08:40:45.882119+0000","last_became_peered":"2023-12-22T08:40:45.882119+0000","last_unstale":"2023-12-22T08:40:48.398720+0000","last_undegraded":"2023-12-22T08:40:48.398720+0000","last_fullsized":"2023-12-22T08:40:48.398720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398030+0000","last_change":"2023-12-22T08:40:45.513658+0000","last_active":"2023-12-22T08:40:48.398030+0000","last_peered":"2023-12-22T08:40:48.398030+0000","last_clean":"2023-12-22T08:40:48.398030+0000","last_became_active":"2023-12-22T08:40:45.513339+0000","last_became_peered":"2023-12-22T08:40:45.513339+0000","last_unstale":"2023-12-22T08:40:48.398030+0000","last_undegraded":"2023-12-22T08:40:48.398030+0000","last_fullsized":"2023-12-22T08:40:48.398030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398866+0000","last_change":"2023-12-22T08:40:45.885859+0000","last_active":"2023-12-22T08:40:48.398866+0000","last_peered":"2023-12-22T08:40:48.398866+0000","last_clean":"2023-12-22T08:40:48.398866+0000","last_became_active":"2023-12-22T08:40:45.885570+0000","last_became_peered":"2023-12-22T08:40:45.885570+0000","last_unstale":"2023-12-22T08:40:48.398866+0000","last_undegraded":"2023-12-22T08:40:48.398866+0000","last_fullsized":"2023-12-22T08:40:48.398866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398284+0000","last_change":"2023-12-22T08:40:45.505894+0000","last_active":"2023-12-22T08:40:48.398284+0000","last_peered":"2023-12-22T08:40:48.398284+0000","last_clean":"2023-12-22T08:40:48.398284+0000","last_became_active":"2023-12-22T08:40:45.505632+0000","last_became_peered":"2023-12-22T08:40:45.505632+0000","last_unstale":"2023-12-22T08:40:48.398284+0000","last_undegraded":"2023-12-22T08:40:48.398284+0000","last_fullsized":"2023-12-22T08:40:48.398284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947422+0000","last_change":"2023-12-22T08:40:45.892678+0000","last_active":"2023-12-22T08:40:47.947422+0000","last_peered":"2023-12-22T08:40:47.947422+0000","last_clean":"2023-12-22T08:40:47.947422+0000","last_became_active":"2023-12-22T08:40:45.892124+0000","last_became_peered":"2023-12-22T08:40:45.892124+0000","last_unstale":"2023-12-22T08:40:47.947422+0000","last_undegraded":"2023-12-22T08:40:47.947422+0000","last_fullsized":"2023-12-22T08:40:47.947422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:30.540430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398091+0000","last_change":"2023-12-22T08:40:45.508702+0000","last_active":"2023-12-22T08:40:48.398091+0000","last_peered":"2023-12-22T08:40:48.398091+0000","last_clean":"2023-12-22T08:40:48.398091+0000","last_became_active":"2023-12-22T08:40:45.508363+0000","last_became_peered":"2023-12-22T08:40:45.508363+0000","last_unstale":"2023-12-22T08:40:48.398091+0000","last_undegraded":"2023-12-22T08:40:48.398091+0000","last_fullsized":"2023-12-22T08:40:48.398091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398572+0000","last_change":"2023-12-22T08:40:45.891244+0000","last_active":"2023-12-22T08:40:48.398572+0000","last_peered":"2023-12-22T08:40:48.398572+0000","last_clean":"2023-12-22T08:40:48.398572+0000","last_became_active":"2023-12-22T08:40:45.890987+0000","last_became_peered":"2023-12-22T08:40:45.890987+0000","last_unstale":"2023-12-22T08:40:48.398572+0000","last_undegraded":"2023-12-22T08:40:48.398572+0000","last_fullsized":"2023-12-22T08:40:48.398572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:57.963627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:40:45.872970+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:40:45.872970+0000","last_peered":"2023-12-22T08:40:45.872970+0000","last_clean":"2023-12-22T08:40:45.872970+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:40:45.872970+0000","last_undegraded":"2023-12-22T08:40:45.872970+0000","last_fullsized":"2023-12-22T08:40:45.872970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947033+0000","last_change":"2023-12-22T08:40:45.502151+0000","last_active":"2023-12-22T08:40:47.947033+0000","last_peered":"2023-12-22T08:40:47.947033+0000","last_clean":"2023-12-22T08:40:47.947033+0000","last_became_active":"2023-12-22T08:40:45.501868+0000","last_became_peered":"2023-12-22T08:40:45.501868+0000","last_unstale":"2023-12-22T08:40:47.947033+0000","last_undegraded":"2023-12-22T08:40:47.947033+0000","last_fullsized":"2023-12-22T08:40:47.947033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868537+0000","last_change":"2023-12-22T08:40:45.892243+0000","last_active":"2023-12-22T08:40:46.868537+0000","last_peered":"2023-12-22T08:40:46.868537+0000","last_clean":"2023-12-22T08:40:46.868537+0000","last_became_active":"2023-12-22T08:40:45.892042+0000","last_became_peered":"2023-12-22T08:40:45.892042+0000","last_unstale":"2023-12-22T08:40:46.868537+0000","last_undegraded":"2023-12-22T08:40:46.868537+0000","last_fullsized":"2023-12-22T08:40:46.868537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398193+0000","last_change":"2023-12-22T08:40:45.508515+0000","last_active":"2023-12-22T08:40:48.398193+0000","last_peered":"2023-12-22T08:40:48.398193+0000","last_clean":"2023-12-22T08:40:48.398193+0000","last_became_active":"2023-12-22T08:40:45.508155+0000","last_became_peered":"2023-12-22T08:40:45.508155+0000","last_unstale":"2023-12-22T08:40:48.398193+0000","last_undegraded":"2023-12-22T08:40:48.398193+0000","last_fullsized":"2023-12-22T08:40:48.398193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868150+0000","last_change":"2023-12-22T08:40:45.875984+0000","last_active":"2023-12-22T08:40:46.868150+0000","last_peered":"2023-12-22T08:40:46.868150+0000","last_clean":"2023-12-22T08:40:46.868150+0000","last_became_active":"2023-12-22T08:40:45.875646+0000","last_became_peered":"2023-12-22T08:40:45.875646+0000","last_unstale":"2023-12-22T08:40:46.868150+0000","last_undegraded":"2023-12-22T08:40:46.868150+0000","last_fullsized":"2023-12-22T08:40:46.868150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397864+0000","last_change":"2023-12-22T08:40:45.513879+0000","last_active":"2023-12-22T08:40:48.397864+0000","last_peered":"2023-12-22T08:40:48.397864+0000","last_clean":"2023-12-22T08:40:48.397864+0000","last_became_active":"2023-12-22T08:40:45.513329+0000","last_became_peered":"2023-12-22T08:40:45.513329+0000","last_unstale":"2023-12-22T08:40:48.397864+0000","last_undegraded":"2023-12-22T08:40:48.397864+0000","last_fullsized":"2023-12-22T08:40:48.397864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398049+0000","last_change":"2023-12-22T08:40:45.883287+0000","last_active":"2023-12-22T08:40:48.398049+0000","last_peered":"2023-12-22T08:40:48.398049+0000","last_clean":"2023-12-22T08:40:48.398049+0000","last_became_active":"2023-12-22T08:40:45.883029+0000","last_became_peered":"2023-12-22T08:40:45.883029+0000","last_unstale":"2023-12-22T08:40:48.398049+0000","last_undegraded":"2023-12-22T08:40:48.398049+0000","last_fullsized":"2023-12-22T08:40:48.398049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:51:18.636850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947366+0000","last_change":"2023-12-22T08:40:45.506897+0000","last_active":"2023-12-22T08:40:47.947366+0000","last_peered":"2023-12-22T08:40:47.947366+0000","last_clean":"2023-12-22T08:40:47.947366+0000","last_became_active":"2023-12-22T08:40:45.506629+0000","last_became_peered":"2023-12-22T08:40:45.506629+0000","last_unstale":"2023-12-22T08:40:47.947366+0000","last_undegraded":"2023-12-22T08:40:47.947366+0000","last_fullsized":"2023-12-22T08:40:47.947366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869291+0000","last_change":"2023-12-22T08:40:45.881933+0000","last_active":"2023-12-22T08:40:46.869291+0000","last_peered":"2023-12-22T08:40:46.869291+0000","last_clean":"2023-12-22T08:40:46.869291+0000","last_became_active":"2023-12-22T08:40:45.881668+0000","last_became_peered":"2023-12-22T08:40:45.881668+0000","last_unstale":"2023-12-22T08:40:46.869291+0000","last_undegraded":"2023-12-22T08:40:46.869291+0000","last_fullsized":"2023-12-22T08:40:46.869291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:45.489511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398192+0000","last_change":"2023-12-22T08:40:45.510517+0000","last_active":"2023-12-22T08:40:48.398192+0000","last_peered":"2023-12-22T08:40:48.398192+0000","last_clean":"2023-12-22T08:40:48.398192+0000","last_became_active":"2023-12-22T08:40:45.510251+0000","last_became_peered":"2023-12-22T08:40:45.510251+0000","last_unstale":"2023-12-22T08:40:48.398192+0000","last_undegraded":"2023-12-22T08:40:48.398192+0000","last_fullsized":"2023-12-22T08:40:48.398192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:04.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947392+0000","last_change":"2023-12-22T08:40:45.893451+0000","last_active":"2023-12-22T08:40:47.947392+0000","last_peered":"2023-12-22T08:40:47.947392+0000","last_clean":"2023-12-22T08:40:47.947392+0000","last_became_active":"2023-12-22T08:40:45.893164+0000","last_became_peered":"2023-12-22T08:40:45.893164+0000","last_unstale":"2023-12-22T08:40:47.947392+0000","last_undegraded":"2023-12-22T08:40:47.947392+0000","last_fullsized":"2023-12-22T08:40:47.947392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:41:59.148169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398723+0000","last_change":"2023-12-22T08:40:45.512956+0000","last_active":"2023-12-22T08:40:48.398723+0000","last_peered":"2023-12-22T08:40:48.398723+0000","last_clean":"2023-12-22T08:40:48.398723+0000","last_became_active":"2023-12-22T08:40:45.512647+0000","last_became_peered":"2023-12-22T08:40:45.512647+0000","last_unstale":"2023-12-22T08:40:48.398723+0000","last_undegraded":"2023-12-22T08:40:48.398723+0000","last_fullsized":"2023-12-22T08:40:48.398723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:12:03.015743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398318+0000","last_change":"2023-12-22T08:40:45.879030+0000","last_active":"2023-12-22T08:40:48.398318+0000","last_peered":"2023-12-22T08:40:48.398318+0000","last_clean":"2023-12-22T08:40:48.398318+0000","last_became_active":"2023-12-22T08:40:45.878738+0000","last_became_peered":"2023-12-22T08:40:45.878738+0000","last_unstale":"2023-12-22T08:40:48.398318+0000","last_undegraded":"2023-12-22T08:40:48.398318+0000","last_fullsized":"2023-12-22T08:40:48.398318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398259+0000","last_change":"2023-12-22T08:40:45.504141+0000","last_active":"2023-12-22T08:40:48.398259+0000","last_peered":"2023-12-22T08:40:48.398259+0000","last_clean":"2023-12-22T08:40:48.398259+0000","last_became_active":"2023-12-22T08:40:45.503853+0000","last_became_peered":"2023-12-22T08:40:45.503853+0000","last_unstale":"2023-12-22T08:40:48.398259+0000","last_undegraded":"2023-12-22T08:40:48.398259+0000","last_fullsized":"2023-12-22T08:40:48.398259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869172+0000","last_change":"2023-12-22T08:40:45.886077+0000","last_active":"2023-12-22T08:40:46.869172+0000","last_peered":"2023-12-22T08:40:46.869172+0000","last_clean":"2023-12-22T08:40:46.869172+0000","last_became_active":"2023-12-22T08:40:45.885810+0000","last_became_peered":"2023-12-22T08:40:45.885810+0000","last_unstale":"2023-12-22T08:40:46.869172+0000","last_undegraded":"2023-12-22T08:40:46.869172+0000","last_fullsized":"2023-12-22T08:40:46.869172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975100+0000","last_change":"2023-12-22T08:40:45.508614+0000","last_active":"2023-12-22T08:40:47.975100+0000","last_peered":"2023-12-22T08:40:47.975100+0000","last_clean":"2023-12-22T08:40:47.975100+0000","last_became_active":"2023-12-22T08:40:45.508360+0000","last_became_peered":"2023-12-22T08:40:45.508360+0000","last_unstale":"2023-12-22T08:40:47.975100+0000","last_undegraded":"2023-12-22T08:40:47.975100+0000","last_fullsized":"2023-12-22T08:40:47.975100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868357+0000","last_change":"2023-12-22T08:40:45.873932+0000","last_active":"2023-12-22T08:40:46.868357+0000","last_peered":"2023-12-22T08:40:46.868357+0000","last_clean":"2023-12-22T08:40:46.868357+0000","last_became_active":"2023-12-22T08:40:45.873690+0000","last_became_peered":"2023-12-22T08:40:45.873690+0000","last_unstale":"2023-12-22T08:40:46.868357+0000","last_undegraded":"2023-12-22T08:40:46.868357+0000","last_fullsized":"2023-12-22T08:40:46.868357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:51:49.322300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398164+0000","last_change":"2023-12-22T08:40:45.513413+0000","last_active":"2023-12-22T08:40:48.398164+0000","last_peered":"2023-12-22T08:40:48.398164+0000","last_clean":"2023-12-22T08:40:48.398164+0000","last_became_active":"2023-12-22T08:40:45.512578+0000","last_became_peered":"2023-12-22T08:40:45.512578+0000","last_unstale":"2023-12-22T08:40:48.398164+0000","last_undegraded":"2023-12-22T08:40:48.398164+0000","last_fullsized":"2023-12-22T08:40:48.398164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:04.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869079+0000","last_change":"2023-12-22T08:40:45.884963+0000","last_active":"2023-12-22T08:40:46.869079+0000","last_peered":"2023-12-22T08:40:46.869079+0000","last_clean":"2023-12-22T08:40:46.869079+0000","last_became_active":"2023-12-22T08:40:45.884695+0000","last_became_peered":"2023-12-22T08:40:45.884695+0000","last_unstale":"2023-12-22T08:40:46.869079+0000","last_undegraded":"2023-12-22T08:40:46.869079+0000","last_fullsized":"2023-12-22T08:40:46.869079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:35.519308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398062+0000","last_change":"2023-12-22T08:40:45.507307+0000","last_active":"2023-12-22T08:40:48.398062+0000","last_peered":"2023-12-22T08:40:48.398062+0000","last_clean":"2023-12-22T08:40:48.398062+0000","last_became_active":"2023-12-22T08:40:45.506990+0000","last_became_peered":"2023-12-22T08:40:45.506990+0000","last_unstale":"2023-12-22T08:40:48.398062+0000","last_undegraded":"2023-12-22T08:40:48.398062+0000","last_fullsized":"2023-12-22T08:40:48.398062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868827+0000","last_change":"2023-12-22T08:40:45.884456+0000","last_active":"2023-12-22T08:40:46.868827+0000","last_peered":"2023-12-22T08:40:46.868827+0000","last_clean":"2023-12-22T08:40:46.868827+0000","last_became_active":"2023-12-22T08:40:45.884201+0000","last_became_peered":"2023-12-22T08:40:45.884201+0000","last_unstale":"2023-12-22T08:40:46.868827+0000","last_undegraded":"2023-12-22T08:40:46.868827+0000","last_fullsized":"2023-12-22T08:40:46.868827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398187+0000","last_change":"2023-12-22T08:40:45.515513+0000","last_active":"2023-12-22T08:40:48.398187+0000","last_peered":"2023-12-22T08:40:48.398187+0000","last_clean":"2023-12-22T08:40:48.398187+0000","last_became_active":"2023-12-22T08:40:45.515195+0000","last_became_peered":"2023-12-22T08:40:45.515195+0000","last_unstale":"2023-12-22T08:40:48.398187+0000","last_undegraded":"2023-12-22T08:40:48.398187+0000","last_fullsized":"2023-12-22T08:40:48.398187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869019+0000","last_change":"2023-12-22T08:40:45.887878+0000","last_active":"2023-12-22T08:40:46.869019+0000","last_peered":"2023-12-22T08:40:46.869019+0000","last_clean":"2023-12-22T08:40:46.869019+0000","last_became_active":"2023-12-22T08:40:45.887636+0000","last_became_peered":"2023-12-22T08:40:45.887636+0000","last_unstale":"2023-12-22T08:40:46.869019+0000","last_undegraded":"2023-12-22T08:40:46.869019+0000","last_fullsized":"2023-12-22T08:40:46.869019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398552+0000","last_change":"2023-12-22T08:40:45.508892+0000","last_active":"2023-12-22T08:40:48.398552+0000","last_peered":"2023-12-22T08:40:48.398552+0000","last_clean":"2023-12-22T08:40:48.398552+0000","last_became_active":"2023-12-22T08:40:45.508596+0000","last_became_peered":"2023-12-22T08:40:45.508596+0000","last_unstale":"2023-12-22T08:40:48.398552+0000","last_undegraded":"2023-12-22T08:40:48.398552+0000","last_fullsized":"2023-12-22T08:40:48.398552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:25.292485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974883+0000","last_change":"2023-12-22T08:40:45.882288+0000","last_active":"2023-12-22T08:40:47.974883+0000","last_peered":"2023-12-22T08:40:47.974883+0000","last_clean":"2023-12-22T08:40:47.974883+0000","last_became_active":"2023-12-22T08:40:45.882025+0000","last_became_peered":"2023-12-22T08:40:45.882025+0000","last_unstale":"2023-12-22T08:40:47.974883+0000","last_undegraded":"2023-12-22T08:40:47.974883+0000","last_fullsized":"2023-12-22T08:40:47.974883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947348+0000","last_change":"2023-12-22T08:40:45.889079+0000","last_active":"2023-12-22T08:40:47.947348+0000","last_peered":"2023-12-22T08:40:47.947348+0000","last_clean":"2023-12-22T08:40:47.947348+0000","last_became_active":"2023-12-22T08:40:45.888545+0000","last_became_peered":"2023-12-22T08:40:45.888545+0000","last_unstale":"2023-12-22T08:40:47.947348+0000","last_undegraded":"2023-12-22T08:40:47.947348+0000","last_fullsized":"2023-12-22T08:40:47.947348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398487+0000","last_change":"2023-12-22T08:40:45.510991+0000","last_active":"2023-12-22T08:40:48.398487+0000","last_peered":"2023-12-22T08:40:48.398487+0000","last_clean":"2023-12-22T08:40:48.398487+0000","last_became_active":"2023-12-22T08:40:45.510738+0000","last_became_peered":"2023-12-22T08:40:45.510738+0000","last_unstale":"2023-12-22T08:40:48.398487+0000","last_undegraded":"2023-12-22T08:40:48.398487+0000","last_fullsized":"2023-12-22T08:40:48.398487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:44.484526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947402+0000","last_change":"2023-12-22T08:40:45.890868+0000","last_active":"2023-12-22T08:40:47.947402+0000","last_peered":"2023-12-22T08:40:47.947402+0000","last_clean":"2023-12-22T08:40:47.947402+0000","last_became_active":"2023-12-22T08:40:45.890569+0000","last_became_peered":"2023-12-22T08:40:45.890569+0000","last_unstale":"2023-12-22T08:40:47.947402+0000","last_undegraded":"2023-12-22T08:40:47.947402+0000","last_fullsized":"2023-12-22T08:40:47.947402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398584+0000","last_change":"2023-12-22T08:40:45.511043+0000","last_active":"2023-12-22T08:40:48.398584+0000","last_peered":"2023-12-22T08:40:48.398584+0000","last_clean":"2023-12-22T08:40:48.398584+0000","last_became_active":"2023-12-22T08:40:45.510756+0000","last_became_peered":"2023-12-22T08:40:45.510756+0000","last_unstale":"2023-12-22T08:40:48.398584+0000","last_undegraded":"2023-12-22T08:40:48.398584+0000","last_fullsized":"2023-12-22T08:40:48.398584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868465+0000","last_change":"2023-12-22T08:40:45.890415+0000","last_active":"2023-12-22T08:40:46.868465+0000","last_peered":"2023-12-22T08:40:46.868465+0000","last_clean":"2023-12-22T08:40:46.868465+0000","last_became_active":"2023-12-22T08:40:45.889396+0000","last_became_peered":"2023-12-22T08:40:45.889396+0000","last_unstale":"2023-12-22T08:40:46.868465+0000","last_undegraded":"2023-12-22T08:40:46.868465+0000","last_fullsized":"2023-12-22T08:40:46.868465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869104+0000","last_change":"2023-12-22T08:40:45.515548+0000","last_active":"2023-12-22T08:40:46.869104+0000","last_peered":"2023-12-22T08:40:46.869104+0000","last_clean":"2023-12-22T08:40:46.869104+0000","last_became_active":"2023-12-22T08:40:45.515186+0000","last_became_peered":"2023-12-22T08:40:45.515186+0000","last_unstale":"2023-12-22T08:40:46.869104+0000","last_undegraded":"2023-12-22T08:40:46.869104+0000","last_fullsized":"2023-12-22T08:40:46.869104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868946+0000","last_change":"2023-12-22T08:40:45.891682+0000","last_active":"2023-12-22T08:40:46.868946+0000","last_peered":"2023-12-22T08:40:46.868946+0000","last_clean":"2023-12-22T08:40:46.868946+0000","last_became_active":"2023-12-22T08:40:45.891415+0000","last_became_peered":"2023-12-22T08:40:45.891415+0000","last_unstale":"2023-12-22T08:40:46.868946+0000","last_undegraded":"2023-12-22T08:40:46.868946+0000","last_fullsized":"2023-12-22T08:40:46.868946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868641+0000","last_change":"2023-12-22T08:40:45.510426+0000","last_active":"2023-12-22T08:40:46.868641+0000","last_peered":"2023-12-22T08:40:46.868641+0000","last_clean":"2023-12-22T08:40:46.868641+0000","last_became_active":"2023-12-22T08:40:45.510100+0000","last_became_peered":"2023-12-22T08:40:45.510100+0000","last_unstale":"2023-12-22T08:40:46.868641+0000","last_undegraded":"2023-12-22T08:40:46.868641+0000","last_fullsized":"2023-12-22T08:40:46.868641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":64758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:40:49.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:50.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.999+0000 7fbfeeaaf640 1 Processor -- start 2023-12-22T08:40:50.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.999+0000 7fbfeeaaf640 1 -- start start 2023-12-22T08:40:50.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.999+0000 7fbfeeaaf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbfe806a6d0 0x7fbfe814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.999+0000 7fbfeeaaf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 0x7fbfe81554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.999+0000 7fbfeeaaf640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe80bb310 con 0x7fbfe814b1f0 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.999+0000 7fbfeeaaf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe80bf960 con 0x7fbfe806a6d0 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:49.999+0000 7fbfeeaaf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80bb5b0 con 0x7fbfe80ba550 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.000+0000 7fbfec84b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbfe806a6d0 0x7fbfe814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.000+0000 7fbfec84b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbfe806a6d0 0x7fbfe814acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54202/0 (socket says 172.21.15.31:54202) 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.000+0000 7fbfec84b640 1 -- 172.21.15.31:0/2902666736 learned_addr learned my addr 172.21.15.31:0/2902666736 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.000+0000 7fbfed04c640 1 --2- 172.21.15.31:0/2902666736 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 0x7fbfe81554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.000+0000 7fbfec84b640 1 -- 172.21.15.31:0/2902666736 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 msgr2=0x7fbfe81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.000+0000 7fbfec84b640 1 --2- 172.21.15.31:0/2902666736 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 0x7fbfe81554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.000+0000 7fbfec84b640 1 -- 172.21.15.31:0/2902666736 >> v1:172.21.15.69:6789/0 conn(0x7fbfe814b1f0 legacy=0x7fbfe80b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.000+0000 7fbfec84b640 1 -- 172.21.15.31:0/2902666736 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe80c0120 con 0x7fbfe806a6d0 2023-12-22T08:40:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfec84b640 1 --2- 172.21.15.31:0/2902666736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe806a6d0 0x7fbfe814acb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009870 tx=0x7fbfdc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5824624298cdcfbb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfe77fe640 1 -- 172.21.15.31:0/2902666736 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc030840 con 0x7fbfe806a6d0 2023-12-22T08:40:50.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfe77fe640 1 -- 172.21.15.31:0/2902666736 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0309a0 con 0x7fbfe806a6d0 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfe77fe640 1 -- 172.21.15.31:0/2902666736 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc030d30 con 0x7fbfe806a6d0 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/2902666736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe806a6d0 msgr2=0x7fbfe814acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/2902666736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe806a6d0 0x7fbfe814acb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009870 tx=0x7fbfdc02b980 comp rx=0 tx=0).stop 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/2902666736 shutdown_connections 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/2902666736 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 0x7fbfe81554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/2902666736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe806a6d0 0x7fbfe814acb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/2902666736 >> 172.21.15.31:0/2902666736 conn(0x7fbfe80c0350 msgr2=0x7fbfe80c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/2902666736 shutdown_connections 2023-12-22T08:40:50.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.001+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/2902666736 wait complete. 2023-12-22T08:40:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.002+0000 7fbfeeaaf640 1 Processor -- start 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.002+0000 7fbfeeaaf640 1 -- start start 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfeeaaf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbfe806a6d0 0x7fbfe81e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfeeaaf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 0x7fbfe81e39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfeeaaf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe814b1f0 0x7fbfe81e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfeeaaf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81e36e0 con 0x7fbfe814b1f0 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfeeaaf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81d4450 con 0x7fbfe806a6d0 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfeeaaf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80b6e60 con 0x7fbfe80ba550 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfed04c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe814b1f0 0x7fbfe81e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfed04c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe814b1f0 0x7fbfe81e31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54218/0 (socket says 172.21.15.31:54218) 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfed04c640 1 -- 172.21.15.31:0/1651146084 learned_addr learned my addr 172.21.15.31:0/1651146084 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.003+0000 7fbfec84b640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbfe806a6d0 0x7fbfe81e0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfe7fff640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 0x7fbfe81e39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfed04c640 1 -- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 msgr2=0x7fbfe81e39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfed04c640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 0x7fbfe81e39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfed04c640 1 -- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbfe806a6d0 msgr2=0x7fbfe81e0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfed04c640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbfe806a6d0 0x7fbfe81e0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfed04c640 1 -- 172.21.15.31:0/1651146084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0094d0 con 0x7fbfe814b1f0 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfed04c640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe814b1f0 0x7fbfe81e31a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007e60 tx=0x7fbfe000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfe57fa640 1 -- 172.21.15.31:0/1651146084 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0014620 con 0x7fbfe814b1f0 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfe57fa640 1 -- 172.21.15.31:0/1651146084 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0014780 con 0x7fbfe814b1f0 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe814ec30 con 0x7fbfe814b1f0 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfe57fa640 1 -- 172.21.15.31:0/1651146084 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0014b30 con 0x7fbfe814b1f0 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.004+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe81d40e0 con 0x7fbfe814b1f0 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.005+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe81d42a0 con 0x7fbfe814b1f0 2023-12-22T08:40:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.005+0000 7fbfe57fa640 1 -- 172.21.15.31:0/1651146084 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfe0014c90 con 0x7fbfe814b1f0 2023-12-22T08:40:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.006+0000 7fbfe57fa640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbfcc06a460 0x7fbfcc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.006+0000 7fbfe57fa640 1 -- 172.21.15.31:0/1651146084 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfe0089240 con 0x7fbfe814b1f0 2023-12-22T08:40:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.006+0000 7fbfec84b640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbfcc06a460 0x7fbfcc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.006+0000 7fbfec84b640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbfcc06a460 0x7fbfcc06c920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc036000 tx=0x7fbfdc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.010+0000 7fbfe57fa640 1 -- 172.21.15.31:0/1651146084 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbfe0054820 con 0x7fbfe814b1f0 2023-12-22T08:40:50.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.183+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfe80c1160 con 0x7fbfcc06a460 2023-12-22T08:40:50.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.190+0000 7fbfe57fa640 1 -- 172.21.15.31:0/1651146084 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264645 (secure 0 0 0) 0x7fbfdc044470 con 0x7fbfcc06a460 2023-12-22T08:40:50.195 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:50.197 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:40:50.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbfcc06a460 msgr2=0x7fbfcc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbfcc06a460 0x7fbfcc06c920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc036000 tx=0x7fbfdc008030 comp rx=0 tx=0).stop 2023-12-22T08:40:50.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe814b1f0 msgr2=0x7fbfe81e31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe814b1f0 0x7fbfe81e31a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0007e60 tx=0x7fbfe000e4b0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 shutdown_connections 2023-12-22T08:40:50.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbfcc06a460 0x7fbfcc06c920 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbfe814b1f0 0x7fbfe81e31a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbfe80ba550 0x7fbfe81e39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 --2- 172.21.15.31:0/1651146084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbfe806a6d0 0x7fbfe81e0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 >> 172.21.15.31:0/1651146084 conn(0x7fbfe80c0350 msgr2=0x7fbfe80c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 shutdown_connections 2023-12-22T08:40:50.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.193+0000 7fbfeeaaf640 1 -- 172.21.15.31:0/1651146084 wait complete. 2023-12-22T08:40:50.206 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-22T08:40:49.783482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218404,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756316,"statfs":{"total":773094113280,"available":772870467584,"internally_reserved":0,"allocated":2854912,"data_stored":1733744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.295603"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398792+0000","last_change":"2023-12-22T08:40:45.883952+0000","last_active":"2023-12-22T08:40:48.398792+0000","last_peered":"2023-12-22T08:40:48.398792+0000","last_clean":"2023-12-22T08:40:48.398792+0000","last_became_active":"2023-12-22T08:40:45.883513+0000","last_became_peered":"2023-12-22T08:40:45.883513+0000","last_unstale":"2023-12-22T08:40:48.398792+0000","last_undegraded":"2023-12-22T08:40:48.398792+0000","last_fullsized":"2023-12-22T08:40:48.398792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:30.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398236+0000","last_change":"2023-12-22T08:40:45.878775+0000","last_active":"2023-12-22T08:40:48.398236+0000","last_peered":"2023-12-22T08:40:48.398236+0000","last_clean":"2023-12-22T08:40:48.398236+0000","last_became_active":"2023-12-22T08:40:45.878528+0000","last_became_peered":"2023-12-22T08:40:45.878528+0000","last_unstale":"2023-12-22T08:40:48.398236+0000","last_undegraded":"2023-12-22T08:40:48.398236+0000","last_fullsized":"2023-12-22T08:40:48.398236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868312+0000","last_change":"2023-12-22T08:40:45.880293+0000","last_active":"2023-12-22T08:40:46.868312+0000","last_peered":"2023-12-22T08:40:46.868312+0000","last_clean":"2023-12-22T08:40:46.868312+0000","last_became_active":"2023-12-22T08:40:45.880038+0000","last_became_peered":"2023-12-22T08:40:45.880038+0000","last_unstale":"2023-12-22T08:40:46.868312+0000","last_undegraded":"2023-12-22T08:40:46.868312+0000","last_fullsized":"2023-12-22T08:40:46.868312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947206+0000","last_change":"2023-12-22T08:40:45.892847+0000","last_active":"2023-12-22T08:40:47.947206+0000","last_peered":"2023-12-22T08:40:47.947206+0000","last_clean":"2023-12-22T08:40:47.947206+0000","last_became_active":"2023-12-22T08:40:45.892443+0000","last_became_peered":"2023-12-22T08:40:45.892443+0000","last_unstale":"2023-12-22T08:40:47.947206+0000","last_undegraded":"2023-12-22T08:40:47.947206+0000","last_fullsized":"2023-12-22T08:40:47.947206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:33.421892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398449+0000","last_change":"2023-12-22T08:40:45.884154+0000","last_active":"2023-12-22T08:40:48.398449+0000","last_peered":"2023-12-22T08:40:48.398449+0000","last_clean":"2023-12-22T08:40:48.398449+0000","last_became_active":"2023-12-22T08:40:45.883879+0000","last_became_peered":"2023-12-22T08:40:45.883879+0000","last_unstale":"2023-12-22T08:40:48.398449+0000","last_undegraded":"2023-12-22T08:40:48.398449+0000","last_fullsized":"2023-12-22T08:40:48.398449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:30.540430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.946964+0000","last_change":"2023-12-22T08:40:45.889896+0000","last_active":"2023-12-22T08:40:47.946964+0000","last_peered":"2023-12-22T08:40:47.946964+0000","last_clean":"2023-12-22T08:40:47.946964+0000","last_became_active":"2023-12-22T08:40:45.888864+0000","last_became_peered":"2023-12-22T08:40:45.888864+0000","last_unstale":"2023-12-22T08:40:47.946964+0000","last_undegraded":"2023-12-22T08:40:47.946964+0000","last_fullsized":"2023-12-22T08:40:47.946964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398256+0000","last_change":"2023-12-22T08:40:45.881811+0000","last_active":"2023-12-22T08:40:48.398256+0000","last_peered":"2023-12-22T08:40:48.398256+0000","last_clean":"2023-12-22T08:40:48.398256+0000","last_became_active":"2023-12-22T08:40:45.881578+0000","last_became_peered":"2023-12-22T08:40:45.881578+0000","last_unstale":"2023-12-22T08:40:48.398256+0000","last_undegraded":"2023-12-22T08:40:48.398256+0000","last_fullsized":"2023-12-22T08:40:48.398256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:16.186426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868647+0000","last_change":"2023-12-22T08:40:45.892116+0000","last_active":"2023-12-22T08:40:46.868647+0000","last_peered":"2023-12-22T08:40:46.868647+0000","last_clean":"2023-12-22T08:40:46.868647+0000","last_became_active":"2023-12-22T08:40:45.891946+0000","last_became_peered":"2023-12-22T08:40:45.891946+0000","last_unstale":"2023-12-22T08:40:46.868647+0000","last_undegraded":"2023-12-22T08:40:46.868647+0000","last_fullsized":"2023-12-22T08:40:46.868647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398786+0000","last_change":"2023-12-22T08:40:45.890365+0000","last_active":"2023-12-22T08:40:48.398786+0000","last_peered":"2023-12-22T08:40:48.398786+0000","last_clean":"2023-12-22T08:40:48.398786+0000","last_became_active":"2023-12-22T08:40:45.890130+0000","last_became_peered":"2023-12-22T08:40:45.890130+0000","last_unstale":"2023-12-22T08:40:48.398786+0000","last_undegraded":"2023-12-22T08:40:48.398786+0000","last_fullsized":"2023-12-22T08:40:48.398786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:13.809967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975214+0000","last_change":"2023-12-22T08:40:45.889288+0000","last_active":"2023-12-22T08:40:47.975214+0000","last_peered":"2023-12-22T08:40:47.975214+0000","last_clean":"2023-12-22T08:40:47.975214+0000","last_became_active":"2023-12-22T08:40:45.889044+0000","last_became_peered":"2023-12-22T08:40:45.889044+0000","last_unstale":"2023-12-22T08:40:47.975214+0000","last_undegraded":"2023-12-22T08:40:47.975214+0000","last_fullsized":"2023-12-22T08:40:47.975214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975064+0000","last_change":"2023-12-22T08:40:45.890399+0000","last_active":"2023-12-22T08:40:47.975064+0000","last_peered":"2023-12-22T08:40:47.975064+0000","last_clean":"2023-12-22T08:40:47.975064+0000","last_became_active":"2023-12-22T08:40:45.890142+0000","last_became_peered":"2023-12-22T08:40:45.890142+0000","last_unstale":"2023-12-22T08:40:47.975064+0000","last_undegraded":"2023-12-22T08:40:47.975064+0000","last_fullsized":"2023-12-22T08:40:47.975064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869515+0000","last_change":"2023-12-22T08:40:45.877838+0000","last_active":"2023-12-22T08:40:46.869515+0000","last_peered":"2023-12-22T08:40:46.869515+0000","last_clean":"2023-12-22T08:40:46.869515+0000","last_became_active":"2023-12-22T08:40:45.877514+0000","last_became_peered":"2023-12-22T08:40:45.877514+0000","last_unstale":"2023-12-22T08:40:46.869515+0000","last_undegraded":"2023-12-22T08:40:46.869515+0000","last_fullsized":"2023-12-22T08:40:46.869515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:05.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868964+0000","last_change":"2023-12-22T08:40:45.891488+0000","last_active":"2023-12-22T08:40:46.868964+0000","last_peered":"2023-12-22T08:40:46.868964+0000","last_clean":"2023-12-22T08:40:46.868964+0000","last_became_active":"2023-12-22T08:40:45.891337+0000","last_became_peered":"2023-12-22T08:40:45.891337+0000","last_unstale":"2023-12-22T08:40:46.868964+0000","last_undegraded":"2023-12-22T08:40:46.868964+0000","last_fullsized":"2023-12-22T08:40:46.868964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868225+0000","last_change":"2023-12-22T08:40:45.878437+0000","last_active":"2023-12-22T08:40:46.868225+0000","last_peered":"2023-12-22T08:40:46.868225+0000","last_clean":"2023-12-22T08:40:46.868225+0000","last_became_active":"2023-12-22T08:40:45.878165+0000","last_became_peered":"2023-12-22T08:40:45.878165+0000","last_unstale":"2023-12-22T08:40:46.868225+0000","last_undegraded":"2023-12-22T08:40:46.868225+0000","last_fullsized":"2023-12-22T08:40:46.868225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398069+0000","last_change":"2023-12-22T08:40:45.878993+0000","last_active":"2023-12-22T08:40:48.398069+0000","last_peered":"2023-12-22T08:40:48.398069+0000","last_clean":"2023-12-22T08:40:48.398069+0000","last_became_active":"2023-12-22T08:40:45.878204+0000","last_became_peered":"2023-12-22T08:40:45.878204+0000","last_unstale":"2023-12-22T08:40:48.398069+0000","last_undegraded":"2023-12-22T08:40:48.398069+0000","last_fullsized":"2023-12-22T08:40:48.398069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.946898+0000","last_change":"2023-12-22T08:40:45.886532+0000","last_active":"2023-12-22T08:40:47.946898+0000","last_peered":"2023-12-22T08:40:47.946898+0000","last_clean":"2023-12-22T08:40:47.946898+0000","last_became_active":"2023-12-22T08:40:45.886207+0000","last_became_peered":"2023-12-22T08:40:45.886207+0000","last_unstale":"2023-12-22T08:40:47.946898+0000","last_undegraded":"2023-12-22T08:40:47.946898+0000","last_fullsized":"2023-12-22T08:40:47.946898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947576+0000","last_change":"2023-12-22T08:40:45.887660+0000","last_active":"2023-12-22T08:40:47.947576+0000","last_peered":"2023-12-22T08:40:47.947576+0000","last_clean":"2023-12-22T08:40:47.947576+0000","last_became_active":"2023-12-22T08:40:45.887406+0000","last_became_peered":"2023-12-22T08:40:45.887406+0000","last_unstale":"2023-12-22T08:40:47.947576+0000","last_undegraded":"2023-12-22T08:40:47.947576+0000","last_fullsized":"2023-12-22T08:40:47.947576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397941+0000","last_change":"2023-12-22T08:40:45.887556+0000","last_active":"2023-12-22T08:40:48.397941+0000","last_peered":"2023-12-22T08:40:48.397941+0000","last_clean":"2023-12-22T08:40:48.397941+0000","last_became_active":"2023-12-22T08:40:45.887294+0000","last_became_peered":"2023-12-22T08:40:45.887294+0000","last_unstale":"2023-12-22T08:40:48.397941+0000","last_undegraded":"2023-12-22T08:40:48.397941+0000","last_fullsized":"2023-12-22T08:40:48.397941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:45.489511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398722+0000","last_change":"2023-12-22T08:40:45.883598+0000","last_active":"2023-12-22T08:40:48.398722+0000","last_peered":"2023-12-22T08:40:48.398722+0000","last_clean":"2023-12-22T08:40:48.398722+0000","last_became_active":"2023-12-22T08:40:45.883319+0000","last_became_peered":"2023-12-22T08:40:45.883319+0000","last_unstale":"2023-12-22T08:40:48.398722+0000","last_undegraded":"2023-12-22T08:40:48.398722+0000","last_fullsized":"2023-12-22T08:40:48.398722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:33.421892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975025+0000","last_change":"2023-12-22T08:40:45.881672+0000","last_active":"2023-12-22T08:40:47.975025+0000","last_peered":"2023-12-22T08:40:47.975025+0000","last_clean":"2023-12-22T08:40:47.975025+0000","last_became_active":"2023-12-22T08:40:45.881403+0000","last_became_peered":"2023-12-22T08:40:45.881403+0000","last_unstale":"2023-12-22T08:40:47.975025+0000","last_undegraded":"2023-12-22T08:40:47.975025+0000","last_fullsized":"2023-12-22T08:40:47.975025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868566+0000","last_change":"2023-12-22T08:40:45.875815+0000","last_active":"2023-12-22T08:40:46.868566+0000","last_peered":"2023-12-22T08:40:46.868566+0000","last_clean":"2023-12-22T08:40:46.868566+0000","last_became_active":"2023-12-22T08:40:45.875552+0000","last_became_peered":"2023-12-22T08:40:45.875552+0000","last_unstale":"2023-12-22T08:40:46.868566+0000","last_undegraded":"2023-12-22T08:40:46.868566+0000","last_fullsized":"2023-12-22T08:40:46.868566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947204+0000","last_change":"2023-12-22T08:40:45.889509+0000","last_active":"2023-12-22T08:40:47.947204+0000","last_peered":"2023-12-22T08:40:47.947204+0000","last_clean":"2023-12-22T08:40:47.947204+0000","last_became_active":"2023-12-22T08:40:45.889147+0000","last_became_peered":"2023-12-22T08:40:45.889147+0000","last_unstale":"2023-12-22T08:40:47.947204+0000","last_undegraded":"2023-12-22T08:40:47.947204+0000","last_fullsized":"2023-12-22T08:40:47.947204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868668+0000","last_change":"2023-12-22T08:40:45.888792+0000","last_active":"2023-12-22T08:40:46.868668+0000","last_peered":"2023-12-22T08:40:46.868668+0000","last_clean":"2023-12-22T08:40:46.868668+0000","last_became_active":"2023-12-22T08:40:45.888190+0000","last_became_peered":"2023-12-22T08:40:45.888190+0000","last_unstale":"2023-12-22T08:40:46.868668+0000","last_undegraded":"2023-12-22T08:40:46.868668+0000","last_fullsized":"2023-12-22T08:40:46.868668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:14:22.484265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947028+0000","last_change":"2023-12-22T08:40:45.893300+0000","last_active":"2023-12-22T08:40:47.947028+0000","last_peered":"2023-12-22T08:40:47.947028+0000","last_clean":"2023-12-22T08:40:47.947028+0000","last_became_active":"2023-12-22T08:40:45.892789+0000","last_became_peered":"2023-12-22T08:40:45.892789+0000","last_unstale":"2023-12-22T08:40:47.947028+0000","last_undegraded":"2023-12-22T08:40:47.947028+0000","last_fullsized":"2023-12-22T08:40:47.947028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:30.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869172+0000","last_change":"2023-12-22T08:40:45.888716+0000","last_active":"2023-12-22T08:40:46.869172+0000","last_peered":"2023-12-22T08:40:46.869172+0000","last_clean":"2023-12-22T08:40:46.869172+0000","last_became_active":"2023-12-22T08:40:45.888164+0000","last_became_peered":"2023-12-22T08:40:45.888164+0000","last_unstale":"2023-12-22T08:40:46.869172+0000","last_undegraded":"2023-12-22T08:40:46.869172+0000","last_fullsized":"2023-12-22T08:40:46.869172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975264+0000","last_change":"2023-12-22T08:40:45.875528+0000","last_active":"2023-12-22T08:40:47.975264+0000","last_peered":"2023-12-22T08:40:47.975264+0000","last_clean":"2023-12-22T08:40:47.975264+0000","last_became_active":"2023-12-22T08:40:45.875275+0000","last_became_peered":"2023-12-22T08:40:45.875275+0000","last_unstale":"2023-12-22T08:40:47.975264+0000","last_undegraded":"2023-12-22T08:40:47.975264+0000","last_fullsized":"2023-12-22T08:40:47.975264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398211+0000","last_change":"2023-12-22T08:40:45.884223+0000","last_active":"2023-12-22T08:40:48.398211+0000","last_peered":"2023-12-22T08:40:48.398211+0000","last_clean":"2023-12-22T08:40:48.398211+0000","last_became_active":"2023-12-22T08:40:45.883970+0000","last_became_peered":"2023-12-22T08:40:45.883970+0000","last_unstale":"2023-12-22T08:40:48.398211+0000","last_undegraded":"2023-12-22T08:40:48.398211+0000","last_fullsized":"2023-12-22T08:40:48.398211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868912+0000","last_change":"2023-12-22T08:40:45.882599+0000","last_active":"2023-12-22T08:40:46.868912+0000","last_peered":"2023-12-22T08:40:46.868912+0000","last_clean":"2023-12-22T08:40:46.868912+0000","last_became_active":"2023-12-22T08:40:45.882327+0000","last_became_peered":"2023-12-22T08:40:45.882327+0000","last_unstale":"2023-12-22T08:40:46.868912+0000","last_undegraded":"2023-12-22T08:40:46.868912+0000","last_fullsized":"2023-12-22T08:40:46.868912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868649+0000","last_change":"2023-12-22T08:40:45.889519+0000","last_active":"2023-12-22T08:40:46.868649+0000","last_peered":"2023-12-22T08:40:46.868649+0000","last_clean":"2023-12-22T08:40:46.868649+0000","last_became_active":"2023-12-22T08:40:45.889215+0000","last_became_peered":"2023-12-22T08:40:45.889215+0000","last_unstale":"2023-12-22T08:40:46.868649+0000","last_undegraded":"2023-12-22T08:40:46.868649+0000","last_fullsized":"2023-12-22T08:40:46.868649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947237+0000","last_change":"2023-12-22T08:40:45.893059+0000","last_active":"2023-12-22T08:40:47.947237+0000","last_peered":"2023-12-22T08:40:47.947237+0000","last_clean":"2023-12-22T08:40:47.947237+0000","last_became_active":"2023-12-22T08:40:45.892669+0000","last_became_peered":"2023-12-22T08:40:45.892669+0000","last_unstale":"2023-12-22T08:40:47.947237+0000","last_undegraded":"2023-12-22T08:40:47.947237+0000","last_fullsized":"2023-12-22T08:40:47.947237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:13.809967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397775+0000","last_change":"2023-12-22T08:40:45.889241+0000","last_active":"2023-12-22T08:40:48.397775+0000","last_peered":"2023-12-22T08:40:48.397775+0000","last_clean":"2023-12-22T08:40:48.397775+0000","last_became_active":"2023-12-22T08:40:45.888986+0000","last_became_peered":"2023-12-22T08:40:45.888986+0000","last_unstale":"2023-12-22T08:40:48.397775+0000","last_undegraded":"2023-12-22T08:40:48.397775+0000","last_fullsized":"2023-12-22T08:40:48.397775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:05.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974913+0000","last_change":"2023-12-22T08:40:45.881924+0000","last_active":"2023-12-22T08:40:47.974913+0000","last_peered":"2023-12-22T08:40:47.974913+0000","last_clean":"2023-12-22T08:40:47.974913+0000","last_became_active":"2023-12-22T08:40:45.880927+0000","last_became_peered":"2023-12-22T08:40:45.880927+0000","last_unstale":"2023-12-22T08:40:47.974913+0000","last_undegraded":"2023-12-22T08:40:47.974913+0000","last_fullsized":"2023-12-22T08:40:47.974913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868974+0000","last_change":"2023-12-22T08:40:45.878836+0000","last_active":"2023-12-22T08:40:46.868974+0000","last_peered":"2023-12-22T08:40:46.868974+0000","last_clean":"2023-12-22T08:40:46.868974+0000","last_became_active":"2023-12-22T08:40:45.878561+0000","last_became_peered":"2023-12-22T08:40:45.878561+0000","last_unstale":"2023-12-22T08:40:46.868974+0000","last_undegraded":"2023-12-22T08:40:46.868974+0000","last_fullsized":"2023-12-22T08:40:46.868974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:26.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869042+0000","last_change":"2023-12-22T08:40:45.512780+0000","last_active":"2023-12-22T08:40:46.869042+0000","last_peered":"2023-12-22T08:40:46.869042+0000","last_clean":"2023-12-22T08:40:46.869042+0000","last_became_active":"2023-12-22T08:40:45.512502+0000","last_became_peered":"2023-12-22T08:40:45.512502+0000","last_unstale":"2023-12-22T08:40:46.869042+0000","last_undegraded":"2023-12-22T08:40:46.869042+0000","last_fullsized":"2023-12-22T08:40:46.869042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:27.751410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868831+0000","last_change":"2023-12-22T08:40:45.876753+0000","last_active":"2023-12-22T08:40:46.868831+0000","last_peered":"2023-12-22T08:40:46.868831+0000","last_clean":"2023-12-22T08:40:46.868831+0000","last_became_active":"2023-12-22T08:40:45.876192+0000","last_became_peered":"2023-12-22T08:40:45.876192+0000","last_unstale":"2023-12-22T08:40:46.868831+0000","last_undegraded":"2023-12-22T08:40:46.868831+0000","last_fullsized":"2023-12-22T08:40:46.868831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974998+0000","last_change":"2023-12-22T08:40:45.509309+0000","last_active":"2023-12-22T08:40:47.974998+0000","last_peered":"2023-12-22T08:40:47.974998+0000","last_clean":"2023-12-22T08:40:47.974998+0000","last_became_active":"2023-12-22T08:40:45.508805+0000","last_became_peered":"2023-12-22T08:40:45.508805+0000","last_unstale":"2023-12-22T08:40:47.974998+0000","last_undegraded":"2023-12-22T08:40:47.974998+0000","last_fullsized":"2023-12-22T08:40:47.974998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868799+0000","last_change":"2023-12-22T08:40:45.511261+0000","last_active":"2023-12-22T08:40:46.868799+0000","last_peered":"2023-12-22T08:40:46.868799+0000","last_clean":"2023-12-22T08:40:46.868799+0000","last_became_active":"2023-12-22T08:40:45.510991+0000","last_became_peered":"2023-12-22T08:40:45.510991+0000","last_unstale":"2023-12-22T08:40:46.868799+0000","last_undegraded":"2023-12-22T08:40:46.868799+0000","last_fullsized":"2023-12-22T08:40:46.868799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868743+0000","last_change":"2023-12-22T08:40:45.885554+0000","last_active":"2023-12-22T08:40:46.868743+0000","last_peered":"2023-12-22T08:40:46.868743+0000","last_clean":"2023-12-22T08:40:46.868743+0000","last_became_active":"2023-12-22T08:40:45.885316+0000","last_became_peered":"2023-12-22T08:40:45.885316+0000","last_unstale":"2023-12-22T08:40:46.868743+0000","last_undegraded":"2023-12-22T08:40:46.868743+0000","last_fullsized":"2023-12-22T08:40:46.868743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947033+0000","last_change":"2023-12-22T08:40:45.504497+0000","last_active":"2023-12-22T08:40:47.947033+0000","last_peered":"2023-12-22T08:40:47.947033+0000","last_clean":"2023-12-22T08:40:47.947033+0000","last_became_active":"2023-12-22T08:40:45.504227+0000","last_became_peered":"2023-12-22T08:40:45.504227+0000","last_unstale":"2023-12-22T08:40:47.947033+0000","last_undegraded":"2023-12-22T08:40:47.947033+0000","last_fullsized":"2023-12-22T08:40:47.947033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397985+0000","last_change":"2023-12-22T08:40:45.884410+0000","last_active":"2023-12-22T08:40:48.397985+0000","last_peered":"2023-12-22T08:40:48.397985+0000","last_clean":"2023-12-22T08:40:48.397985+0000","last_became_active":"2023-12-22T08:40:45.884074+0000","last_became_peered":"2023-12-22T08:40:45.884074+0000","last_unstale":"2023-12-22T08:40:48.397985+0000","last_undegraded":"2023-12-22T08:40:48.397985+0000","last_fullsized":"2023-12-22T08:40:48.397985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975082+0000","last_change":"2023-12-22T08:40:45.511242+0000","last_active":"2023-12-22T08:40:47.975082+0000","last_peered":"2023-12-22T08:40:47.975082+0000","last_clean":"2023-12-22T08:40:47.975082+0000","last_became_active":"2023-12-22T08:40:45.510960+0000","last_became_peered":"2023-12-22T08:40:45.510960+0000","last_unstale":"2023-12-22T08:40:47.975082+0000","last_undegraded":"2023-12-22T08:40:47.975082+0000","last_fullsized":"2023-12-22T08:40:47.975082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947286+0000","last_change":"2023-12-22T08:40:45.888628+0000","last_active":"2023-12-22T08:40:47.947286+0000","last_peered":"2023-12-22T08:40:47.947286+0000","last_clean":"2023-12-22T08:40:47.947286+0000","last_became_active":"2023-12-22T08:40:45.888351+0000","last_became_peered":"2023-12-22T08:40:45.888351+0000","last_unstale":"2023-12-22T08:40:47.947286+0000","last_undegraded":"2023-12-22T08:40:47.947286+0000","last_fullsized":"2023-12-22T08:40:47.947286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:16.186426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947394+0000","last_change":"2023-12-22T08:40:45.507232+0000","last_active":"2023-12-22T08:40:47.947394+0000","last_peered":"2023-12-22T08:40:47.947394+0000","last_clean":"2023-12-22T08:40:47.947394+0000","last_became_active":"2023-12-22T08:40:45.506953+0000","last_became_peered":"2023-12-22T08:40:45.506953+0000","last_unstale":"2023-12-22T08:40:47.947394+0000","last_undegraded":"2023-12-22T08:40:47.947394+0000","last_fullsized":"2023-12-22T08:40:47.947394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868557+0000","last_change":"2023-12-22T08:40:45.890659+0000","last_active":"2023-12-22T08:40:46.868557+0000","last_peered":"2023-12-22T08:40:46.868557+0000","last_clean":"2023-12-22T08:40:46.868557+0000","last_became_active":"2023-12-22T08:40:45.889673+0000","last_became_peered":"2023-12-22T08:40:45.889673+0000","last_unstale":"2023-12-22T08:40:46.868557+0000","last_undegraded":"2023-12-22T08:40:46.868557+0000","last_fullsized":"2023-12-22T08:40:46.868557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398207+0000","last_change":"2023-12-22T08:40:45.507641+0000","last_active":"2023-12-22T08:40:48.398207+0000","last_peered":"2023-12-22T08:40:48.398207+0000","last_clean":"2023-12-22T08:40:48.398207+0000","last_became_active":"2023-12-22T08:40:45.507322+0000","last_became_peered":"2023-12-22T08:40:45.507322+0000","last_unstale":"2023-12-22T08:40:48.398207+0000","last_undegraded":"2023-12-22T08:40:48.398207+0000","last_fullsized":"2023-12-22T08:40:48.398207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:25.292485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869520+0000","last_change":"2023-12-22T08:40:45.877133+0000","last_active":"2023-12-22T08:40:46.869520+0000","last_peered":"2023-12-22T08:40:46.869520+0000","last_clean":"2023-12-22T08:40:46.869520+0000","last_became_active":"2023-12-22T08:40:45.876811+0000","last_became_peered":"2023-12-22T08:40:45.876811+0000","last_unstale":"2023-12-22T08:40:46.869520+0000","last_undegraded":"2023-12-22T08:40:46.869520+0000","last_fullsized":"2023-12-22T08:40:46.869520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:45.181460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975130+0000","last_change":"2023-12-22T08:40:45.515520+0000","last_active":"2023-12-22T08:40:47.975130+0000","last_peered":"2023-12-22T08:40:47.975130+0000","last_clean":"2023-12-22T08:40:47.975130+0000","last_became_active":"2023-12-22T08:40:45.515191+0000","last_became_peered":"2023-12-22T08:40:45.515191+0000","last_unstale":"2023-12-22T08:40:47.975130+0000","last_undegraded":"2023-12-22T08:40:47.975130+0000","last_fullsized":"2023-12-22T08:40:47.975130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398510+0000","last_change":"2023-12-22T08:40:45.884908+0000","last_active":"2023-12-22T08:40:48.398510+0000","last_peered":"2023-12-22T08:40:48.398510+0000","last_clean":"2023-12-22T08:40:48.398510+0000","last_became_active":"2023-12-22T08:40:45.884670+0000","last_became_peered":"2023-12-22T08:40:45.884670+0000","last_unstale":"2023-12-22T08:40:48.398510+0000","last_undegraded":"2023-12-22T08:40:48.398510+0000","last_fullsized":"2023-12-22T08:40:48.398510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:17.567380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868744+0000","last_change":"2023-12-22T08:40:45.509332+0000","last_active":"2023-12-22T08:40:46.868744+0000","last_peered":"2023-12-22T08:40:46.868744+0000","last_clean":"2023-12-22T08:40:46.868744+0000","last_became_active":"2023-12-22T08:40:45.509052+0000","last_became_peered":"2023-12-22T08:40:45.509052+0000","last_unstale":"2023-12-22T08:40:46.868744+0000","last_undegraded":"2023-12-22T08:40:46.868744+0000","last_fullsized":"2023-12-22T08:40:46.868744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:27.751410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868335+0000","last_change":"2023-12-22T08:40:45.875255+0000","last_active":"2023-12-22T08:40:46.868335+0000","last_peered":"2023-12-22T08:40:46.868335+0000","last_clean":"2023-12-22T08:40:46.868335+0000","last_became_active":"2023-12-22T08:40:45.875014+0000","last_became_peered":"2023-12-22T08:40:45.875014+0000","last_unstale":"2023-12-22T08:40:46.868335+0000","last_undegraded":"2023-12-22T08:40:46.868335+0000","last_fullsized":"2023-12-22T08:40:46.868335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947312+0000","last_change":"2023-12-22T08:40:45.513554+0000","last_active":"2023-12-22T08:40:47.947312+0000","last_peered":"2023-12-22T08:40:47.947312+0000","last_clean":"2023-12-22T08:40:47.947312+0000","last_became_active":"2023-12-22T08:40:45.513255+0000","last_became_peered":"2023-12-22T08:40:45.513255+0000","last_unstale":"2023-12-22T08:40:47.947312+0000","last_undegraded":"2023-12-22T08:40:47.947312+0000","last_fullsized":"2023-12-22T08:40:47.947312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398497+0000","last_change":"2023-12-22T08:40:45.886788+0000","last_active":"2023-12-22T08:40:48.398497+0000","last_peered":"2023-12-22T08:40:48.398497+0000","last_clean":"2023-12-22T08:40:48.398497+0000","last_became_active":"2023-12-22T08:40:45.886544+0000","last_became_peered":"2023-12-22T08:40:45.886544+0000","last_unstale":"2023-12-22T08:40:48.398497+0000","last_undegraded":"2023-12-22T08:40:48.398497+0000","last_fullsized":"2023-12-22T08:40:48.398497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974941+0000","last_change":"2023-12-22T08:40:45.508706+0000","last_active":"2023-12-22T08:40:47.974941+0000","last_peered":"2023-12-22T08:40:47.974941+0000","last_clean":"2023-12-22T08:40:47.974941+0000","last_became_active":"2023-12-22T08:40:45.508419+0000","last_became_peered":"2023-12-22T08:40:45.508419+0000","last_unstale":"2023-12-22T08:40:47.974941+0000","last_undegraded":"2023-12-22T08:40:47.974941+0000","last_fullsized":"2023-12-22T08:40:47.974941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974937+0000","last_change":"2023-12-22T08:40:45.881751+0000","last_active":"2023-12-22T08:40:47.974937+0000","last_peered":"2023-12-22T08:40:47.974937+0000","last_clean":"2023-12-22T08:40:47.974937+0000","last_became_active":"2023-12-22T08:40:45.881474+0000","last_became_peered":"2023-12-22T08:40:45.881474+0000","last_unstale":"2023-12-22T08:40:47.974937+0000","last_undegraded":"2023-12-22T08:40:47.974937+0000","last_fullsized":"2023-12-22T08:40:47.974937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397769+0000","last_change":"2023-12-22T08:40:45.505971+0000","last_active":"2023-12-22T08:40:48.397769+0000","last_peered":"2023-12-22T08:40:48.397769+0000","last_clean":"2023-12-22T08:40:48.397769+0000","last_became_active":"2023-12-22T08:40:45.505672+0000","last_became_peered":"2023-12-22T08:40:45.505672+0000","last_unstale":"2023-12-22T08:40:48.397769+0000","last_undegraded":"2023-12-22T08:40:48.397769+0000","last_fullsized":"2023-12-22T08:40:48.397769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398260+0000","last_change":"2023-12-22T08:40:45.879566+0000","last_active":"2023-12-22T08:40:48.398260+0000","last_peered":"2023-12-22T08:40:48.398260+0000","last_clean":"2023-12-22T08:40:48.398260+0000","last_became_active":"2023-12-22T08:40:45.879319+0000","last_became_peered":"2023-12-22T08:40:45.879319+0000","last_unstale":"2023-12-22T08:40:48.398260+0000","last_undegraded":"2023-12-22T08:40:48.398260+0000","last_fullsized":"2023-12-22T08:40:48.398260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:41:59.148169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869645+0000","last_change":"2023-12-22T08:40:45.511686+0000","last_active":"2023-12-22T08:40:46.869645+0000","last_peered":"2023-12-22T08:40:46.869645+0000","last_clean":"2023-12-22T08:40:46.869645+0000","last_became_active":"2023-12-22T08:40:45.511341+0000","last_became_peered":"2023-12-22T08:40:45.511341+0000","last_unstale":"2023-12-22T08:40:46.869645+0000","last_undegraded":"2023-12-22T08:40:46.869645+0000","last_fullsized":"2023-12-22T08:40:46.869645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:34:01.717358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398720+0000","last_change":"2023-12-22T08:40:45.882380+0000","last_active":"2023-12-22T08:40:48.398720+0000","last_peered":"2023-12-22T08:40:48.398720+0000","last_clean":"2023-12-22T08:40:48.398720+0000","last_became_active":"2023-12-22T08:40:45.882119+0000","last_became_peered":"2023-12-22T08:40:45.882119+0000","last_unstale":"2023-12-22T08:40:48.398720+0000","last_undegraded":"2023-12-22T08:40:48.398720+0000","last_fullsized":"2023-12-22T08:40:48.398720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398030+0000","last_change":"2023-12-22T08:40:45.513658+0000","last_active":"2023-12-22T08:40:48.398030+0000","last_peered":"2023-12-22T08:40:48.398030+0000","last_clean":"2023-12-22T08:40:48.398030+0000","last_became_active":"2023-12-22T08:40:45.513339+0000","last_became_peered":"2023-12-22T08:40:45.513339+0000","last_unstale":"2023-12-22T08:40:48.398030+0000","last_undegraded":"2023-12-22T08:40:48.398030+0000","last_fullsized":"2023-12-22T08:40:48.398030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398866+0000","last_change":"2023-12-22T08:40:45.885859+0000","last_active":"2023-12-22T08:40:48.398866+0000","last_peered":"2023-12-22T08:40:48.398866+0000","last_clean":"2023-12-22T08:40:48.398866+0000","last_became_active":"2023-12-22T08:40:45.885570+0000","last_became_peered":"2023-12-22T08:40:45.885570+0000","last_unstale":"2023-12-22T08:40:48.398866+0000","last_undegraded":"2023-12-22T08:40:48.398866+0000","last_fullsized":"2023-12-22T08:40:48.398866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398284+0000","last_change":"2023-12-22T08:40:45.505894+0000","last_active":"2023-12-22T08:40:48.398284+0000","last_peered":"2023-12-22T08:40:48.398284+0000","last_clean":"2023-12-22T08:40:48.398284+0000","last_became_active":"2023-12-22T08:40:45.505632+0000","last_became_peered":"2023-12-22T08:40:45.505632+0000","last_unstale":"2023-12-22T08:40:48.398284+0000","last_undegraded":"2023-12-22T08:40:48.398284+0000","last_fullsized":"2023-12-22T08:40:48.398284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947422+0000","last_change":"2023-12-22T08:40:45.892678+0000","last_active":"2023-12-22T08:40:47.947422+0000","last_peered":"2023-12-22T08:40:47.947422+0000","last_clean":"2023-12-22T08:40:47.947422+0000","last_became_active":"2023-12-22T08:40:45.892124+0000","last_became_peered":"2023-12-22T08:40:45.892124+0000","last_unstale":"2023-12-22T08:40:47.947422+0000","last_undegraded":"2023-12-22T08:40:47.947422+0000","last_fullsized":"2023-12-22T08:40:47.947422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:30.540430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398091+0000","last_change":"2023-12-22T08:40:45.508702+0000","last_active":"2023-12-22T08:40:48.398091+0000","last_peered":"2023-12-22T08:40:48.398091+0000","last_clean":"2023-12-22T08:40:48.398091+0000","last_became_active":"2023-12-22T08:40:45.508363+0000","last_became_peered":"2023-12-22T08:40:45.508363+0000","last_unstale":"2023-12-22T08:40:48.398091+0000","last_undegraded":"2023-12-22T08:40:48.398091+0000","last_fullsized":"2023-12-22T08:40:48.398091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398572+0000","last_change":"2023-12-22T08:40:45.891244+0000","last_active":"2023-12-22T08:40:48.398572+0000","last_peered":"2023-12-22T08:40:48.398572+0000","last_clean":"2023-12-22T08:40:48.398572+0000","last_became_active":"2023-12-22T08:40:45.890987+0000","last_became_peered":"2023-12-22T08:40:45.890987+0000","last_unstale":"2023-12-22T08:40:48.398572+0000","last_undegraded":"2023-12-22T08:40:48.398572+0000","last_fullsized":"2023-12-22T08:40:48.398572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:57.963627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:40:45.872970+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:40:45.872970+0000","last_peered":"2023-12-22T08:40:45.872970+0000","last_clean":"2023-12-22T08:40:45.872970+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:40:45.872970+0000","last_undegraded":"2023-12-22T08:40:45.872970+0000","last_fullsized":"2023-12-22T08:40:45.872970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947033+0000","last_change":"2023-12-22T08:40:45.502151+0000","last_active":"2023-12-22T08:40:47.947033+0000","last_peered":"2023-12-22T08:40:47.947033+0000","last_clean":"2023-12-22T08:40:47.947033+0000","last_became_active":"2023-12-22T08:40:45.501868+0000","last_became_peered":"2023-12-22T08:40:45.501868+0000","last_unstale":"2023-12-22T08:40:47.947033+0000","last_undegraded":"2023-12-22T08:40:47.947033+0000","last_fullsized":"2023-12-22T08:40:47.947033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868537+0000","last_change":"2023-12-22T08:40:45.892243+0000","last_active":"2023-12-22T08:40:46.868537+0000","last_peered":"2023-12-22T08:40:46.868537+0000","last_clean":"2023-12-22T08:40:46.868537+0000","last_became_active":"2023-12-22T08:40:45.892042+0000","last_became_peered":"2023-12-22T08:40:45.892042+0000","last_unstale":"2023-12-22T08:40:46.868537+0000","last_undegraded":"2023-12-22T08:40:46.868537+0000","last_fullsized":"2023-12-22T08:40:46.868537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398193+0000","last_change":"2023-12-22T08:40:45.508515+0000","last_active":"2023-12-22T08:40:48.398193+0000","last_peered":"2023-12-22T08:40:48.398193+0000","last_clean":"2023-12-22T08:40:48.398193+0000","last_became_active":"2023-12-22T08:40:45.508155+0000","last_became_peered":"2023-12-22T08:40:45.508155+0000","last_unstale":"2023-12-22T08:40:48.398193+0000","last_undegraded":"2023-12-22T08:40:48.398193+0000","last_fullsized":"2023-12-22T08:40:48.398193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868150+0000","last_change":"2023-12-22T08:40:45.875984+0000","last_active":"2023-12-22T08:40:46.868150+0000","last_peered":"2023-12-22T08:40:46.868150+0000","last_clean":"2023-12-22T08:40:46.868150+0000","last_became_active":"2023-12-22T08:40:45.875646+0000","last_became_peered":"2023-12-22T08:40:45.875646+0000","last_unstale":"2023-12-22T08:40:46.868150+0000","last_undegraded":"2023-12-22T08:40:46.868150+0000","last_fullsized":"2023-12-22T08:40:46.868150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397864+0000","last_change":"2023-12-22T08:40:45.513879+0000","last_active":"2023-12-22T08:40:48.397864+0000","last_peered":"2023-12-22T08:40:48.397864+0000","last_clean":"2023-12-22T08:40:48.397864+0000","last_became_active":"2023-12-22T08:40:45.513329+0000","last_became_peered":"2023-12-22T08:40:45.513329+0000","last_unstale":"2023-12-22T08:40:48.397864+0000","last_undegraded":"2023-12-22T08:40:48.397864+0000","last_fullsized":"2023-12-22T08:40:48.397864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398049+0000","last_change":"2023-12-22T08:40:45.883287+0000","last_active":"2023-12-22T08:40:48.398049+0000","last_peered":"2023-12-22T08:40:48.398049+0000","last_clean":"2023-12-22T08:40:48.398049+0000","last_became_active":"2023-12-22T08:40:45.883029+0000","last_became_peered":"2023-12-22T08:40:45.883029+0000","last_unstale":"2023-12-22T08:40:48.398049+0000","last_undegraded":"2023-12-22T08:40:48.398049+0000","last_fullsized":"2023-12-22T08:40:48.398049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:51:18.636850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947366+0000","last_change":"2023-12-22T08:40:45.506897+0000","last_active":"2023-12-22T08:40:47.947366+0000","last_peered":"2023-12-22T08:40:47.947366+0000","last_clean":"2023-12-22T08:40:47.947366+0000","last_became_active":"2023-12-22T08:40:45.506629+0000","last_became_peered":"2023-12-22T08:40:45.506629+0000","last_unstale":"2023-12-22T08:40:47.947366+0000","last_undegraded":"2023-12-22T08:40:47.947366+0000","last_fullsized":"2023-12-22T08:40:47.947366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869291+0000","last_change":"2023-12-22T08:40:45.881933+0000","last_active":"2023-12-22T08:40:46.869291+0000","last_peered":"2023-12-22T08:40:46.869291+0000","last_clean":"2023-12-22T08:40:46.869291+0000","last_became_active":"2023-12-22T08:40:45.881668+0000","last_became_peered":"2023-12-22T08:40:45.881668+0000","last_unstale":"2023-12-22T08:40:46.869291+0000","last_undegraded":"2023-12-22T08:40:46.869291+0000","last_fullsized":"2023-12-22T08:40:46.869291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:45.489511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398192+0000","last_change":"2023-12-22T08:40:45.510517+0000","last_active":"2023-12-22T08:40:48.398192+0000","last_peered":"2023-12-22T08:40:48.398192+0000","last_clean":"2023-12-22T08:40:48.398192+0000","last_became_active":"2023-12-22T08:40:45.510251+0000","last_became_peered":"2023-12-22T08:40:45.510251+0000","last_unstale":"2023-12-22T08:40:48.398192+0000","last_undegraded":"2023-12-22T08:40:48.398192+0000","last_fullsized":"2023-12-22T08:40:48.398192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:04.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947392+0000","last_change":"2023-12-22T08:40:45.893451+0000","last_active":"2023-12-22T08:40:47.947392+0000","last_peered":"2023-12-22T08:40:47.947392+0000","last_clean":"2023-12-22T08:40:47.947392+0000","last_became_active":"2023-12-22T08:40:45.893164+0000","last_became_peered":"2023-12-22T08:40:45.893164+0000","last_unstale":"2023-12-22T08:40:47.947392+0000","last_undegraded":"2023-12-22T08:40:47.947392+0000","last_fullsized":"2023-12-22T08:40:47.947392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:41:59.148169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398723+0000","last_change":"2023-12-22T08:40:45.512956+0000","last_active":"2023-12-22T08:40:48.398723+0000","last_peered":"2023-12-22T08:40:48.398723+0000","last_clean":"2023-12-22T08:40:48.398723+0000","last_became_active":"2023-12-22T08:40:45.512647+0000","last_became_peered":"2023-12-22T08:40:45.512647+0000","last_unstale":"2023-12-22T08:40:48.398723+0000","last_undegraded":"2023-12-22T08:40:48.398723+0000","last_fullsized":"2023-12-22T08:40:48.398723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:12:03.015743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398318+0000","last_change":"2023-12-22T08:40:45.879030+0000","last_active":"2023-12-22T08:40:48.398318+0000","last_peered":"2023-12-22T08:40:48.398318+0000","last_clean":"2023-12-22T08:40:48.398318+0000","last_became_active":"2023-12-22T08:40:45.878738+0000","last_became_peered":"2023-12-22T08:40:45.878738+0000","last_unstale":"2023-12-22T08:40:48.398318+0000","last_undegraded":"2023-12-22T08:40:48.398318+0000","last_fullsized":"2023-12-22T08:40:48.398318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398259+0000","last_change":"2023-12-22T08:40:45.504141+0000","last_active":"2023-12-22T08:40:48.398259+0000","last_peered":"2023-12-22T08:40:48.398259+0000","last_clean":"2023-12-22T08:40:48.398259+0000","last_became_active":"2023-12-22T08:40:45.503853+0000","last_became_peered":"2023-12-22T08:40:45.503853+0000","last_unstale":"2023-12-22T08:40:48.398259+0000","last_undegraded":"2023-12-22T08:40:48.398259+0000","last_fullsized":"2023-12-22T08:40:48.398259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869172+0000","last_change":"2023-12-22T08:40:45.886077+0000","last_active":"2023-12-22T08:40:46.869172+0000","last_peered":"2023-12-22T08:40:46.869172+0000","last_clean":"2023-12-22T08:40:46.869172+0000","last_became_active":"2023-12-22T08:40:45.885810+0000","last_became_peered":"2023-12-22T08:40:45.885810+0000","last_unstale":"2023-12-22T08:40:46.869172+0000","last_undegraded":"2023-12-22T08:40:46.869172+0000","last_fullsized":"2023-12-22T08:40:46.869172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975100+0000","last_change":"2023-12-22T08:40:45.508614+0000","last_active":"2023-12-22T08:40:47.975100+0000","last_peered":"2023-12-22T08:40:47.975100+0000","last_clean":"2023-12-22T08:40:47.975100+0000","last_became_active":"2023-12-22T08:40:45.508360+0000","last_became_peered":"2023-12-22T08:40:45.508360+0000","last_unstale":"2023-12-22T08:40:47.975100+0000","last_undegraded":"2023-12-22T08:40:47.975100+0000","last_fullsized":"2023-12-22T08:40:47.975100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868357+0000","last_change":"2023-12-22T08:40:45.873932+0000","last_active":"2023-12-22T08:40:46.868357+0000","last_peered":"2023-12-22T08:40:46.868357+0000","last_clean":"2023-12-22T08:40:46.868357+0000","last_became_active":"2023-12-22T08:40:45.873690+0000","last_became_peered":"2023-12-22T08:40:45.873690+0000","last_unstale":"2023-12-22T08:40:46.868357+0000","last_undegraded":"2023-12-22T08:40:46.868357+0000","last_fullsized":"2023-12-22T08:40:46.868357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:51:49.322300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398164+0000","last_change":"2023-12-22T08:40:45.513413+0000","last_active":"2023-12-22T08:40:48.398164+0000","last_peered":"2023-12-22T08:40:48.398164+0000","last_clean":"2023-12-22T08:40:48.398164+0000","last_became_active":"2023-12-22T08:40:45.512578+0000","last_became_peered":"2023-12-22T08:40:45.512578+0000","last_unstale":"2023-12-22T08:40:48.398164+0000","last_undegraded":"2023-12-22T08:40:48.398164+0000","last_fullsized":"2023-12-22T08:40:48.398164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:04.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869079+0000","last_change":"2023-12-22T08:40:45.884963+0000","last_active":"2023-12-22T08:40:46.869079+0000","last_peered":"2023-12-22T08:40:46.869079+0000","last_clean":"2023-12-22T08:40:46.869079+0000","last_became_active":"2023-12-22T08:40:45.884695+0000","last_became_peered":"2023-12-22T08:40:45.884695+0000","last_unstale":"2023-12-22T08:40:46.869079+0000","last_undegraded":"2023-12-22T08:40:46.869079+0000","last_fullsized":"2023-12-22T08:40:46.869079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:35.519308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398062+0000","last_change":"2023-12-22T08:40:45.507307+0000","last_active":"2023-12-22T08:40:48.398062+0000","last_peered":"2023-12-22T08:40:48.398062+0000","last_clean":"2023-12-22T08:40:48.398062+0000","last_became_active":"2023-12-22T08:40:45.506990+0000","last_became_peered":"2023-12-22T08:40:45.506990+0000","last_unstale":"2023-12-22T08:40:48.398062+0000","last_undegraded":"2023-12-22T08:40:48.398062+0000","last_fullsized":"2023-12-22T08:40:48.398062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868827+0000","last_change":"2023-12-22T08:40:45.884456+0000","last_active":"2023-12-22T08:40:46.868827+0000","last_peered":"2023-12-22T08:40:46.868827+0000","last_clean":"2023-12-22T08:40:46.868827+0000","last_became_active":"2023-12-22T08:40:45.884201+0000","last_became_peered":"2023-12-22T08:40:45.884201+0000","last_unstale":"2023-12-22T08:40:46.868827+0000","last_undegraded":"2023-12-22T08:40:46.868827+0000","last_fullsized":"2023-12-22T08:40:46.868827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398187+0000","last_change":"2023-12-22T08:40:45.515513+0000","last_active":"2023-12-22T08:40:48.398187+0000","last_peered":"2023-12-22T08:40:48.398187+0000","last_clean":"2023-12-22T08:40:48.398187+0000","last_became_active":"2023-12-22T08:40:45.515195+0000","last_became_peered":"2023-12-22T08:40:45.515195+0000","last_unstale":"2023-12-22T08:40:48.398187+0000","last_undegraded":"2023-12-22T08:40:48.398187+0000","last_fullsized":"2023-12-22T08:40:48.398187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869019+0000","last_change":"2023-12-22T08:40:45.887878+0000","last_active":"2023-12-22T08:40:46.869019+0000","last_peered":"2023-12-22T08:40:46.869019+0000","last_clean":"2023-12-22T08:40:46.869019+0000","last_became_active":"2023-12-22T08:40:45.887636+0000","last_became_peered":"2023-12-22T08:40:45.887636+0000","last_unstale":"2023-12-22T08:40:46.869019+0000","last_undegraded":"2023-12-22T08:40:46.869019+0000","last_fullsized":"2023-12-22T08:40:46.869019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398552+0000","last_change":"2023-12-22T08:40:45.508892+0000","last_active":"2023-12-22T08:40:48.398552+0000","last_peered":"2023-12-22T08:40:48.398552+0000","last_clean":"2023-12-22T08:40:48.398552+0000","last_became_active":"2023-12-22T08:40:45.508596+0000","last_became_peered":"2023-12-22T08:40:45.508596+0000","last_unstale":"2023-12-22T08:40:48.398552+0000","last_undegraded":"2023-12-22T08:40:48.398552+0000","last_fullsized":"2023-12-22T08:40:48.398552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:25.292485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974883+0000","last_change":"2023-12-22T08:40:45.882288+0000","last_active":"2023-12-22T08:40:47.974883+0000","last_peered":"2023-12-22T08:40:47.974883+0000","last_clean":"2023-12-22T08:40:47.974883+0000","last_became_active":"2023-12-22T08:40:45.882025+0000","last_became_peered":"2023-12-22T08:40:45.882025+0000","last_unstale":"2023-12-22T08:40:47.974883+0000","last_undegraded":"2023-12-22T08:40:47.974883+0000","last_fullsized":"2023-12-22T08:40:47.974883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947348+0000","last_change":"2023-12-22T08:40:45.889079+0000","last_active":"2023-12-22T08:40:47.947348+0000","last_peered":"2023-12-22T08:40:47.947348+0000","last_clean":"2023-12-22T08:40:47.947348+0000","last_became_active":"2023-12-22T08:40:45.888545+0000","last_became_peered":"2023-12-22T08:40:45.888545+0000","last_unstale":"2023-12-22T08:40:47.947348+0000","last_undegraded":"2023-12-22T08:40:47.947348+0000","last_fullsized":"2023-12-22T08:40:47.947348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398487+0000","last_change":"2023-12-22T08:40:45.510991+0000","last_active":"2023-12-22T08:40:48.398487+0000","last_peered":"2023-12-22T08:40:48.398487+0000","last_clean":"2023-12-22T08:40:48.398487+0000","last_became_active":"2023-12-22T08:40:45.510738+0000","last_became_peered":"2023-12-22T08:40:45.510738+0000","last_unstale":"2023-12-22T08:40:48.398487+0000","last_undegraded":"2023-12-22T08:40:48.398487+0000","last_fullsized":"2023-12-22T08:40:48.398487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:44.484526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947402+0000","last_change":"2023-12-22T08:40:45.890868+0000","last_active":"2023-12-22T08:40:47.947402+0000","last_peered":"2023-12-22T08:40:47.947402+0000","last_clean":"2023-12-22T08:40:47.947402+0000","last_became_active":"2023-12-22T08:40:45.890569+0000","last_became_peered":"2023-12-22T08:40:45.890569+0000","last_unstale":"2023-12-22T08:40:47.947402+0000","last_undegraded":"2023-12-22T08:40:47.947402+0000","last_fullsized":"2023-12-22T08:40:47.947402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398584+0000","last_change":"2023-12-22T08:40:45.511043+0000","last_active":"2023-12-22T08:40:48.398584+0000","last_peered":"2023-12-22T08:40:48.398584+0000","last_clean":"2023-12-22T08:40:48.398584+0000","last_became_active":"2023-12-22T08:40:45.510756+0000","last_became_peered":"2023-12-22T08:40:45.510756+0000","last_unstale":"2023-12-22T08:40:48.398584+0000","last_undegraded":"2023-12-22T08:40:48.398584+0000","last_fullsized":"2023-12-22T08:40:48.398584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868465+0000","last_change":"2023-12-22T08:40:45.890415+0000","last_active":"2023-12-22T08:40:46.868465+0000","last_peered":"2023-12-22T08:40:46.868465+0000","last_clean":"2023-12-22T08:40:46.868465+0000","last_became_active":"2023-12-22T08:40:45.889396+0000","last_became_peered":"2023-12-22T08:40:45.889396+0000","last_unstale":"2023-12-22T08:40:46.868465+0000","last_undegraded":"2023-12-22T08:40:46.868465+0000","last_fullsized":"2023-12-22T08:40:46.868465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869104+0000","last_change":"2023-12-22T08:40:45.515548+0000","last_active":"2023-12-22T08:40:46.869104+0000","last_peered":"2023-12-22T08:40:46.869104+0000","last_clean":"2023-12-22T08:40:46.869104+0000","last_became_active":"2023-12-22T08:40:45.515186+0000","last_became_peered":"2023-12-22T08:40:45.515186+0000","last_unstale":"2023-12-22T08:40:46.869104+0000","last_undegraded":"2023-12-22T08:40:46.869104+0000","last_fullsized":"2023-12-22T08:40:46.869104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868946+0000","last_change":"2023-12-22T08:40:45.891682+0000","last_active":"2023-12-22T08:40:46.868946+0000","last_peered":"2023-12-22T08:40:46.868946+0000","last_clean":"2023-12-22T08:40:46.868946+0000","last_became_active":"2023-12-22T08:40:45.891415+0000","last_became_peered":"2023-12-22T08:40:45.891415+0000","last_unstale":"2023-12-22T08:40:46.868946+0000","last_undegraded":"2023-12-22T08:40:46.868946+0000","last_fullsized":"2023-12-22T08:40:46.868946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868641+0000","last_change":"2023-12-22T08:40:45.510426+0000","last_active":"2023-12-22T08:40:46.868641+0000","last_peered":"2023-12-22T08:40:46.868641+0000","last_clean":"2023-12-22T08:40:46.868641+0000","last_became_active":"2023-12-22T08:40:45.510100+0000","last_became_peered":"2023-12-22T08:40:45.510100+0000","last_unstale":"2023-12-22T08:40:46.868641+0000","last_undegraded":"2023-12-22T08:40:46.868641+0000","last_fullsized":"2023-12-22T08:40:46.868641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":64758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:40:50.210 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:40:50.210 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-22T08:40:50.211 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-22T08:40:50.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-22T08:40:50.211 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.349+0000 7f8c3d226640 1 Processor -- start 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.349+0000 7f8c3d226640 1 -- start start 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3d226640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8c3806a6d0 0x7f8c3814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3d226640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c380ba550 0x7f8c381554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3d226640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c380bb310 con 0x7f8c3814b1f0 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3d226640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c380bf960 con 0x7f8c380ba550 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3d226640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c380bb5b0 con 0x7f8c3806a6d0 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3759e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c380ba550 0x7f8c381554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3759e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c380ba550 0x7f8c381554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54230/0 (socket says 172.21.15.31:54230) 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3759e640 1 -- 172.21.15.31:0/449644303 learned_addr learned my addr 172.21.15.31:0/449644303 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:50.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c36d9d640 1 --2- 172.21.15.31:0/449644303 >> v2:172.21.15.69:3300/0 conn(0x7f8c3806a6d0 0x7f8c3814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3759e640 1 -- 172.21.15.31:0/449644303 >> v2:172.21.15.69:3300/0 conn(0x7f8c3806a6d0 msgr2=0x7f8c3814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:50.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3759e640 1 --2- 172.21.15.31:0/449644303 >> v2:172.21.15.69:3300/0 conn(0x7f8c3806a6d0 0x7f8c3814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3759e640 1 -- 172.21.15.31:0/449644303 >> v1:172.21.15.69:6789/0 conn(0x7f8c3814b1f0 legacy=0x7f8c380b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:50.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.350+0000 7f8c3759e640 1 -- 172.21.15.31:0/449644303 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380c0120 con 0x7f8c380ba550 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.351+0000 7f8c3759e640 1 --2- 172.21.15.31:0/449644303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c380ba550 0x7f8c381554e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8c3808a260 tx=0x7f8c2802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633f6db8a57ccee1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.351+0000 7f8c35d9b640 1 -- 172.21.15.31:0/449644303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2802cb20 con 0x7f8c380ba550 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.351+0000 7f8c35d9b640 1 -- 172.21.15.31:0/449644303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2802cc80 con 0x7f8c380ba550 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.351+0000 7f8c35d9b640 1 -- 172.21.15.31:0/449644303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280343f0 con 0x7f8c380ba550 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.351+0000 7f8c3d226640 1 -- 172.21.15.31:0/449644303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c380ba550 msgr2=0x7f8c381554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.351+0000 7f8c3d226640 1 --2- 172.21.15.31:0/449644303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c380ba550 0x7f8c381554e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8c3808a260 tx=0x7f8c2802bf80 comp rx=0 tx=0).stop 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.351+0000 7f8c3d226640 1 -- 172.21.15.31:0/449644303 shutdown_connections 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.352+0000 7f8c3d226640 1 --2- 172.21.15.31:0/449644303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c380ba550 0x7f8c381554e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.352+0000 7f8c3d226640 1 --2- 172.21.15.31:0/449644303 >> v2:172.21.15.69:3300/0 conn(0x7f8c3806a6d0 0x7f8c3814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.352+0000 7f8c3d226640 1 -- 172.21.15.31:0/449644303 >> 172.21.15.31:0/449644303 conn(0x7f8c380c0350 msgr2=0x7f8c380c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.352+0000 7f8c3d226640 1 -- 172.21.15.31:0/449644303 shutdown_connections 2023-12-22T08:40:50.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.352+0000 7f8c3d226640 1 -- 172.21.15.31:0/449644303 wait complete. 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.353+0000 7f8c3d226640 1 Processor -- start 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.353+0000 7f8c3d226640 1 -- start start 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.353+0000 7f8c3d226640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8c3806a6d0 0x7f8c380a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.353+0000 7f8c3d226640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c380ba550 0x7f8c380a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.353+0000 7f8c3d226640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3814b1f0 0x7f8c381e3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.353+0000 7f8c3d226640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381e3a50 con 0x7f8c3814b1f0 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.353+0000 7f8c3d226640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380b6710 con 0x7f8c380ba550 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.353+0000 7f8c3d226640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380b62f0 con 0x7f8c3806a6d0 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3814b1f0 0x7f8c381e3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3814b1f0 0x7f8c381e3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54242/0 (socket says 172.21.15.31:54242) 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 -- 172.21.15.31:0/4048914900 learned_addr learned my addr 172.21.15.31:0/4048914900 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3659c640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c380ba550 0x7f8c380a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c36d9d640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8c3806a6d0 0x7f8c380a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 -- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8c3806a6d0 msgr2=0x7f8c380a55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8c3806a6d0 0x7f8c380a55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 -- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c380ba550 msgr2=0x7f8c380a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c380ba550 0x7f8c380a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 -- 172.21.15.31:0/4048914900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009b30 con 0x7f8c3814b1f0 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3759e640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3814b1f0 0x7f8c381e3ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c28036040 tx=0x7f8c28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c2f7fe640 1 -- 172.21.15.31:0/4048914900 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28007e70 con 0x7f8c3814b1f0 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c2f7fe640 1 -- 172.21.15.31:0/4048914900 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28009510 con 0x7f8c3814b1f0 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c380b6990 con 0x7f8c3814b1f0 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c2f7fe640 1 -- 172.21.15.31:0/4048914900 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2803e690 con 0x7f8c3814b1f0 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.354+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c380a0180 con 0x7f8c3814b1f0 2023-12-22T08:40:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.355+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c381e3c00 con 0x7f8c3814b1f0 2023-12-22T08:40:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.356+0000 7f8c2f7fe640 1 -- 172.21.15.31:0/4048914900 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8c2803e7f0 con 0x7f8c3814b1f0 2023-12-22T08:40:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.356+0000 7f8c2f7fe640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f8c1806a430 0x7f8c1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.356+0000 7f8c2f7fe640 1 -- 172.21.15.31:0/4048914900 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c280ab2d0 con 0x7f8c3814b1f0 2023-12-22T08:40:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.356+0000 7f8c36d9d640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f8c1806a430 0x7f8c1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.357+0000 7f8c36d9d640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f8c1806a430 0x7f8c1806c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c30006fd0 tx=0x7f8c30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.360+0000 7f8c2f7fe640 1 -- 172.21.15.31:0/4048914900 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8c381e3c00 con 0x7f8c3814b1f0 2023-12-22T08:40:50.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.581+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8c380bf1a0 con 0x7f8c3814b1f0 2023-12-22T08:40:50.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.584+0000 7f8c2f7fe640 1 -- 172.21.15.31:0/4048914900 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169964 (secure 0 0 0) 0x7f8c28076a00 con 0x7f8c3814b1f0 2023-12-22T08:40:50.588 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:50.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f8c1806a430 msgr2=0x7f8c1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f8c1806a430 0x7f8c1806c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c30006fd0 tx=0x7f8c30008040 comp rx=0 tx=0).stop 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3814b1f0 msgr2=0x7f8c381e3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3814b1f0 0x7f8c381e3ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c28036040 tx=0x7f8c28004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 shutdown_connections 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f8c1806a430 0x7f8c1806c8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3814b1f0 0x7f8c381e3ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c380ba550 0x7f8c380a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 --2- 172.21.15.31:0/4048914900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8c3806a6d0 0x7f8c380a55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 >> 172.21.15.31:0/4048914900 conn(0x7f8c380c0350 msgr2=0x7f8c380bea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 shutdown_connections 2023-12-22T08:40:50.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.586+0000 7f8c3d226640 1 -- 172.21.15.31:0/4048914900 wait complete. 2023-12-22T08:40:50.599 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":119711},{"type":"v1","addr":"172.21.15.69:6833","nonce":119711}]},"active_addr":"172.21.15.69:6833/119711","active_change":"2023-12-22T08:40:25.772464+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":401696905}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":972460983}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2438632039}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3712277882}]}]} 2023-12-22T08:40:50.602 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-22T08:40:50.602 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-22T08:40:50.603 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:50.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.706+0000 7f1ff2758640 1 Processor -- start 2023-12-22T08:40:50.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.706+0000 7f1ff2758640 1 -- start start 2023-12-22T08:40:50.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.706+0000 7f1ff2758640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec0ba550 0x7f1fec0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.706+0000 7f1ff2758640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1fec0ba000 0x7f1fec1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.706+0000 7f1ff2758640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec0bb310 con 0x7f1fec06a6d0 2023-12-22T08:40:50.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.706+0000 7f1ff2758640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec0bf960 con 0x7f1fec0ba000 2023-12-22T08:40:50.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.706+0000 7f1ff2758640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0bb5b0 con 0x7f1fec0ba550 2023-12-22T08:40:50.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1ff0cf5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1fec0ba000 0x7f1fec1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1febfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1fec06a6d0 0x7f1fec14acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47894/0 (socket says 172.21.15.31:47894) 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1ff0cf5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1fec0ba000 0x7f1fec1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54246/0 (socket says 172.21.15.31:54246) 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1febfff640 1 -- 172.21.15.31:0/391741406 learned_addr learned my addr 172.21.15.31:0/391741406 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1feb7fe640 1 --2- 172.21.15.31:0/391741406 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec0ba550 0x7f1fec0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1ff0cf5640 1 -- 172.21.15.31:0/391741406 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec0ba550 msgr2=0x7f1fec0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1ff0cf5640 1 --2- 172.21.15.31:0/391741406 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec0ba550 0x7f1fec0b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1ff0cf5640 1 -- 172.21.15.31:0/391741406 >> v1:172.21.15.31:6789/0 conn(0x7f1fec06a6d0 legacy=0x7f1fec14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1feaffd640 1 -- 172.21.15.31:0/391741406 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557532796 0 0) 0x7f1fec0bb310 con 0x7f1fec06a6d0 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.707+0000 7f1ff0cf5640 1 -- 172.21.15.31:0/391741406 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0c0120 con 0x7f1fec0ba000 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff0cf5640 1 --2- 172.21.15.31:0/391741406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba000 0x7f1fec1554e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009d90 tx=0x7f1fe402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e30cff254893bc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1feaffd640 1 -- 172.21.15.31:0/391741406 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe402cc50 con 0x7f1fec0ba000 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1feaffd640 1 -- 172.21.15.31:0/391741406 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe402cdb0 con 0x7f1fec0ba000 2023-12-22T08:40:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1feaffd640 1 -- 172.21.15.31:0/391741406 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4034660 con 0x7f1fec0ba000 2023-12-22T08:40:50.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff2758640 1 -- 172.21.15.31:0/391741406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba000 msgr2=0x7f1fec1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff2758640 1 --2- 172.21.15.31:0/391741406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba000 0x7f1fec1554e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4009d90 tx=0x7f1fe402bea0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff2758640 1 -- 172.21.15.31:0/391741406 shutdown_connections 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff2758640 1 --2- 172.21.15.31:0/391741406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba000 0x7f1fec1554e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff2758640 1 --2- 172.21.15.31:0/391741406 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec0ba550 0x7f1fec0b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff2758640 1 -- 172.21.15.31:0/391741406 >> 172.21.15.31:0/391741406 conn(0x7f1fec0c0350 msgr2=0x7f1fec0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff2758640 1 -- 172.21.15.31:0/391741406 shutdown_connections 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.708+0000 7f1ff2758640 1 -- 172.21.15.31:0/391741406 wait complete. 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.709+0000 7f1ff2758640 1 Processor -- start 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff2758640 1 -- start start 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff2758640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec06a6d0 0x7f1fec0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff2758640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fec0ba000 0x7f1fec1e03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff2758640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba550 0x7f1fec0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff2758640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0b6dc0 con 0x7f1fec0ba550 2023-12-22T08:40:50.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff2758640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec147ad0 con 0x7f1fec0ba000 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff2758640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec09f710 con 0x7f1fec06a6d0 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff0cf5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba550 0x7f1fec0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff0cf5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba550 0x7f1fec0b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54256/0 (socket says 172.21.15.31:54256) 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.710+0000 7f1ff0cf5640 1 -- 172.21.15.31:0/1164279746 learned_addr learned my addr 172.21.15.31:0/1164279746 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1feb7fe640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fec0ba000 0x7f1fec1e03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1febfff640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec06a6d0 0x7f1fec0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1ff0cf5640 1 -- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec06a6d0 msgr2=0x7f1fec0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1ff0cf5640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec06a6d0 0x7f1fec0b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1ff0cf5640 1 -- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fec0ba000 msgr2=0x7f1fec1e03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1ff0cf5640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fec0ba000 0x7f1fec1e03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1ff0cf5640 1 -- 172.21.15.31:0/1164279746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4009a70 con 0x7f1fec0ba550 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1feb7fe640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fec0ba000 0x7f1fec1e03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1ff0cf5640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba550 0x7f1fec0b46f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4037040 tx=0x7f1fe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1fe8ff9640 1 -- 172.21.15.31:0/1164279746 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4040650 con 0x7f1fec0ba550 2023-12-22T08:40:50.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1fe8ff9640 1 -- 172.21.15.31:0/1164279746 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe40407d0 con 0x7f1fec0ba550 2023-12-22T08:40:50.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec1dfbe0 con 0x7f1fec0ba550 2023-12-22T08:40:50.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1fe8ff9640 1 -- 172.21.15.31:0/1164279746 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4040b80 con 0x7f1fec0ba550 2023-12-22T08:40:50.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.711+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec1dfe80 con 0x7f1fec0ba550 2023-12-22T08:40:50.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.712+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec1dfa40 con 0x7f1fec0ba550 2023-12-22T08:40:50.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.712+0000 7f1fe8ff9640 1 -- 172.21.15.31:0/1164279746 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1fe4040ce0 con 0x7f1fec0ba550 2023-12-22T08:40:50.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.713+0000 7f1fe8ff9640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1fd806a430 0x7f1fd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:50.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.713+0000 7f1fe8ff9640 1 -- 172.21.15.31:0/1164279746 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fe40ab830 con 0x7f1fec0ba550 2023-12-22T08:40:50.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.713+0000 7f1febfff640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1fd806a430 0x7f1fd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:50.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.714+0000 7f1febfff640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1fd806a430 0x7f1fd806c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc000f60 tx=0x7f1fdc007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:50.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.717+0000 7f1fe8ff9640 1 -- 172.21.15.31:0/1164279746 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1fec1dfa40 con 0x7f1fec0ba550 2023-12-22T08:40:50.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.895+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fec1dfa40 con 0x7f1fec0ba550 2023-12-22T08:40:50.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.896+0000 7f1fe8ff9640 1 -- 172.21.15.31:0/1164279746 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f1fec1dfa40 con 0x7f1fec0ba550 2023-12-22T08:40:50.898 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:50.899 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:50.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.897+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1fd806a430 msgr2=0x7f1fd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.897+0000 7f1ff2758640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1fd806a430 0x7f1fd806c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc000f60 tx=0x7f1fdc007b50 comp rx=0 tx=0).stop 2023-12-22T08:40:50.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.897+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba550 msgr2=0x7f1fec0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:50.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.897+0000 7f1ff2758640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba550 0x7f1fec0b46f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4037040 tx=0x7f1fe4004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:50.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.898+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 shutdown_connections 2023-12-22T08:40:50.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.898+0000 7f1ff2758640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1fd806a430 0x7f1fd806c8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.898+0000 7f1ff2758640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fec0ba550 0x7f1fec0b46f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.898+0000 7f1ff2758640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fec0ba000 0x7f1fec1e03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.898+0000 7f1ff2758640 1 --2- 172.21.15.31:0/1164279746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1fec06a6d0 0x7f1fec0b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:50.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.898+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 >> 172.21.15.31:0/1164279746 conn(0x7f1fec0c0350 msgr2=0x7f1fec0a1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:50.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.898+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 shutdown_connections 2023-12-22T08:40:50.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:50.898+0000 7f1ff2758640 1 -- 172.21.15.31:0/1164279746 wait complete. 2023-12-22T08:40:50.911 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-22T08:40:50.911 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:51.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.014+0000 7ff769c96640 1 Processor -- start 2023-12-22T08:40:51.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.014+0000 7ff769c96640 1 -- start start 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff769c96640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff76406a6d0 0x7ff76414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff769c96640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7640ba550 0x7ff7641554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff769c96640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640bb310 con 0x7ff76414b1f0 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff769c96640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640bf960 con 0x7ff76406a6d0 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff769c96640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640bb5b0 con 0x7ff7640ba550 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff7637fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff76406a6d0 0x7ff76414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff7637fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff76406a6d0 0x7ff76414acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54268/0 (socket says 172.21.15.31:54268) 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff7637fe640 1 -- 172.21.15.31:0/91633952 learned_addr learned my addr 172.21.15.31:0/91633952 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.015+0000 7ff763fff640 1 --2- 172.21.15.31:0/91633952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7640ba550 0x7ff7641554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.016+0000 7ff7637fe640 1 -- 172.21.15.31:0/91633952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7640ba550 msgr2=0x7ff7641554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.016+0000 7ff7637fe640 1 --2- 172.21.15.31:0/91633952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7640ba550 0x7ff7641554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.016+0000 7ff7637fe640 1 -- 172.21.15.31:0/91633952 >> v1:172.21.15.69:6789/0 conn(0x7ff76414b1f0 legacy=0x7ff7640b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.016+0000 7ff7637fe640 1 -- 172.21.15.31:0/91633952 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640c0120 con 0x7ff76406a6d0 2023-12-22T08:40:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.016+0000 7ff7637fe640 1 --2- 172.21.15.31:0/91633952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff76414acb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff754009870 tx=0x7ff75402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8956ca451fd9d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.016+0000 7ff7627fc640 1 -- 172.21.15.31:0/91633952 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754030840 con 0x7ff76406a6d0 2023-12-22T08:40:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.016+0000 7ff7627fc640 1 -- 172.21.15.31:0/91633952 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540309a0 con 0x7ff76406a6d0 2023-12-22T08:40:51.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.016+0000 7ff7627fc640 1 -- 172.21.15.31:0/91633952 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754030d30 con 0x7ff76406a6d0 2023-12-22T08:40:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.017+0000 7ff769c96640 1 -- 172.21.15.31:0/91633952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 msgr2=0x7ff76414acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.017+0000 7ff769c96640 1 --2- 172.21.15.31:0/91633952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff76414acb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff754009870 tx=0x7ff75402b980 comp rx=0 tx=0).stop 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.017+0000 7ff769c96640 1 -- 172.21.15.31:0/91633952 shutdown_connections 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.017+0000 7ff769c96640 1 --2- 172.21.15.31:0/91633952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7640ba550 0x7ff7641554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.017+0000 7ff769c96640 1 --2- 172.21.15.31:0/91633952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff76414acb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.017+0000 7ff769c96640 1 -- 172.21.15.31:0/91633952 >> 172.21.15.31:0/91633952 conn(0x7ff7640c0350 msgr2=0x7ff7640c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.017+0000 7ff769c96640 1 -- 172.21.15.31:0/91633952 shutdown_connections 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.017+0000 7ff769c96640 1 -- 172.21.15.31:0/91633952 wait complete. 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.018+0000 7ff769c96640 1 Processor -- start 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.018+0000 7ff769c96640 1 -- start start 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff769c96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff7641e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff769c96640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7640ba550 0x7ff7641e39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff769c96640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76414b1f0 0x7ff7641e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff769c96640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7641e36e0 con 0x7ff76406a6d0 2023-12-22T08:40:51.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff769c96640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7641d4450 con 0x7ff7640ba550 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff769c96640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640b6e60 con 0x7ff76414b1f0 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff7641e0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff7641e0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54278/0 (socket says 172.21.15.31:54278) 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 -- 172.21.15.31:0/577481954 learned_addr learned my addr 172.21.15.31:0/577481954 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff762ffd640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7640ba550 0x7ff7641e39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff763fff640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76414b1f0 0x7ff7641e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 -- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76414b1f0 msgr2=0x7ff7641e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76414b1f0 0x7ff7641e31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 -- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7640ba550 msgr2=0x7ff7641e39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7640ba550 0x7ff7641e39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 -- 172.21.15.31:0/577481954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540094d0 con 0x7ff76406a6d0 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff762ffd640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7640ba550 0x7ff7641e39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.019+0000 7ff7637fe640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff7641e0e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff75402b9c0 tx=0x7ff754004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.020+0000 7ff74bfff640 1 -- 172.21.15.31:0/577481954 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754039c90 con 0x7ff76406a6d0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.020+0000 7ff74bfff640 1 -- 172.21.15.31:0/577481954 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff754039df0 con 0x7ff76406a6d0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.020+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76414ec30 con 0x7ff76406a6d0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.020+0000 7ff74bfff640 1 -- 172.21.15.31:0/577481954 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540446c0 con 0x7ff76406a6d0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.020+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7641d40e0 con 0x7ff76406a6d0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.021+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff764073a40 con 0x7ff76406a6d0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.021+0000 7ff74bfff640 1 -- 172.21.15.31:0/577481954 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff75404d3b0 con 0x7ff76406a6d0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.022+0000 7ff74bfff640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff75006a460 0x7ff75006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.022+0000 7ff74bfff640 1 -- 172.21.15.31:0/577481954 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff75403e070 con 0x7ff76406a6d0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.022+0000 7ff762ffd640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff75006a460 0x7ff75006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.022+0000 7ff762ffd640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff75006a460 0x7ff75006c920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff758007fd0 tx=0x7ff758009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.026+0000 7ff74bfff640 1 -- 172.21.15.31:0/577481954 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff754076c60 con 0x7ff76406a6d0 2023-12-22T08:40:51.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.203+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7640a62d0 con 0x7ff76406a6d0 2023-12-22T08:40:51.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.204+0000 7ff74bfff640 1 -- 172.21.15.31:0/577481954 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7ff75407a280 con 0x7ff76406a6d0 2023-12-22T08:40:51.207 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:51.207 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:51.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff75006a460 msgr2=0x7ff75006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff75006a460 0x7ff75006c920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff758007fd0 tx=0x7ff758009040 comp rx=0 tx=0).stop 2023-12-22T08:40:51.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 msgr2=0x7ff7641e0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff7641e0e30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff75402b9c0 tx=0x7ff754004730 comp rx=0 tx=0).stop 2023-12-22T08:40:51.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 shutdown_connections 2023-12-22T08:40:51.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff75006a460 0x7ff75006c920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76414b1f0 0x7ff7641e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7640ba550 0x7ff7641e39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 --2- 172.21.15.31:0/577481954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff76406a6d0 0x7ff7641e0e30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 >> 172.21.15.31:0/577481954 conn(0x7ff7640c0350 msgr2=0x7ff7640c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 shutdown_connections 2023-12-22T08:40:51.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.206+0000 7ff769c96640 1 -- 172.21.15.31:0/577481954 wait complete. 2023-12-22T08:40:51.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-22T08:40:51.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-22T08:40:51.221 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-22T08:40:51.221 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-22T08:40:51.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-22T08:40:51.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-22T08:40:51.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-22T08:40:51.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-22T08:40:51.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.401+0000 7f428b4f3640 1 Processor -- start 2023-12-22T08:40:51.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.402+0000 7f428b4f3640 1 -- start start 2023-12-22T08:40:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.402+0000 7f525b59e640 1 Processor -- start 2023-12-22T08:40:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.402+0000 7f525b59e640 1 -- start start 2023-12-22T08:40:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.402+0000 7f19a32af640 1 Processor -- start 2023-12-22T08:40:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.402+0000 7f19a32af640 1 -- start start 2023-12-22T08:40:51.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.403+0000 7f428b4f3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f427c03b790 0x7f427c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.403+0000 7f525b59e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c071820 0x7f525c14df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.403+0000 7f66317d9640 1 Processor -- start 2023-12-22T08:40:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.403+0000 7f525b59e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525c06fe90 con 0x7f525c14e480 2023-12-22T08:40:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.403+0000 7f525b59e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525c0b86f0 con 0x7f525c06caa0 2023-12-22T08:40:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.403+0000 7f525b59e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0b8260 con 0x7f525c071820 2023-12-22T08:40:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.403+0000 7f5259d9b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c071820 0x7f525c14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f5259d9b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c071820 0x7f525c14df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56866/0 (socket says 172.21.15.31:56866) 2023-12-22T08:40:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f5259d9b640 1 -- 172.21.15.31:0/2089774706 learned_addr learned my addr 172.21.15.31:0/2089774706 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f428a4f1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f427c03b790 0x7f427c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a32af640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f199c0b8df0 0x7f199c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a32af640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f199c14ae00 0x7f199c0b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a32af640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c0b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f428a4f1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f427c03b790 0x7f427c03bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54294/0 (socket says 172.21.15.31:54294) 2023-12-22T08:40:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f428a4f1640 1 -- 172.21.15.31:0/2982232399 learned_addr learned my addr 172.21.15.31:0/2982232399 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a32af640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0b33c0 con 0x7f199c0b8df0 2023-12-22T08:40:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a32af640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0b3ed0 con 0x7f199c14ae00 2023-12-22T08:40:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a32af640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0b91d0 con 0x7f199c14b240 2023-12-22T08:40:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a084a640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f199c14ae00 0x7f199c0b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a184c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c0b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f428b4f3640 1 -- 172.21.15.31:0/2982232399 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c039720 con 0x7f427c0c7390 2023-12-22T08:40:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f428b4f3640 1 -- 172.21.15.31:0/2982232399 --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c007b20 con 0x7f427c03b0b0 2023-12-22T08:40:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a184c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c0b7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56880/0 (socket says 172.21.15.31:56880) 2023-12-22T08:40:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f19a184c640 1 -- 172.21.15.31:0/3416082429 learned_addr learned my addr 172.21.15.31:0/3416082429 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f428b4f3640 1 -- 172.21.15.31:0/2982232399 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c0d10e0 con 0x7f427c03b790 2023-12-22T08:40:51.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f5259d9b640 1 -- 172.21.15.31:0/2089774706 >> v1:172.21.15.69:6789/0 conn(0x7f525c06caa0 legacy=0x7f525c06f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f42894ef640 1 -- 172.21.15.31:0/2982232399 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791143581 0 0) 0x7f427c007b20 con 0x7f427c03b0b0 2023-12-22T08:40:51.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f42894ef640 1 -- 172.21.15.31:0/2982232399 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4270003520 con 0x7f427c03b0b0 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f19a184c640 1 -- 172.21.15.31:0/3416082429 >> v2:172.21.15.69:3300/0 conn(0x7f199c14ae00 msgr2=0x7f199c0b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f19a184c640 1 --2- 172.21.15.31:0/3416082429 >> v2:172.21.15.69:3300/0 conn(0x7f199c14ae00 0x7f199c0b7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f19a184c640 1 -- 172.21.15.31:0/3416082429 >> v2:172.21.15.31:3300/0 conn(0x7f199c0b8df0 msgr2=0x7f199c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f19a184c640 1 --2- 172.21.15.31:0/3416082429 >> v2:172.21.15.31:3300/0 conn(0x7f199c0b8df0 0x7f199c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f19a184c640 1 -- 172.21.15.31:0/3416082429 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c142030 con 0x7f199c14b240 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.403+0000 7f66317d9640 1 -- start start 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f66317d9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c069d00 0x7f662c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f66317d9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662c06f210 con 0x7f662c0b6130 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f66317d9640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662c06f4b0 con 0x7f662c14a8f0 2023-12-22T08:40:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f66317d9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c071090 con 0x7f662c069d00 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f662b7fe640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f662c14a8f0 0x7f662c070290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:55216/0 (socket says 172.21.15.31:55216) 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f662b7fe640 1 -- 172.21.15.31:0/657985116 learned_addr learned my addr 172.21.15.31:0/657985116 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f662affd640 1 --2- 172.21.15.31:0/657985116 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c069d00 0x7f662c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f1b4309e640 1 Processor -- start 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.404+0000 7f1b4309e640 1 -- start start 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f1b4309e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b34006ed0 0x7f1b3403c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4309e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b340072b0 0x7f1b340dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4309e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3403a6f0 con 0x7f1b340d5500 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4309e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3403a9d0 con 0x7f1b34006ed0 2023-12-22T08:40:51.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4309e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3403acb0 con 0x7f1b340072b0 2023-12-22T08:40:51.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f5259d9b640 1 -- 172.21.15.31:0/2089774706 >> v1:172.21.15.31:6789/0 conn(0x7f525c14e480 legacy=0x7f525c1446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f5259d9b640 1 -- 172.21.15.31:0/2089774706 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c0b7c10 con 0x7f525c071820 2023-12-22T08:40:51.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f662affd640 1 -- 172.21.15.31:0/657985116 >> v1:172.21.15.69:6789/0 conn(0x7f662c14a8f0 legacy=0x7f662c070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f662affd640 1 -- 172.21.15.31:0/657985116 >> v1:172.21.15.31:6789/0 conn(0x7f662c0b6130 legacy=0x7f662c14a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f662affd640 1 -- 172.21.15.31:0/657985116 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c06f790 con 0x7f662c069d00 2023-12-22T08:40:51.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4189b640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1b340d5500 0x7f1b3403e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:55224/0 (socket says 172.21.15.31:55224) 2023-12-22T08:40:51.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4189b640 1 -- 172.21.15.31:0/2167286518 learned_addr learned my addr 172.21.15.31:0/2167286518 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f19a184c640 1 --2- 172.21.15.31:0/3416082429 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c0b7fb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f199c06bbe0 tx=0x7f198c02b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a57fcf143e025fd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f5259d9b640 1 --2- 172.21.15.31:0/2089774706 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c071820 0x7f525c14df40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f524c009820 tx=0x7f524c02b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b13f86debe666d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f428a4f1640 1 -- 172.21.15.31:0/2982232399 >> v1:172.21.15.69:6789/0 conn(0x7f427c03b0b0 legacy=0x7f427c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f428a4f1640 1 -- 172.21.15.31:0/2982232399 >> v1:172.21.15.31:6789/0 conn(0x7f427c0c7390 legacy=0x7f427c0d7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.405+0000 7f428a4f1640 1 -- 172.21.15.31:0/2982232399 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c03a8f0 con 0x7f427c03b790 2023-12-22T08:40:51.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f662affd640 1 --2- 172.21.15.31:0/657985116 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c069d00 0x7f662c0b5bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f661c0097d0 tx=0x7f661c02da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35b67710e5acd84f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4289d640 1 --2- 172.21.15.31:0/2167286518 >> v2:172.21.15.69:3300/0 conn(0x7f1b340072b0 0x7f1b340dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f6629ffb640 1 -- 172.21.15.31:0/657985116 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c031840 con 0x7f662c069d00 2023-12-22T08:40:51.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4109a640 1 -- 172.21.15.31:0/2167286518 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536435079 0 0) 0x7f1b3403a6f0 con 0x7f1b340d5500 2023-12-22T08:40:51.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.406+0000 7f1b4109a640 1 -- 172.21.15.31:0/2167286518 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b28003520 con 0x7f1b340d5500 2023-12-22T08:40:51.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f1b4209c640 1 --2- 172.21.15.31:0/2167286518 >> v2:172.21.15.31:3300/0 conn(0x7f1b34006ed0 0x7f1b3403c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f1993fff640 1 -- 172.21.15.31:0/3416082429 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c030890 con 0x7f199c14b240 2023-12-22T08:40:51.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f1993fff640 1 -- 172.21.15.31:0/3416082429 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0309f0 con 0x7f199c14b240 2023-12-22T08:40:51.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f1993fff640 1 -- 172.21.15.31:0/3416082429 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c030d60 con 0x7f199c14b240 2023-12-22T08:40:51.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f6629ffb640 1 -- 172.21.15.31:0/657985116 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c0319a0 con 0x7f662c069d00 2023-12-22T08:40:51.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f525959a640 1 -- 172.21.15.31:0/2089774706 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c004230 con 0x7f525c071820 2023-12-22T08:40:51.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f525959a640 1 -- 172.21.15.31:0/2089774706 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c02e050 con 0x7f525c071820 2023-12-22T08:40:51.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f525959a640 1 -- 172.21.15.31:0/2089774706 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c003610 con 0x7f525c071820 2023-12-22T08:40:51.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f29ca78f640 1 Processor -- start 2023-12-22T08:40:51.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 -- 172.21.15.31:0/3416082429 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 msgr2=0x7f199c0b7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 --2- 172.21.15.31:0/3416082429 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c0b7fb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f199c06bbe0 tx=0x7f198c02b9d0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f6629ffb640 1 -- 172.21.15.31:0/657985116 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c031d30 con 0x7f662c069d00 2023-12-22T08:40:51.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f66317d9640 1 -- 172.21.15.31:0/657985116 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c069d00 msgr2=0x7f662c0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f66317d9640 1 --2- 172.21.15.31:0/657985116 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c069d00 0x7f662c0b5bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f661c0097d0 tx=0x7f661c02da20 comp rx=0 tx=0).stop 2023-12-22T08:40:51.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 -- 172.21.15.31:0/3416082429 shutdown_connections 2023-12-22T08:40:51.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 --2- 172.21.15.31:0/3416082429 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c0b7fb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f66317d9640 1 -- 172.21.15.31:0/657985116 shutdown_connections 2023-12-22T08:40:51.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f66317d9640 1 --2- 172.21.15.31:0/657985116 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c069d00 0x7f662c0b5bf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f66317d9640 1 -- 172.21.15.31:0/657985116 >> 172.21.15.31:0/657985116 conn(0x7f662c0bc120 msgr2=0x7f662c0bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 --2- 172.21.15.31:0/3416082429 >> v2:172.21.15.69:3300/0 conn(0x7f199c14ae00 0x7f199c0b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 --2- 172.21.15.31:0/3416082429 >> v2:172.21.15.31:3300/0 conn(0x7f199c0b8df0 0x7f199c0b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 -- 172.21.15.31:0/3416082429 >> 172.21.15.31:0/3416082429 conn(0x7f199c06ae10 msgr2=0x7f199c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f1b4289d640 1 -- 172.21.15.31:0/2167286518 >> v2:172.21.15.31:3300/0 conn(0x7f1b34006ed0 msgr2=0x7f1b3403c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f1b4289d640 1 --2- 172.21.15.31:0/2167286518 >> v2:172.21.15.31:3300/0 conn(0x7f1b34006ed0 0x7f1b3403c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f1b4289d640 1 -- 172.21.15.31:0/2167286518 >> v1:172.21.15.69:6789/0 conn(0x7f1b340d5500 legacy=0x7f1b3403e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.407+0000 7f1b4289d640 1 -- 172.21.15.31:0/2167286518 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3403e290 con 0x7f1b340072b0 2023-12-22T08:40:51.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7fca25bce640 1 Processor -- start 2023-12-22T08:40:51.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f66317d9640 1 -- 172.21.15.31:0/657985116 shutdown_connections 2023-12-22T08:40:51.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7fca25bce640 1 -- start start 2023-12-22T08:40:51.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f1b4289d640 1 --2- 172.21.15.31:0/2167286518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b340072b0 0x7f1b340dfd80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009250 tx=0x7f1b2c02b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24949e08a01070e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f428a4f1640 1 --2- 172.21.15.31:0/2982232399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f427c03b790 0x7f427c03bb70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4280009870 tx=0x7f428002dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0e5d4c5fe5cf21 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f525b59e640 1 -- 172.21.15.31:0/2089774706 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c071820 msgr2=0x7f525c14df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f525b59e640 1 --2- 172.21.15.31:0/2089774706 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c071820 0x7f525c14df40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f524c009820 tx=0x7f524c02b760 comp rx=0 tx=0).stop 2023-12-22T08:40:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 -- 172.21.15.31:0/3416082429 shutdown_connections 2023-12-22T08:40:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f1b4109a640 1 -- 172.21.15.31:0/2167286518 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38001690 con 0x7f1b340072b0 2023-12-22T08:40:51.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f525b59e640 1 -- 172.21.15.31:0/2089774706 shutdown_connections 2023-12-22T08:40:51.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f525b59e640 1 --2- 172.21.15.31:0/2089774706 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c071820 0x7f525c14df40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f525b59e640 1 -- 172.21.15.31:0/2089774706 >> 172.21.15.31:0/2089774706 conn(0x7f525c0b8890 msgr2=0x7f525c0b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f525b59e640 1 -- 172.21.15.31:0/2089774706 shutdown_connections 2023-12-22T08:40:51.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f525b59e640 1 -- 172.21.15.31:0/2089774706 wait complete. 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f42894ef640 1 -- 172.21.15.31:0/2982232399 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428002eb90 con 0x7f427c03b790 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f42894ef640 1 -- 172.21.15.31:0/2982232399 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428002ecf0 con 0x7f427c03b790 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f42894ef640 1 -- 172.21.15.31:0/2982232399 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428002eea0 con 0x7f427c03b790 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f29ca78f640 1 -- start start 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29ca78f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f29bc008250 0x7f29bc03c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29ca78f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc03f820 0x7f29bc0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29ca78f640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f29bc0c7d30 0x7f29bc0d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29ca78f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc03b240 con 0x7f29bc008250 2023-12-22T08:40:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29ca78f640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc03d090 con 0x7f29bc0c7d30 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29ca78f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0ce250 con 0x7f29bc03f820 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29c978d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f29bc008250 0x7f29bc03c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29c8f8c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc03f820 0x7f29bc0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29c978d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f29bc008250 0x7f29bc03c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54314/0 (socket says 172.21.15.31:54314) 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29c978d640 1 -- 172.21.15.31:0/3860270819 learned_addr learned my addr 172.21.15.31:0/3860270819 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f29c9f8e640 1 --2- 172.21.15.31:0/3860270819 >> v2:172.21.15.69:3300/0 conn(0x7f29bc0c7d30 0x7f29bc0d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f29c8f8c640 1 -- 172.21.15.31:0/3860270819 >> v2:172.21.15.69:3300/0 conn(0x7f29bc0c7d30 msgr2=0x7f29bc0d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f29c8f8c640 1 --2- 172.21.15.31:0/3860270819 >> v2:172.21.15.69:3300/0 conn(0x7f29bc0c7d30 0x7f29bc0d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f29c8f8c640 1 -- 172.21.15.31:0/3860270819 >> v2:172.21.15.31:3300/0 conn(0x7f29bc008250 msgr2=0x7f29bc03c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f29c8f8c640 1 --2- 172.21.15.31:0/3860270819 >> v2:172.21.15.31:3300/0 conn(0x7f29bc008250 0x7f29bc03c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f29c8f8c640 1 -- 172.21.15.31:0/3860270819 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc03a9a0 con 0x7f29bc03f820 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f66317d9640 1 -- 172.21.15.31:0/657985116 wait complete. 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f1b4109a640 1 -- 172.21.15.31:0/2167286518 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c02e050 con 0x7f1b340072b0 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f1b4109a640 1 -- 172.21.15.31:0/2167286518 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c030730 con 0x7f1b340072b0 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f1b4309e640 1 -- 172.21.15.31:0/2167286518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b340072b0 msgr2=0x7f1b340dfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f1b4309e640 1 --2- 172.21.15.31:0/2167286518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b340072b0 0x7f1b340dfd80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009250 tx=0x7f1b2c02b6c0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f1b4309e640 1 -- 172.21.15.31:0/2167286518 shutdown_connections 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f1b4309e640 1 --2- 172.21.15.31:0/2167286518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b340072b0 0x7f1b340dfd80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f1b4309e640 1 --2- 172.21.15.31:0/2167286518 >> v2:172.21.15.31:3300/0 conn(0x7f1b34006ed0 0x7f1b3403c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7f1b4309e640 1 -- 172.21.15.31:0/2167286518 >> 172.21.15.31:0/2167286518 conn(0x7f1b3403ef10 msgr2=0x7f1b3403f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7fca25bce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca1803e210 0x7fca180ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7fca25bce640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca18043340 con 0x7fca180084b0 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7fca25bce640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca18036f80 con 0x7fca180ce9d0 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7fca25bce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca180d45f0 con 0x7fca1803e210 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7fca24bcc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca1803e210 0x7fca180ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7fca24bcc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca1803e210 0x7fca180ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56892/0 (socket says 172.21.15.31:56892) 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7fca253cd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fca180084b0 0x7fca18006ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47932/0 (socket says 172.21.15.31:47932) 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.409+0000 7fca253cd640 1 -- 172.21.15.31:0/3769966999 learned_addr learned my addr 172.21.15.31:0/3769966999 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7fca1f7fe640 1 -- 172.21.15.31:0/3769966999 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121063417 0 0) 0x7fca18043340 con 0x7fca180084b0 2023-12-22T08:40:51.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7fca1f7fe640 1 -- 172.21.15.31:0/3769966999 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca10003520 con 0x7fca180084b0 2023-12-22T08:40:51.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7fca24bcc640 1 -- 172.21.15.31:0/3769966999 >> v1:172.21.15.69:6789/0 conn(0x7fca180ce9d0 legacy=0x7fca18007da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7fca24bcc640 1 -- 172.21.15.31:0/3769966999 >> v1:172.21.15.31:6789/0 conn(0x7fca180084b0 legacy=0x7fca18006ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7fca24bcc640 1 -- 172.21.15.31:0/3769966999 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18036cb0 con 0x7fca1803e210 2023-12-22T08:40:51.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.408+0000 7f19a32af640 1 -- 172.21.15.31:0/3416082429 wait complete. 2023-12-22T08:40:51.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f19a32af640 1 Processor -- start 2023-12-22T08:40:51.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f66317d9640 1 Processor -- start 2023-12-22T08:40:51.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f1b4309e640 1 -- 172.21.15.31:0/2167286518 shutdown_connections 2023-12-22T08:40:51.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f525b59e640 1 Processor -- start 2023-12-22T08:40:51.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f66317d9640 1 -- start start 2023-12-22T08:40:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.410+0000 7f19a32af640 1 -- start start 2023-12-22T08:40:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f525b59e640 1 -- start start 2023-12-22T08:40:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7fca24bcc640 1 --2- 172.21.15.31:0/3769966999 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca1803e210 0x7fca180ce490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca140130a0 tx=0x7fca1403c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf1fdd7b0d8f0970 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f29c8f8c640 1 --2- 172.21.15.31:0/3860270819 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc03f820 0x7f29bc0cdd10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00afc0 tx=0x7f29c002fc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54893270247941af server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f1b4309e640 1 -- 172.21.15.31:0/2167286518 wait complete. 2023-12-22T08:40:51.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7fdececce640 1 Processor -- start 2023-12-22T08:40:51.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f428b4f3640 1 -- 172.21.15.31:0/2982232399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f427c03b790 msgr2=0x7f427c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7fdececce640 1 -- start start 2023-12-22T08:40:51.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f428b4f3640 1 --2- 172.21.15.31:0/2982232399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f427c03b790 0x7f427c03bb70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4280009870 tx=0x7f428002dde0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7fca1f7fe640 1 -- 172.21.15.31:0/3769966999 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1403e040 con 0x7fca1803e210 2023-12-22T08:40:51.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7fca1f7fe640 1 -- 172.21.15.31:0/3769966999 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca140114e0 con 0x7fca1803e210 2023-12-22T08:40:51.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7fca1f7fe640 1 -- 172.21.15.31:0/3769966999 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1400f850 con 0x7fca1803e210 2023-12-22T08:40:51.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f29bbfff640 1 -- 172.21.15.31:0/3860270819 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00307f0 con 0x7f29bc03f820 2023-12-22T08:40:51.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f66317d9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f662c069d00 0x7f662c1d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f66317d9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c0b6130 0x7f662c1df320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f29bbfff640 1 -- 172.21.15.31:0/3860270819 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c0030950 con 0x7f29bc03f820 2023-12-22T08:40:51.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f29bbfff640 1 -- 172.21.15.31:0/3860270819 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0030ce0 con 0x7f29bc03f820 2023-12-22T08:40:51.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f428b4f3640 1 -- 172.21.15.31:0/2982232399 shutdown_connections 2023-12-22T08:40:51.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.411+0000 7f428b4f3640 1 --2- 172.21.15.31:0/2982232399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f427c03b790 0x7f427c03bb70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f428b4f3640 1 -- 172.21.15.31:0/2982232399 >> 172.21.15.31:0/2982232399 conn(0x7f427c0069e0 msgr2=0x7f427c006dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a32af640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0b8df0 0x7f199c13c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a32af640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f199c14ae00 0x7f199c1e81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a32af640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c13e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a32af640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c13c920 con 0x7f199c14ae00 2023-12-22T08:40:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a32af640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c1e7d50 con 0x7f199c0b8df0 2023-12-22T08:40:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a32af640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c1e1ea0 con 0x7f199c14b240 2023-12-22T08:40:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f428b4f3640 1 -- 172.21.15.31:0/2982232399 shutdown_connections 2023-12-22T08:40:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f66317d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f662c14a8f0 0x7f662c1df860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f428b4f3640 1 -- 172.21.15.31:0/2982232399 wait complete. 2023-12-22T08:40:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f662a7fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c0b6130 0x7f662c1df320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f525b59e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c06caa0 0x7f525c0bb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f662a7fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c0b6130 0x7f662c1df320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56924/0 (socket says 172.21.15.31:56924) 2023-12-22T08:40:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f662a7fc640 1 -- 172.21.15.31:0/1675627905 learned_addr learned my addr 172.21.15.31:0/1675627905 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f662affd640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f662c069d00 0x7f662c1d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f525b59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525c071820 0x7f525c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f525a59c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c06caa0 0x7f525c0bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f525a59c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c06caa0 0x7f525c0bb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56948/0 (socket says 172.21.15.31:56948) 2023-12-22T08:40:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f29ca78f640 1 -- 172.21.15.31:0/3860270819 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc03f820 msgr2=0x7f29bc0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f29ca78f640 1 --2- 172.21.15.31:0/3860270819 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc03f820 0x7f29bc0cdd10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00afc0 tx=0x7f29c002fc50 comp rx=0 tx=0).stop 2023-12-22T08:40:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7fca25bce640 1 -- 172.21.15.31:0/3769966999 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca1803e210 msgr2=0x7fca180ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7fca25bce640 1 --2- 172.21.15.31:0/3769966999 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca1803e210 0x7fca180ce490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca140130a0 tx=0x7fca1403c8b0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7fca25bce640 1 -- 172.21.15.31:0/3769966999 shutdown_connections 2023-12-22T08:40:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7fca25bce640 1 --2- 172.21.15.31:0/3769966999 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca1803e210 0x7fca180ce490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7fca25bce640 1 -- 172.21.15.31:0/3769966999 >> 172.21.15.31:0/3769966999 conn(0x7fca180400a0 msgr2=0x7fca180404b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f29ca78f640 1 -- 172.21.15.31:0/3860270819 shutdown_connections 2023-12-22T08:40:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f29ca78f640 1 --2- 172.21.15.31:0/3860270819 >> v2:172.21.15.69:3300/0 conn(0x7f29bc0c7d30 0x7f29bc0d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7fca25bce640 1 -- 172.21.15.31:0/3769966999 shutdown_connections 2023-12-22T08:40:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f5259d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525c071820 0x7f525c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f5259d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525c071820 0x7f525c148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54330/0 (socket says 172.21.15.31:54330) 2023-12-22T08:40:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f29ca78f640 1 --2- 172.21.15.31:0/3860270819 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc03f820 0x7f29bc0cdd10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f29ca78f640 1 --2- 172.21.15.31:0/3860270819 >> v2:172.21.15.31:3300/0 conn(0x7f29bc008250 0x7f29bc03c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f29ca78f640 1 -- 172.21.15.31:0/3860270819 >> 172.21.15.31:0/3860270819 conn(0x7f29bc040020 msgr2=0x7f29bc040400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f525a59c640 1 -- 172.21.15.31:0/3716225383 learned_addr learned my addr 172.21.15.31:0/3716225383 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7fca25bce640 1 -- 172.21.15.31:0/3769966999 wait complete. 2023-12-22T08:40:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525b59e640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f525c1493e0 0x7f525c138280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a084a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f199c14ae00 0x7f199c1e81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a184c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c13e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a184c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c13e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56938/0 (socket says 172.21.15.31:56938) 2023-12-22T08:40:51.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a184c640 1 -- 172.21.15.31:0/2882079511 learned_addr learned my addr 172.21.15.31:0/2882079511 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f662b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f662c14a8f0 0x7f662c1df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525b59e640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0bbb50 con 0x7f525c071820 2023-12-22T08:40:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.412+0000 7f19a104b640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0b8df0 0x7f199c13c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f19a104b640 1 -- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 msgr2=0x7f199c13e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f19a104b640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f199c14b240 0x7f199c13e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f19a104b640 1 -- 172.21.15.31:0/2882079511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f199c14ae00 msgr2=0x7f199c1e81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f19a104b640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f199c14ae00 0x7f199c1e81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f19a104b640 1 -- 172.21.15.31:0/2882079511 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c0094d0 con 0x7f199c0b8df0 2023-12-22T08:40:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525b59e640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0b5590 con 0x7f525c1493e0 2023-12-22T08:40:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525b59e640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0b3290 con 0x7f525c06caa0 2023-12-22T08:40:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525ad9d640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f525c1493e0 0x7f525c138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f29ca78f640 1 -- 172.21.15.31:0/3860270819 shutdown_connections 2023-12-22T08:40:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f29ca78f640 1 -- 172.21.15.31:0/3860270819 wait complete. 2023-12-22T08:40:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7fdececce640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdec814af10 0x7fdec80b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7fdecca6a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdec806bc90 0x7fdec814a800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47942/0 (socket says 172.21.15.31:47942) 2023-12-22T08:40:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f19a084a640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f199c14ae00 0x7f199c1e81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:51.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7fdec7fff640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fdec806ce40 0x7fdec80b1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:55242/0 (socket says 172.21.15.31:55242) 2023-12-22T08:40:51.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7fdecd26b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdec814af10 0x7fdec80b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525a59c640 1 -- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f525c1493e0 msgr2=0x7f525c138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525a59c640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f525c1493e0 0x7f525c138280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525a59c640 1 -- 172.21.15.31:0/3716225383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525c071820 msgr2=0x7f525c148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525a59c640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525c071820 0x7f525c148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f525a59c640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c0094d0 con 0x7f525c06caa0 2023-12-22T08:40:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fdecd26b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdec814af10 0x7fdec80b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54346/0 (socket says 172.21.15.31:54346) 2023-12-22T08:40:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fdececce640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec809ef60 con 0x7fdec806bc90 2023-12-22T08:40:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c144b00 con 0x7f662c14a8f0 2023-12-22T08:40:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1d05e0 con 0x7f662c069d00 2023-12-22T08:40:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.413+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662c1def00 con 0x7f662c0b6130 2023-12-22T08:40:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fdececce640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec80b3160 con 0x7fdec806ce40 2023-12-22T08:40:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fdececce640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec809eca0 con 0x7fdec814af10 2023-12-22T08:40:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f428b4f3640 1 Processor -- start 2023-12-22T08:40:51.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f19a104b640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0b8df0 0x7f199c13c3e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f199800b420 tx=0x7f199800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998011830 con 0x7f199c0b8df0 2023-12-22T08:40:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f525a59c640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c06caa0 0x7f525c0bb610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f525400cb20 tx=0x7f52540021d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998011990 con 0x7f199c0b8df0 2023-12-22T08:40:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f428b4f3640 1 -- start start 2023-12-22T08:40:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f662b7fe640 1 -- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c0b6130 msgr2=0x7f662c1df320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fdecca6a640 1 -- 172.21.15.31:0/4146452845 learned_addr learned my addr 172.21.15.31:0/4146452845 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f662b7fe640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f662c0b6130 0x7f662c1df320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f662b7fe640 1 -- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f662c069d00 msgr2=0x7f662c1d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f662b7fe640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f662c069d00 0x7f662c1d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fca25bce640 1 Processor -- start 2023-12-22T08:40:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254003da0 con 0x7f525c06caa0 2023-12-22T08:40:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525400a820 con 0x7f525c06caa0 2023-12-22T08:40:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fca25bce640 1 -- start start 2023-12-22T08:40:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f662b7fe640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c009400 con 0x7f662c14a8f0 2023-12-22T08:40:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7f1b4309e640 1 Processor -- start 2023-12-22T08:40:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f662b7fe640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f662c14a8f0 0x7f662c1df860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f662000b3e0 tx=0x7f662000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f29ca78f640 1 Processor -- start 2023-12-22T08:40:51.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428b4f3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f427c03b0b0 0x7f427c0cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428b4f3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f427c03b790 0x7f427c0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428b4f3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f427c0c7390 0x7f427c0cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428b4f3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0caaa0 con 0x7f427c03b790 2023-12-22T08:40:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428b4f3640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0ccd50 con 0x7f427c03b0b0 2023-12-22T08:40:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428b4f3640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0cf9f0 con 0x7f427c0c7390 2023-12-22T08:40:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f29ca78f640 1 -- start start 2023-12-22T08:40:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7fca25bce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180084b0 0x7fca180c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428a4f1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f427c03b0b0 0x7f427c0cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428a4f1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f427c03b0b0 0x7f427c0cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53308/0 (socket says 172.21.15.31:53308) 2023-12-22T08:40:51.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428a4f1640 1 -- 172.21.15.31:0/2482212963 learned_addr learned my addr 172.21.15.31:0/2482212963 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f428acf2640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f427c0c7390 0x7f427c0cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998011830 con 0x7f199c0b8df0 2023-12-22T08:40:51.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fdecd26b640 1 -- 172.21.15.31:0/4146452845 >> v1:172.21.15.69:6789/0 conn(0x7fdec806ce40 legacy=0x7fdec80b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.414+0000 7fdecd26b640 1 -- 172.21.15.31:0/4146452845 >> v1:172.21.15.31:6789/0 conn(0x7fdec806bc90 legacy=0x7fdec814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7fdecd26b640 1 -- 172.21.15.31:0/4146452845 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec806c070 con 0x7fdec814af10 2023-12-22T08:40:51.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f1b4309e640 1 -- start start 2023-12-22T08:40:51.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4309e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1b34006ed0 0x7f1b3415b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4309e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b340072b0 0x7f1b340d2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525400ab90 con 0x7f525c06caa0 2023-12-22T08:40:51.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f525b59e640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c0b57e0 con 0x7f525c06caa0 2023-12-22T08:40:51.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.415+0000 7f525b59e640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c0b5da0 con 0x7f525c06caa0 2023-12-22T08:40:51.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f4289cf0640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f427c03b790 0x7f427c0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f428a4f1640 1 -- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f427c0c7390 msgr2=0x7f427c0cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fca25bce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1803e210 0x7fca180cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4209c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1b34006ed0 0x7f1b3415b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4209c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1b34006ed0 0x7f1b3415b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56956/0 (socket says 172.21.15.31:56956) 2023-12-22T08:40:51.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4209c640 1 -- 172.21.15.31:0/405251101 learned_addr learned my addr 172.21.15.31:0/405251101 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4309e640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b340d5500 0x7f1b3401b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f428a4f1640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f427c0c7390 0x7f427c0cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f428a4f1640 1 -- 172.21.15.31:0/2482212963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f427c03b790 msgr2=0x7f427c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f428a4f1640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f427c03b790 0x7f427c0ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fdecd26b640 1 --2- 172.21.15.31:0/4146452845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec814af10 0x7fdec80b2a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdec0008330 tx=0x7fdec002e5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb472afc2ddc0d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f428a4f1640 1 -- 172.21.15.31:0/2482212963 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800094d0 con 0x7f427c03b0b0 2023-12-22T08:40:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fca25bce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca180ce9d0 0x7fca181626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4309e640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340d2840 con 0x7f1b340072b0 2023-12-22T08:40:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4309e640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3416ec50 con 0x7f1b340d5500 2023-12-22T08:40:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fca1ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1803e210 0x7fca180cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fca1ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1803e210 0x7fca180cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54374/0 (socket says 172.21.15.31:54374) 2023-12-22T08:40:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4309e640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3416e7c0 con 0x7f1b34006ed0 2023-12-22T08:40:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fca1ffff640 1 -- 172.21.15.31:0/1406172845 learned_addr learned my addr 172.21.15.31:0/1406172845 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fca25bce640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18028a70 con 0x7fca1803e210 2023-12-22T08:40:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fca25bce640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180c9410 con 0x7fca180084b0 2023-12-22T08:40:51.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4289d640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b340d5500 0x7f1b3401b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fca25bce640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca18029450 con 0x7fca180ce9d0 2023-12-22T08:40:51.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c1e7a20 con 0x7f199c0b8df0 2023-12-22T08:40:51.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f428a4f1640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f427c03b0b0 0x7f427c0cdaf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4280009870 tx=0x7f42800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f1b4189b640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b340072b0 0x7f1b340d2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c0a2ab0 con 0x7f199c0b8df0 2023-12-22T08:40:51.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fdec77fe640 1 -- 172.21.15.31:0/4146452845 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec000a2d0 con 0x7fdec814af10 2023-12-22T08:40:51.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.416+0000 7fdec7fff640 1 --1- 172.21.15.31:0/4146452845 >> v1:172.21.15.69:6789/0 conn(0x7fdec806ce40 0x7fdec80b1780 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-22T08:40:51.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29ca78f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc008250 0x7f29bc0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1ffff640 1 -- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca180ce9d0 msgr2=0x7fca181626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1ffff640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca180ce9d0 0x7fca181626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1ffff640 1 -- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180084b0 msgr2=0x7fca180c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1ffff640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180084b0 0x7fca180c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1ffff640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca14011ca0 con 0x7fca1803e210 2023-12-22T08:40:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fdec77fe640 1 -- 172.21.15.31:0/4146452845 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0031050 con 0x7fdec814af10 2023-12-22T08:40:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29ca78f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29bc03f820 0x7f29bc0ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f1b4209c640 1 -- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b340d5500 msgr2=0x7f1b3401b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f1b4209c640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b340d5500 0x7f1b3401b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f1b4209c640 1 -- 172.21.15.31:0/405251101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b340072b0 msgr2=0x7f1b340d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f1b4209c640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b340072b0 0x7f1b340d2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29ca78f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29bc0c7d30 0x7f29bc030d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fdec77fe640 1 -- 172.21.15.31:0/4146452845 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0008640 con 0x7fdec814af10 2023-12-22T08:40:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f525c06ce80 con 0x7f525c06caa0 2023-12-22T08:40:51.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f1b4209c640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c009400 con 0x7f1b34006ed0 2023-12-22T08:40:51.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1ffff640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1803e210 0x7fca180cfc10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b410 tx=0x7fca0c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29ca78f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0cd900 con 0x7f29bc0c7d30 2023-12-22T08:40:51.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29ca78f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0d1cb0 con 0x7f29bc03f820 2023-12-22T08:40:51.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29ca78f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0d0290 con 0x7f29bc008250 2023-12-22T08:40:51.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29c978d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc008250 0x7f29bc0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c011830 con 0x7fca1803e210 2023-12-22T08:40:51.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f1b4209c640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1b34006ed0 0x7f1b3415b660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c068dc0 tx=0x7f1b3c04e660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c011990 con 0x7fca1803e210 2023-12-22T08:40:51.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280041680 con 0x7f427c03b0b0 2023-12-22T08:40:51.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280041800 con 0x7f427c03b0b0 2023-12-22T08:40:51.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c0cfc90 con 0x7f427c03b0b0 2023-12-22T08:40:51.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f199c0b35a0 con 0x7f199c0b8df0 2023-12-22T08:40:51.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29c8f8c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29bc03f820 0x7f29bc0ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29c978d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc008250 0x7f29bc0cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56966/0 (socket says 172.21.15.31:56966) 2023-12-22T08:40:51.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f29c978d640 1 -- 172.21.15.31:0/3615855291 learned_addr learned my addr 172.21.15.31:0/3615855291 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c011d40 con 0x7fca1803e210 2023-12-22T08:40:51.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fca25bce640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca180d20e0 con 0x7fca1803e210 2023-12-22T08:40:51.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fca25bce640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca180d03d0 con 0x7fca1803e210 2023-12-22T08:40:51.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c08e070 con 0x7f1b34006ed0 2023-12-22T08:40:51.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c073480 con 0x7f1b34006ed0 2023-12-22T08:40:51.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7f1b4309e640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b34041d30 con 0x7f1b34006ed0 2023-12-22T08:40:51.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7f1b4309e640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b34162340 con 0x7f1b34006ed0 2023-12-22T08:40:51.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f29c978d640 1 -- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29bc03f820 msgr2=0x7f29bc0ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f29c978d640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29bc03f820 0x7f29bc0ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f29c978d640 1 -- 172.21.15.31:0/3615855291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29bc0c7d30 msgr2=0x7f29bc030d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f29c978d640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29bc0c7d30 0x7f29bc030d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f29c978d640 1 -- 172.21.15.31:0/3615855291 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c000d8a0 con 0x7f29bc008250 2023-12-22T08:40:51.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620011830 con 0x7f662c14a8f0 2023-12-22T08:40:51.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c147c20 con 0x7f662c14a8f0 2023-12-22T08:40:51.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.417+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c144120 con 0x7f662c14a8f0 2023-12-22T08:40:51.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620011990 con 0x7f662c14a8f0 2023-12-22T08:40:51.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca18042fd0 con 0x7fca1803e210 2023-12-22T08:40:51.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f29c978d640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc008250 0x7f29bc0cd3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29b400b4e0 tx=0x7f29b400ff60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1998011b00 con 0x7f199c0b8df0 2023-12-22T08:40:51.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280041bb0 con 0x7f427c03b0b0 2023-12-22T08:40:51.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620011d00 con 0x7f662c14a8f0 2023-12-22T08:40:51.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f1991ffb640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f198006a520 0x7f198006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.419+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f525400acf0 con 0x7f525c06caa0 2023-12-22T08:40:51.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f660c000fc0 con 0x7f662c14a8f0 2023-12-22T08:40:51.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1998088020 con 0x7f199c0b8df0 2023-12-22T08:40:51.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f1991ffb640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f19800726c0 0x7f1980074ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 --> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1980075190 con 0x7f19800726c0 2023-12-22T08:40:51.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1998011830 con 0x7f199c0b8df0 2023-12-22T08:40:51.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c06cea0 con 0x7f1b34006ed0 2023-12-22T08:40:51.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f524affd640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f523c06a500 0x7f523c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5254088bd0 con 0x7f525c06caa0 2023-12-22T08:40:51.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4018440 con 0x7f29bc008250 2023-12-22T08:40:51.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40185a0 con 0x7f29bc008250 2023-12-22T08:40:51.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f5259d9b640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f523c06a500 0x7f523c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f524affd640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f523c0725b0 0x7f523c0749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f523c075080 con 0x7f523c0725b0 2023-12-22T08:40:51.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5254088f80 con 0x7f525c06caa0 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f19a184c640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f19800726c0 0x7f1980074ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fdececce640 1 -- 172.21.15.31:0/4146452845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec814af10 msgr2=0x7fdec80b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fdececce640 1 --2- 172.21.15.31:0/4146452845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec814af10 0x7fdec80b2a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdec0008330 tx=0x7fdec002e5b0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fdececce640 1 -- 172.21.15.31:0/4146452845 shutdown_connections 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fdececce640 1 --2- 172.21.15.31:0/4146452845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec814af10 0x7fdec80b2a90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fdececce640 1 -- 172.21.15.31:0/4146452845 >> 172.21.15.31:0/4146452845 conn(0x7fdec806a610 msgr2=0x7fdec80bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fdececce640 1 -- 172.21.15.31:0/4146452845 shutdown_connections 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.418+0000 7fdececce640 1 -- 172.21.15.31:0/4146452845 wait complete. 2023-12-22T08:40:51.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7fdececce640 1 Processor -- start 2023-12-22T08:40:51.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7fdececce640 1 -- start start 2023-12-22T08:40:51.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c0cb280 con 0x7f427c03b0b0 2023-12-22T08:40:51.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4018910 con 0x7f29bc008250 2023-12-22T08:40:51.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc0cf930 con 0x7f29bc008250 2023-12-22T08:40:51.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdececce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdec806bc90 0x7fdec809e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdececce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdec806ce40 0x7fdec80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdececce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec814af10 0x7fdec80a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdececce640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec8089e60 con 0x7fdec814af10 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdececce640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec81454d0 con 0x7fdec806bc90 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdececce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec8145a50 con 0x7fdec806ce40 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdecca6a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdec806bc90 0x7fdec809e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdec806ce40 0x7fdec80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdec806ce40 0x7fdec80b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:56970/0 (socket says 172.21.15.31:56970) 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdecca6a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdec806bc90 0x7fdec809e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53336/0 (socket says 172.21.15.31:53336) 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7fdec7fff640 1 -- 172.21.15.31:0/3534588871 learned_addr learned my addr 172.21.15.31:0/3534588871 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f427c0077b0 con 0x7f427c03b0b0 2023-12-22T08:40:51.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc0cfef0 con 0x7f29bc008250 2023-12-22T08:40:51.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.420+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b3403a2b0 con 0x7f1b34006ed0 2023-12-22T08:40:51.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1b3c073810 con 0x7f1b34006ed0 2023-12-22T08:40:51.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca0c01a400 con 0x7fca1803e210 2023-12-22T08:40:51.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f428004b460 con 0x7f427c03b0b0 2023-12-22T08:40:51.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fdec7fff640 1 -- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdec806bc90 msgr2=0x7fdec809e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fdec7fff640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdec806bc90 0x7fdec809e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fdec7fff640 1 -- 172.21.15.31:0/3534588871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec814af10 msgr2=0x7fdec80a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fdec7fff640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec814af10 0x7fdec80a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fdec7fff640 1 -- 172.21.15.31:0/3534588871 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec000aa90 con 0x7fdec806ce40 2023-12-22T08:40:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fdecca6a640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdec806bc90 0x7fdec809e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f662001a400 con 0x7f662c14a8f0 2023-12-22T08:40:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f525ad9d640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f523c0725b0 0x7f523c0749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7f427affd640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f426806a480 0x7f426806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f428007a800 con 0x7f427c03b0b0 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7f4289cf0640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f426806a480 0x7f426806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f427affd640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7f4268072530 0x7f4268074950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 --> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4268075000 con 0x7f4268072530 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4280076440 con 0x7f427c03b0b0 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f428acf2640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7f4268072530 0x7f4268074950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7f19a184c640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f19800726c0 0x7f1980074ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.421+0000 7f19a084a640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f198006a520 0x7f198006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 <== osd.2 v2:172.21.15.31:6824/120310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1980075190 con 0x7f19800726c0 2023-12-22T08:40:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f66137fe640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f661806a500 0x7f661806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fca1d7fa640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca0406a430 0x7fca0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca0c089130 con 0x7fca1803e210 2023-12-22T08:40:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7fca24bcc640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca0406a430 0x7fca0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7fca1d7fa640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7fca04072650 0x7fca04074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca04075120 con 0x7fca04072650 2023-12-22T08:40:51.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca0c0894e0 con 0x7fca1803e210 2023-12-22T08:40:51.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7fca253cd640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7fca04072650 0x7fca04074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7f1b32ffd640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1b2006a530 0x7f1b2006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.422+0000 7f1b4189b640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1b2006a530 0x7f1b2006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b3c101cc0 con 0x7f1b34006ed0 2023-12-22T08:40:51.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f1b32ffd640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f1b200725e0 0x7f1b20074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b200750b0 con 0x7f1b200725e0 2023-12-22T08:40:51.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f1b4289d640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f1b200725e0 0x7f1b20074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f1b4189b640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1b2006a530 0x7f1b2006c9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001cd0 tx=0x7f1b38001c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f662affd640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f661806a500 0x7f661806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6620088830 con 0x7f662c14a8f0 2023-12-22T08:40:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f29b4018a70 con 0x7f29bc008250 2023-12-22T08:40:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f19a084a640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f198006a520 0x7f198006c9e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f199c145660 tx=0x7f19940077d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b3c1042e0 con 0x7f1b34006ed0 2023-12-22T08:40:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f66137fe640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f66180725b0 0x7f66180749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6618075080 con 0x7f66180725b0 2023-12-22T08:40:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f662008ae50 con 0x7f662c14a8f0 2023-12-22T08:40:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f5259d9b640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f523c06a500 0x7f523c06c9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f524c034000 tx=0x7f524c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.423+0000 7f4289cf0640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f426806a480 0x7f426806c940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f427c0cd0e0 tx=0x7f4274009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7fca24bcc640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca0406a430 0x7fca0406c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca14046000 tx=0x7fca14041000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7fca253cd640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7fca04072650 0x7fca04074a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29bc03af60 con 0x7f29bc008250 2023-12-22T08:40:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f1b4289d640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f1b200725e0 0x7f1b20074a00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f525ad9d640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f523c0725b0 0x7f523c0749d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f662a7fc640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f66180725b0 0x7f66180749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7fdec7fff640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdec806ce40 0x7fdec80b5220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c4b0 tx=0x7fdeb400c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f29b9ffb640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f29a806a500 0x7f29a806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40074e0 con 0x7fdec806ce40 2023-12-22T08:40:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f662a7fc640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f66180725b0 0x7f66180749d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4007660 con 0x7fdec806ce40 2023-12-22T08:40:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29b4088ff0 con 0x7f29bc008250 2023-12-22T08:40:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f29c8f8c640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f29a806a500 0x7f29a806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4004a20 con 0x7fdec806ce40 2023-12-22T08:40:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec8145ee0 con 0x7fdec806ce40 2023-12-22T08:40:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f428acf2640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7f4268072530 0x7f4268074950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7f29b9ffb640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7f29a80725b0 0x7f29a80749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.424+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec81456e0 con 0x7fdec806ce40 2023-12-22T08:40:51.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 <== osd.0 v2:172.21.15.31:6800/120299 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f523c075080 con 0x7f523c0725b0 2023-12-22T08:40:51.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 <== osd.5 v2:172.21.15.69:6808/120281 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fca04075120 con 0x7fca04072650 2023-12-22T08:40:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 --> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29a8075080 con 0x7f29a80725b0 2023-12-22T08:40:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29b408e5a0 con 0x7f29bc008250 2023-12-22T08:40:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f29c9f8e640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7f29a80725b0 0x7f29a80749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 <== osd.6 v2:172.21.15.69:6816/120298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1b200750b0 con 0x7f1b200725e0 2023-12-22T08:40:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f29c8f8c640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f29a806a500 0x7f29a806c9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29c0039000 tx=0x7f29c0034000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f29c9f8e640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7f29a80725b0 0x7f29a80749d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.426+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdec80b8900 con 0x7fdec806ce40 2023-12-22T08:40:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 <== osd.1 v2:172.21.15.31:6813/120301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4268075000 con 0x7f4268072530 2023-12-22T08:40:51.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.426+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 <== osd.3 v2:172.21.15.31:6808/120300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f29a8075080 con 0x7f29a80725b0 2023-12-22T08:40:51.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.426+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdeb4004b80 con 0x7fdec806ce40 2023-12-22T08:40:51.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.425+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 <== osd.4 v2:172.21.15.69:6800/120280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6618075080 con 0x7f66180725b0 2023-12-22T08:40:51.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.426+0000 7f662affd640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f661806a500 0x7f661806c9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f661c038000 tx=0x7f661c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.427+0000 7fdec57fa640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdeac06a460 0x7fdeac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.427+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdeb4087b50 con 0x7fdec806ce40 2023-12-22T08:40:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.427+0000 7fdec57fa640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7fdeac072680 0x7fdeac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.427+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 --> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdeac075150 con 0x7fdeac072680 2023-12-22T08:40:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.427+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdeb408c280 con 0x7fdec806ce40 2023-12-22T08:40:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.429+0000 7fdecd26b640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7fdeac072680 0x7fdeac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.429+0000 7fdecca6a640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdeac06a460 0x7fdeac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.429+0000 7fdecd26b640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7fdeac072680 0x7fdeac074aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.430+0000 7fdecca6a640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdeac06a460 0x7fdeac06c920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdebc006110 tx=0x7fdebc004d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.430+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 <== osd.7 v2:172.21.15.69:6824/120311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdeac075150 con 0x7fdeac072680 2023-12-22T08:40:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.454+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 --> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f199c0b27f0 con 0x7f19800726c0 2023-12-22T08:40:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.456+0000 7f1991ffb640 1 -- 172.21.15.31:0/2882079511 <== osd.2 v2:172.21.15.31:6824/120310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f198c03f040 con 0x7f19800726c0 2023-12-22T08:40:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.456+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 --> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b3416e900 con 0x7f1b200725e0 2023-12-22T08:40:51.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.456+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 --> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f525c0b7ef0 con 0x7f523c0725b0 2023-12-22T08:40:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.456+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f19800726c0 msgr2=0x7f1980074ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.456+0000 7f19a32af640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f19800726c0 0x7f1980074ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f198006a520 msgr2=0x7f198006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 --> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29bc03ac80 con 0x7f29a80725b0 2023-12-22T08:40:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f19a32af640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f198006a520 0x7f198006c9e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f199c145660 tx=0x7f19940077d0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0b8df0 msgr2=0x7f199c13c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f19a32af640 1 --2- 172.21.15.31:0/2882079511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0b8df0 0x7f199c13c3e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f199800b420 tx=0x7f199800b8e0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f19a184c640 1 -- 172.21.15.31:0/2882079511 reap_dead start 2023-12-22T08:40:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 shutdown_connections 2023-12-22T08:40:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 >> 172.21.15.31:0/2882079511 conn(0x7f199c06ae10 msgr2=0x7f199c06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f524affd640 1 -- 172.21.15.31:0/3716225383 <== osd.0 v2:172.21.15.31:6800/120299 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5250001420 con 0x7f523c0725b0 2023-12-22T08:40:51.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f1b32ffd640 1 -- 172.21.15.31:0/405251101 <== osd.6 v2:172.21.15.69:6816/120298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b2c030800 con 0x7f1b200725e0 2023-12-22T08:40:51.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 --> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f427c0074d0 con 0x7f4268072530 2023-12-22T08:40:51.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f29b9ffb640 1 -- 172.21.15.31:0/3615855291 <== osd.3 v2:172.21.15.31:6808/120300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f29c404e5f0 con 0x7f29a80725b0 2023-12-22T08:40:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f523c0725b0 msgr2=0x7f523c0749d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f5248ff9640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f523c0725b0 0x7f523c0749d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f523c06a500 msgr2=0x7f523c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f5248ff9640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f523c06a500 0x7f523c06c9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f524c034000 tx=0x7f524c008030 comp rx=0 tx=0).stop 2023-12-22T08:40:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.457+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c06caa0 msgr2=0x7f525c0bb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f5248ff9640 1 --2- 172.21.15.31:0/3716225383 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f525c06caa0 0x7f525c0bb610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f525400cb20 tx=0x7f52540021d0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f525ad9d640 1 -- 172.21.15.31:0/3716225383 reap_dead start 2023-12-22T08:40:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 shutdown_connections 2023-12-22T08:40:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f427affd640 1 -- 172.21.15.31:0/2482212963 <== osd.1 v2:172.21.15.31:6813/120301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f428404e5f0 con 0x7f4268072530 2023-12-22T08:40:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7f29a80725b0 msgr2=0x7f29a80749d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29ca78f640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7f29a80725b0 0x7f29a80749d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 shutdown_connections 2023-12-22T08:40:51.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 >> 172.21.15.31:0/3716225383 conn(0x7f525c0b8890 msgr2=0x7f525c06f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f1b200725e0 msgr2=0x7f1b20074a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b30ff9640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f1b200725e0 0x7f1b20074a00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f19a32af640 1 -- 172.21.15.31:0/2882079511 wait complete. 2023-12-22T08:40:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 shutdown_connections 2023-12-22T08:40:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f5248ff9640 1 -- 172.21.15.31:0/3716225383 wait complete. 2023-12-22T08:40:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7f4268072530 msgr2=0x7f4268074950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f428b4f3640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7f4268072530 0x7f4268074950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f426806a480 msgr2=0x7f426806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f29a806a500 msgr2=0x7f29a806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29ca78f640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f29a806a500 0x7f29a806c9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29c0039000 tx=0x7f29c0034000 comp rx=0 tx=0).stop 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc008250 msgr2=0x7f29bc0cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29ca78f640 1 --2- 172.21.15.31:0/3615855291 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f29bc008250 0x7f29bc0cd3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29b400b4e0 tx=0x7f29b400ff60 comp rx=0 tx=0).stop 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29c9f8e640 1 -- 172.21.15.31:0/3615855291 reap_dead start 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 shutdown_connections 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 >> 172.21.15.31:0/3615855291 conn(0x7f29bc040020 msgr2=0x7f29bc03de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 --> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca18042cf0 con 0x7fca04072650 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1b2006a530 msgr2=0x7f1b2006c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b30ff9640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1b2006a530 0x7f1b2006c9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001cd0 tx=0x7f1b38001c60 comp rx=0 tx=0).stop 2023-12-22T08:40:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1b34006ed0 msgr2=0x7f1b3415b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b30ff9640 1 --2- 172.21.15.31:0/405251101 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1b34006ed0 0x7f1b3415b660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c068dc0 tx=0x7f1b3c04e660 comp rx=0 tx=0).stop 2023-12-22T08:40:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b4289d640 1 -- 172.21.15.31:0/405251101 reap_dead start 2023-12-22T08:40:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f428b4f3640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f426806a480 0x7f426806c940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f427c0cd0e0 tx=0x7f4274009040 comp rx=0 tx=0).stop 2023-12-22T08:40:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 shutdown_connections 2023-12-22T08:40:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 >> 172.21.15.31:0/405251101 conn(0x7f1b3403ef10 msgr2=0x7f1b3403cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f427c03b0b0 msgr2=0x7f427c0cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.458+0000 7f428b4f3640 1 --2- 172.21.15.31:0/2482212963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f427c03b0b0 0x7f427c0cdaf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4280009870 tx=0x7f42800046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f428acf2640 1 -- 172.21.15.31:0/2482212963 reap_dead start 2023-12-22T08:40:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 shutdown_connections 2023-12-22T08:40:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 >> 172.21.15.31:0/2482212963 conn(0x7f427c0069e0 msgr2=0x7f427c03d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 shutdown_connections 2023-12-22T08:40:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f1b30ff9640 1 -- 172.21.15.31:0/405251101 wait complete. 2023-12-22T08:40:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 shutdown_connections 2023-12-22T08:40:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f428b4f3640 1 -- 172.21.15.31:0/2482212963 wait complete. 2023-12-22T08:40:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7fca1d7fa640 1 -- 172.21.15.31:0/1406172845 <== osd.5 v2:172.21.15.69:6808/120281 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca2004ef70 con 0x7fca04072650 2023-12-22T08:40:51.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 --> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f660c002cb0 con 0x7f66180725b0 2023-12-22T08:40:51.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7fca04072650 msgr2=0x7fca04074a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7fca0affd640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7fca04072650 0x7fca04074a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 shutdown_connections 2023-12-22T08:40:51.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f29ca78f640 1 -- 172.21.15.31:0/3615855291 wait complete. 2023-12-22T08:40:51.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.459+0000 7f66137fe640 1 -- 172.21.15.31:0/1675627905 <== osd.4 v2:172.21.15.69:6800/120280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f660c002cb0 con 0x7f66180725b0 2023-12-22T08:40:51.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca0406a430 msgr2=0x7fca0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca0affd640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca0406a430 0x7fca0406c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca14046000 tx=0x7fca14041000 comp rx=0 tx=0).stop 2023-12-22T08:40:51.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1803e210 msgr2=0x7fca180cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca0affd640 1 --2- 172.21.15.31:0/1406172845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1803e210 0x7fca180cfc10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b410 tx=0x7fca0c00b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca253cd640 1 -- 172.21.15.31:0/1406172845 reap_dead start 2023-12-22T08:40:51.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 shutdown_connections 2023-12-22T08:40:51.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 >> 172.21.15.31:0/1406172845 conn(0x7fca180400a0 msgr2=0x7fca18004f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f66180725b0 msgr2=0x7f66180749d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7f66317d9640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f66180725b0 0x7f66180749d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f661806a500 msgr2=0x7f661806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7f66317d9640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f661806a500 0x7f661806c9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f661c038000 tx=0x7f661c008030 comp rx=0 tx=0).stop 2023-12-22T08:40:51.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 shutdown_connections 2023-12-22T08:40:51.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.460+0000 7fca0affd640 1 -- 172.21.15.31:0/1406172845 wait complete. 2023-12-22T08:40:51.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.461+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f662c14a8f0 msgr2=0x7f662c1df860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.461+0000 7f66317d9640 1 --2- 172.21.15.31:0/1675627905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f662c14a8f0 0x7f662c1df860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f662000b3e0 tx=0x7f662000b8a0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.461+0000 7f662b7fe640 1 -- 172.21.15.31:0/1675627905 reap_dead start 2023-12-22T08:40:51.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.461+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 shutdown_connections 2023-12-22T08:40:51.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.461+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 >> 172.21.15.31:0/1675627905 conn(0x7f662c0bc120 msgr2=0x7f662c0b9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.461+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 shutdown_connections 2023-12-22T08:40:51.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.461+0000 7f66317d9640 1 -- 172.21.15.31:0/1675627905 wait complete. 2023-12-22T08:40:51.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.461+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 --> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdec80b8620 con 0x7fdeac072680 2023-12-22T08:40:51.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.462+0000 7fdec57fa640 1 -- 172.21.15.31:0/3534588871 <== osd.7 v2:172.21.15.69:6824/120311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdec000a290 con 0x7fdeac072680 2023-12-22T08:40:51.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.462+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7fdeac072680 msgr2=0x7fdeac074aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7fdeac072680 0x7fdeac074aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdeac06a460 msgr2=0x7fdeac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdeac06a460 0x7fdeac06c920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdebc006110 tx=0x7fdebc004d10 comp rx=0 tx=0).stop 2023-12-22T08:40:51.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdec806ce40 msgr2=0x7fdec80b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 --2- 172.21.15.31:0/3534588871 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdec806ce40 0x7fdec80b5220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c4b0 tx=0x7fdeb400c970 comp rx=0 tx=0).stop 2023-12-22T08:40:51.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdecd26b640 1 -- 172.21.15.31:0/3534588871 reap_dead start 2023-12-22T08:40:51.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 shutdown_connections 2023-12-22T08:40:51.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 >> 172.21.15.31:0/3534588871 conn(0x7fdec806a610 msgr2=0x7fdec8147e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 shutdown_connections 2023-12-22T08:40:51.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.463+0000 7fdececce640 1 -- 172.21.15.31:0/3534588871 wait complete. 2023-12-22T08:40:51.520 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-12-22T08:40:51.520 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-22T08:40:51.521 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:51.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-22T08:40:51.522 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:51.522 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:51.523 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-22T08:40:51.523 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-22T08:40:51.524 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-12-22T08:40:51.524 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-22T08:40:51.525 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:51.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-22T08:40:51.526 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-12-22T08:40:51.526 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-22T08:40:51.527 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:51.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-22T08:40:51.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.740+0000 7f148ad55640 1 Processor -- start 2023-12-22T08:40:51.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.740+0000 7f148ad55640 1 -- start start 2023-12-22T08:40:51.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.741+0000 7f85534b9640 1 Processor -- start 2023-12-22T08:40:51.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.741+0000 7f85534b9640 1 -- start start 2023-12-22T08:40:51.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f116eda5640 1 Processor -- start 2023-12-22T08:40:51.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.741+0000 7f0996a7d640 1 Processor -- start 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.741+0000 7f148ad55640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f147c007160 0x7f147c03ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.741+0000 7f148ad55640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c040820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f148ad55640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c03d3a0 con 0x7f147c007540 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f148ad55640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c03bab0 con 0x7f147c007160 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f148ad55640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c03bd90 con 0x7f147c03c290 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f14892f2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f147c007540 0x7f147c0cecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47950/0 (socket says 172.21.15.31:47950) 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f14892f2640 1 -- 172.21.15.31:0/1960780760 learned_addr learned my addr 172.21.15.31:0/1960780760 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f1488af1640 1 --2- 172.21.15.31:0/1960780760 >> v2:172.21.15.31:3300/0 conn(0x7f147c007160 0x7f147c03ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f1483fff640 1 --2- 172.21.15.31:0/1960780760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c040820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f85534b9640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f854c0bab60 0x7f854c148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f85534b9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f85534b9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854c0b9df0 con 0x7f854c149230 2023-12-22T08:40:51.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f85534b9640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c0b9590 con 0x7f854c0bab60 2023-12-22T08:40:51.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f85534b9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0b97a0 con 0x7f854c0b4f50 2023-12-22T08:40:51.746 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f8551cb6640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.741+0000 7f0996a7d640 1 -- start start 2023-12-22T08:40:51.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f0996a7d640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f09880d53e0 0x7f098803c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f0996a7d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098803a5d0 con 0x7f0988006db0 2023-12-22T08:40:51.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f0996a7d640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098803a8b0 con 0x7f0988007190 2023-12-22T08:40:51.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f0996a7d640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098803ab90 con 0x7f09880d53e0 2023-12-22T08:40:51.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f85524b7640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f854c0bab60 0x7f854c148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f85524b7640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f854c0bab60 0x7f854c148cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53350/0 (socket says 172.21.15.31:53350) 2023-12-22T08:40:51.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f85524b7640 1 -- 172.21.15.31:0/2094304080 learned_addr learned my addr 172.21.15.31:0/2094304080 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f14837fe640 1 -- 172.21.15.31:0/1960780760 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555216394 0 0) 0x7f147c03d3a0 con 0x7f147c007540 2023-12-22T08:40:51.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f14837fe640 1 -- 172.21.15.31:0/1960780760 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474003520 con 0x7f147c007540 2023-12-22T08:40:51.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f099501a640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f0988007190 0x7f09880dfc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:55258/0 (socket says 172.21.15.31:55258) 2023-12-22T08:40:51.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f099501a640 1 -- 172.21.15.31:0/3986312705 learned_addr learned my addr 172.21.15.31:0/3986312705 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f098ffff640 1 --2- 172.21.15.31:0/3986312705 >> v2:172.21.15.69:3300/0 conn(0x7f09880d53e0 0x7f098803c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f85524b7640 1 -- 172.21.15.31:0/2094304080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 msgr2=0x7f854c06ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f85524b7640 1 --2- 172.21.15.31:0/2094304080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c06ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.742+0000 7f116eda5640 1 -- start start 2023-12-22T08:40:51.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f116eda5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1160006ed0 0x7f116003c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f116eda5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600072b0 0x7f11600dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f116eda5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116003a6f0 con 0x7f11600d5500 2023-12-22T08:40:51.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f116eda5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f116003a9d0 con 0x7f1160006ed0 2023-12-22T08:40:51.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f116eda5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116003acb0 con 0x7f11600072b0 2023-12-22T08:40:51.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f116d5a2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f11600d5500 0x7f116003e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47962/0 (socket says 172.21.15.31:47962) 2023-12-22T08:40:51.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f116d5a2640 1 -- 172.21.15.31:0/1577895344 learned_addr learned my addr 172.21.15.31:0/1577895344 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f85524b7640 1 -- 172.21.15.31:0/2094304080 >> v1:172.21.15.31:6789/0 conn(0x7f854c149230 legacy=0x7f854c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f4687fc9640 1 Processor -- start 2023-12-22T08:40:51.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f116dda3640 1 --2- 172.21.15.31:0/1577895344 >> v2:172.21.15.31:3300/0 conn(0x7f1160006ed0 0x7f116003c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f1f82b39640 1 Processor -- start 2023-12-22T08:40:51.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f116e5a4640 1 --2- 172.21.15.31:0/1577895344 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600072b0 0x7f11600dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f098f7fe640 1 -- 172.21.15.31:0/3986312705 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399697390 0 0) 0x7f098803a8b0 con 0x7f0988007190 2023-12-22T08:40:51.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f098f7fe640 1 -- 172.21.15.31:0/3986312705 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0980003520 con 0x7f0988007190 2023-12-22T08:40:51.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f098ffff640 1 -- 172.21.15.31:0/3986312705 >> v1:172.21.15.69:6789/0 conn(0x7f0988007190 legacy=0x7f09880dfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f098ffff640 1 -- 172.21.15.31:0/3986312705 >> v1:172.21.15.31:6789/0 conn(0x7f0988006db0 legacy=0x7f098803e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f1f82b39640 1 -- start start 2023-12-22T08:40:51.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f4687fc9640 1 -- start start 2023-12-22T08:40:51.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f116dda3640 1 -- 172.21.15.31:0/1577895344 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600072b0 msgr2=0x7f11600dfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f116dda3640 1 --2- 172.21.15.31:0/1577895344 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600072b0 0x7f11600dfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f116dda3640 1 -- 172.21.15.31:0/1577895344 >> v1:172.21.15.31:6789/0 conn(0x7f11600d5500 legacy=0x7f116003e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f116dda3640 1 -- 172.21.15.31:0/1577895344 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116003e290 con 0x7f1160006ed0 2023-12-22T08:40:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f85524b7640 1 -- 172.21.15.31:0/2094304080 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c0b9a80 con 0x7f854c0bab60 2023-12-22T08:40:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f1f82b39640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1f7c0b14d0 0x7f1f7c0b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f1f82b39640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c06ba80 con 0x7f1f7c0b7a90 2023-12-22T08:40:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f1f82b39640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c146c60 con 0x7f1f7c140ba0 2023-12-22T08:40:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f1f82b39640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c146f40 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f1f810d6640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1f7c0b14d0 0x7f1f7c0b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f1f810d6640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1f7c0b14d0 0x7f1f7c0b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53364/0 (socket says 172.21.15.31:53364) 2023-12-22T08:40:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f1f810d6640 1 -- 172.21.15.31:0/2505665805 learned_addr learned my addr 172.21.15.31:0/2505665805 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f098f7fe640 1 -- 172.21.15.31:0/3986312705 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520901463 0 0) 0x7f098803a5d0 con 0x7f0988006db0 2023-12-22T08:40:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7f098ffff640 1 -- 172.21.15.31:0/3986312705 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098803e170 con 0x7f09880d53e0 2023-12-22T08:40:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7fbb109f5640 1 Processor -- start 2023-12-22T08:40:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.744+0000 7fbb109f5640 1 -- start start 2023-12-22T08:40:51.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f1483fff640 1 -- 172.21.15.31:0/1960780760 >> v2:172.21.15.31:3300/0 conn(0x7f147c007160 msgr2=0x7f147c03ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f1483fff640 1 --2- 172.21.15.31:0/1960780760 >> v2:172.21.15.31:3300/0 conn(0x7f147c007160 0x7f147c03ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f1483fff640 1 -- 172.21.15.31:0/1960780760 >> v1:172.21.15.31:6789/0 conn(0x7f147c007540 legacy=0x7f147c0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.743+0000 7f1483fff640 1 -- 172.21.15.31:0/1960780760 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c03d680 con 0x7f147c03c290 2023-12-22T08:40:51.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f1483fff640 1 --2- 172.21.15.31:0/1960780760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c040820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14700097a0 tx=0x7f147002b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64687359f93a1541 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f14837fe640 1 -- 172.21.15.31:0/1960780760 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478001670 con 0x7f147c03c290 2023-12-22T08:40:51.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f14837fe640 1 -- 172.21.15.31:0/1960780760 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147002e050 con 0x7f147c03c290 2023-12-22T08:40:51.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f14837fe640 1 -- 172.21.15.31:0/1960780760 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470030730 con 0x7f147c03c290 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f4687fc9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46800b7a90 0x7f46800b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f4687fc9640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f46800b0dc0 0x7f46800b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f4687fc9640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468006ba80 con 0x7f4680140ba0 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f4687fc9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4680146c60 con 0x7f46800b7a90 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7f4687fc9640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4680146f40 con 0x7f46800b0dc0 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.745+0000 7fa016238640 1 Processor -- start 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb109f5640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbb0c0b2a20 0x7fbb0c06f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb109f5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb109f5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c0b7c10 con 0x7fbb0c06caa0 2023-12-22T08:40:51.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb109f5640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b7ef0 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb109f5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b81d0 con 0x7fbb0c06ef80 2023-12-22T08:40:51.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f4686566640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f46800b0dc0 0x7f46800b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f4686566640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f46800b0dc0 0x7f46800b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53376/0 (socket says 172.21.15.31:53376) 2023-12-22T08:40:51.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f4686566640 1 -- 172.21.15.31:0/393327984 learned_addr learned my addr 172.21.15.31:0/393327984 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb0ad9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbb0c06caa0 0x7fbb0c158150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47994/0 (socket says 172.21.15.31:47994) 2023-12-22T08:40:51.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb0ad9d640 1 -- 172.21.15.31:0/380146416 learned_addr learned my addr 172.21.15.31:0/380146416 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb0b59e640 1 --2- 172.21.15.31:0/380146416 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f116dda3640 1 --2- 172.21.15.31:0/1577895344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1160006ed0 0x7f116003c550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11640097a0 tx=0x7f116402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248ca31c881f6487 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fa016238640 1 -- start start 2023-12-22T08:40:51.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f85524b7640 1 --2- 172.21.15.31:0/2094304080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c0bab60 0x7f854c148cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f853c009870 tx=0x7f853c02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=175e3716776cc9a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f1f810d6640 1 -- 172.21.15.31:0/2505665805 >> v1:172.21.15.69:6789/0 conn(0x7f1f7c140ba0 legacy=0x7f1f7c06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f1f810d6640 1 -- 172.21.15.31:0/2505665805 >> v1:172.21.15.31:6789/0 conn(0x7f1f7c0b7a90 legacy=0x7f1f7c0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f4686566640 1 -- 172.21.15.31:0/393327984 >> v2:172.21.15.31:3300/0 conn(0x7f46800b7a90 msgr2=0x7f46800b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f4686566640 1 --2- 172.21.15.31:0/393327984 >> v2:172.21.15.31:3300/0 conn(0x7f46800b7a90 0x7f46800b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f4686566640 1 -- 172.21.15.31:0/393327984 >> v1:172.21.15.69:6789/0 conn(0x7f4680140ba0 legacy=0x7f468006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f4686566640 1 -- 172.21.15.31:0/393327984 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680147220 con 0x7f46800b0dc0 2023-12-22T08:40:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f1f810d6640 1 -- 172.21.15.31:0/2505665805 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c147220 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f098ffff640 1 --2- 172.21.15.31:0/3986312705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09880d53e0 0x7f098803c430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f097c0097a0 tx=0x7f097c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ff9ff2c0bd9a5f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7fbb0a59c640 1 --2- 172.21.15.31:0/380146416 >> v2:172.21.15.69:3300/0 conn(0x7fbb0c0b2a20 0x7fbb0c06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f148ad55640 1 -- 172.21.15.31:0/1960780760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 msgr2=0x7f147c040820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f85514b5640 1 -- 172.21.15.31:0/2094304080 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c02f840 con 0x7f854c0bab60 2023-12-22T08:40:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f148ad55640 1 --2- 172.21.15.31:0/1960780760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c040820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14700097a0 tx=0x7f147002b630 comp rx=0 tx=0).stop 2023-12-22T08:40:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f148ad55640 1 -- 172.21.15.31:0/1960780760 shutdown_connections 2023-12-22T08:40:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f148ad55640 1 --2- 172.21.15.31:0/1960780760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c040820 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f148ad55640 1 --2- 172.21.15.31:0/1960780760 >> v2:172.21.15.31:3300/0 conn(0x7f147c007160 0x7f147c03ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f148ad55640 1 -- 172.21.15.31:0/1960780760 >> 172.21.15.31:0/1960780760 conn(0x7f147c041000 msgr2=0x7f147c0413e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f148ad55640 1 -- 172.21.15.31:0/1960780760 shutdown_connections 2023-12-22T08:40:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f148ad55640 1 -- 172.21.15.31:0/1960780760 wait complete. 2023-12-22T08:40:51.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f098f7fe640 1 -- 172.21.15.31:0/3986312705 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c030840 con 0x7f09880d53e0 2023-12-22T08:40:51.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f098f7fe640 1 -- 172.21.15.31:0/3986312705 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c0309a0 con 0x7f09880d53e0 2023-12-22T08:40:51.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa016238640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0080d0f20 0x7fa00803a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f85514b5640 1 -- 172.21.15.31:0/2094304080 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c02f9a0 con 0x7f854c0bab60 2023-12-22T08:40:51.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa00f7fe640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa008006f80 0x7fa0080c7050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:55288/0 (socket says 172.21.15.31:55288) 2023-12-22T08:40:51.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa00f7fe640 1 -- 172.21.15.31:0/1695122386 learned_addr learned my addr 172.21.15.31:0/1695122386 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:51.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa00ffff640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0080d0f20 0x7fa00803a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f098f7fe640 1 -- 172.21.15.31:0/3986312705 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c030d30 con 0x7f09880d53e0 2023-12-22T08:40:51.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa016238640 1 -- 172.21.15.31:0/1695122386 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00803a590 con 0x7fa00803a760 2023-12-22T08:40:51.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa016238640 1 -- 172.21.15.31:0/1695122386 --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00803b0b0 con 0x7fa008006f80 2023-12-22T08:40:51.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa016238640 1 -- 172.21.15.31:0/1695122386 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080c7760 con 0x7fa0080d0f20 2023-12-22T08:40:51.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.746+0000 7f116cda1640 1 -- 172.21.15.31:0/1577895344 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164030610 con 0x7f1160006ed0 2023-12-22T08:40:51.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f116cda1640 1 -- 172.21.15.31:0/1577895344 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164030770 con 0x7f1160006ed0 2023-12-22T08:40:51.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fbb09d9b640 1 -- 172.21.15.31:0/380146416 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204165859 0 0) 0x7fbb0c0b7c10 con 0x7fbb0c06caa0 2023-12-22T08:40:51.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fbb09d9b640 1 -- 172.21.15.31:0/380146416 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf4005730 con 0x7fbb0c06caa0 2023-12-22T08:40:51.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fbb0b59e640 1 -- 172.21.15.31:0/380146416 >> v2:172.21.15.69:3300/0 conn(0x7fbb0c0b2a20 msgr2=0x7fbb0c06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fbb0b59e640 1 --2- 172.21.15.31:0/380146416 >> v2:172.21.15.69:3300/0 conn(0x7fbb0c0b2a20 0x7fbb0c06f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fbb0b59e640 1 -- 172.21.15.31:0/380146416 >> v1:172.21.15.31:6789/0 conn(0x7fbb0c06caa0 legacy=0x7fbb0c158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7f4686566640 1 --2- 172.21.15.31:0/393327984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46800b0dc0 0x7f46800b11e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46800b21e0 tx=0x7f46740300a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d277b80a99cbfae9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fbb0b59e640 1 -- 172.21.15.31:0/380146416 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0b84b0 con 0x7fbb0c06ef80 2023-12-22T08:40:51.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837748317 0 0) 0x7fa00803a590 con 0x7fa00803a760 2023-12-22T08:40:51.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.747+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa000003520 con 0x7fa00803a760 2023-12-22T08:40:51.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562304920 0 0) 0x7fa00803b0b0 con 0x7fa008006f80 2023-12-22T08:40:51.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f85514b5640 1 -- 172.21.15.31:0/2094304080 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c02fd30 con 0x7f854c0bab60 2023-12-22T08:40:51.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa00803a590 con 0x7fa008006f80 2023-12-22T08:40:51.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f0996a7d640 1 -- 172.21.15.31:0/3986312705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09880d53e0 msgr2=0x7f098803c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f0996a7d640 1 --2- 172.21.15.31:0/3986312705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09880d53e0 0x7f098803c430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f097c0097a0 tx=0x7f097c02b980 comp rx=0 tx=0).stop 2023-12-22T08:40:51.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 937080447 0 0) 0x7fa000003520 con 0x7fa00803a760 2023-12-22T08:40:51.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0080d0f20 msgr2=0x7fa00803a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0080d0f20 0x7fa00803a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 >> v1:172.21.15.69:6789/0 conn(0x7fa008006f80 legacy=0x7fa0080c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f116eda5640 1 -- 172.21.15.31:0/1577895344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1160006ed0 msgr2=0x7f116003c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f116eda5640 1 --2- 172.21.15.31:0/1577895344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1160006ed0 0x7f116003c550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11640097a0 tx=0x7f116402b960 comp rx=0 tx=0).stop 2023-12-22T08:40:51.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f116eda5640 1 -- 172.21.15.31:0/1577895344 shutdown_connections 2023-12-22T08:40:51.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f116eda5640 1 --2- 172.21.15.31:0/1577895344 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600072b0 0x7f11600dfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f116eda5640 1 --2- 172.21.15.31:0/1577895344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1160006ed0 0x7f116003c550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f116eda5640 1 -- 172.21.15.31:0/1577895344 >> 172.21.15.31:0/1577895344 conn(0x7f116003ef10 msgr2=0x7f116003f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f116eda5640 1 -- 172.21.15.31:0/1577895344 shutdown_connections 2023-12-22T08:40:51.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00803b350 con 0x7fa00803a760 2023-12-22T08:40:51.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f116eda5640 1 -- 172.21.15.31:0/1577895344 wait complete. 2023-12-22T08:40:51.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f85534b9640 1 -- 172.21.15.31:0/2094304080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c0bab60 msgr2=0x7f854c148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f85534b9640 1 --2- 172.21.15.31:0/2094304080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c0bab60 0x7f854c148cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f853c009870 tx=0x7f853c02ba20 comp rx=0 tx=0).stop 2023-12-22T08:40:51.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f0996a7d640 1 -- 172.21.15.31:0/3986312705 shutdown_connections 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f0996a7d640 1 --2- 172.21.15.31:0/3986312705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09880d53e0 0x7f098803c430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f0996a7d640 1 -- 172.21.15.31:0/3986312705 >> 172.21.15.31:0/3986312705 conn(0x7f098803edf0 msgr2=0x7f098803f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f4684d63640 1 -- 172.21.15.31:0/393327984 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674030e50 con 0x7f46800b0dc0 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f4684d63640 1 -- 172.21.15.31:0/393327984 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674034070 con 0x7f46800b0dc0 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f4684d63640 1 -- 172.21.15.31:0/393327984 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467403a620 con 0x7f46800b0dc0 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f9ffc001670 con 0x7fa00803a760 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 >> v1:172.21.15.31:6789/0 conn(0x7fa00803a760 legacy=0x7fa0080d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0080d0f20 0x7fa000003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7fa00e7fc640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0000040a0 0x7fa0000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fbb0a59c640 1 --2- 172.21.15.31:0/380146416 >> v2:172.21.15.69:3300/0 conn(0x7fbb0c0b2a20 0x7fbb0c06f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:51.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00f7fe640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0080d0f20 0x7fa000003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00e7fc640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa000004d00 0x7fa000005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010068ec0 con 0x7fa000004d00 2023-12-22T08:40:51.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0080c7760 con 0x7fa0000040a0 2023-12-22T08:40:51.771 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00000dcf0 con 0x7fa0080d0f20 2023-12-22T08:40:51.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f148ad55640 1 Processor -- start 2023-12-22T08:40:51.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00effd640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0000040a0 0x7fa0000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f148ad55640 1 -- start start 2023-12-22T08:40:51.772 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f0996a7d640 1 -- 172.21.15.31:0/3986312705 shutdown_connections 2023-12-22T08:40:51.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00ffff640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa000004d00 0x7fa000005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f85534b9640 1 -- 172.21.15.31:0/2094304080 shutdown_connections 2023-12-22T08:40:51.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f85534b9640 1 --2- 172.21.15.31:0/2094304080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c06ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f85534b9640 1 --2- 172.21.15.31:0/2094304080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c0bab60 0x7f854c148cf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.773 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f85534b9640 1 -- 172.21.15.31:0/2094304080 >> 172.21.15.31:0/2094304080 conn(0x7f854c069d00 msgr2=0x7f854c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f4687fc9640 1 -- 172.21.15.31:0/393327984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46800b0dc0 msgr2=0x7f46800b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f4687fc9640 1 --2- 172.21.15.31:0/393327984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46800b0dc0 0x7f46800b11e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46800b21e0 tx=0x7f46740300a0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f85534b9640 1 -- 172.21.15.31:0/2094304080 shutdown_connections 2023-12-22T08:40:51.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fbb0b59e640 1 --2- 172.21.15.31:0/380146416 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c06fd60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c2e0 tx=0x7fbb0402c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce2bfd981b9794e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.774 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f85534b9640 1 -- 172.21.15.31:0/2094304080 wait complete. 2023-12-22T08:40:51.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00effd640 1 -- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0080d0f20 msgr2=0x7fa000003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00effd640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0080d0f20 0x7fa000003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00effd640 1 -- 172.21.15.31:0/1695122386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa000004d00 msgr2=0x7fa000005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:51.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00effd640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa000004d00 0x7fa000005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7fa00effd640 1 -- 172.21.15.31:0/1695122386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000003520 con 0x7fa0000040a0 2023-12-22T08:40:51.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f0996a7d640 1 -- 172.21.15.31:0/3986312705 wait complete. 2023-12-22T08:40:51.775 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f116eda5640 1 Processor -- start 2023-12-22T08:40:51.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f4687fc9640 1 -- 172.21.15.31:0/393327984 shutdown_connections 2023-12-22T08:40:51.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f4687fc9640 1 --2- 172.21.15.31:0/393327984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46800b0dc0 0x7f46800b11e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f4687fc9640 1 --2- 172.21.15.31:0/393327984 >> v2:172.21.15.31:3300/0 conn(0x7f46800b7a90 0x7f46800b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f4687fc9640 1 -- 172.21.15.31:0/393327984 >> 172.21.15.31:0/393327984 conn(0x7f46800b8810 msgr2=0x7f46800b8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.776 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f116eda5640 1 -- start start 2023-12-22T08:40:51.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f1f810d6640 1 --2- 172.21.15.31:0/2505665805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c0b14d0 0x7f1f7c0b7ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009e50 tx=0x7f1f7402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d2216a13d73157 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f1f7b7fe640 1 -- 172.21.15.31:0/2505665805 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7402cb20 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.748+0000 7f1f7b7fe640 1 -- 172.21.15.31:0/2505665805 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7402cc80 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.749+0000 7f1f7b7fe640 1 -- 172.21.15.31:0/2505665805 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f740343f0 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f4687fc9640 1 -- 172.21.15.31:0/393327984 shutdown_connections 2023-12-22T08:40:51.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116eda5640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1160006ed0 0x7f11600d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116eda5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600072b0 0x7f11600bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f148ad55640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f147c007160 0x7f147c0d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116eda5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600d5500 0x7f11600bf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116eda5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11600be510 con 0x7f11600072b0 2023-12-22T08:40:51.778 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f4687fc9640 1 -- 172.21.15.31:0/393327984 wait complete. 2023-12-22T08:40:51.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f148ad55640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f147c007540 0x7f147c1620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116eda5640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11600bdb40 con 0x7f1160006ed0 2023-12-22T08:40:51.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f1488af1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f147c007160 0x7f147c0d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f1488af1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f147c007160 0x7f147c0d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53416/0 (socket says 172.21.15.31:53416) 2023-12-22T08:40:51.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f1488af1640 1 -- 172.21.15.31:0/3488339943 learned_addr learned my addr 172.21.15.31:0/3488339943 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116eda5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11600bd530 con 0x7f11600d5500 2023-12-22T08:40:51.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116e5a4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600d5500 0x7f11600bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f85534b9640 1 Processor -- start 2023-12-22T08:40:51.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116e5a4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600d5500 0x7f11600bf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:57032/0 (socket says 172.21.15.31:57032) 2023-12-22T08:40:51.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f85534b9640 1 -- start start 2023-12-22T08:40:51.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116e5a4640 1 -- 172.21.15.31:0/1470099096 learned_addr learned my addr 172.21.15.31:0/1470099096 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.750+0000 7f116d5a2640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600072b0 0x7f11600bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f1483fff640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f147c007540 0x7f147c1620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f0996a7d640 1 Processor -- start 2023-12-22T08:40:51.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116dda3640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1160006ed0 0x7f11600d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f148ad55640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c162630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116e5a4640 1 -- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1160006ed0 msgr2=0x7f11600d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116e5a4640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1160006ed0 0x7f11600d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c161c50 con 0x7f147c007540 2023-12-22T08:40:51.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0d1680 con 0x7f147c007160 2023-12-22T08:40:51.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116e5a4640 1 -- 172.21.15.31:0/1470099096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600072b0 msgr2=0x7f11600bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f14892f2640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f4687fc9640 1 Processor -- start 2023-12-22T08:40:51.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0d18f0 con 0x7f147c03c290 2023-12-22T08:40:51.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116e5a4640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600072b0 0x7f11600bdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f4687fc9640 1 -- start start 2023-12-22T08:40:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116e5a4640 1 -- 172.21.15.31:0/1470099096 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1164009400 con 0x7f11600d5500 2023-12-22T08:40:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116dda3640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1160006ed0 0x7f11600d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116d5a2640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600072b0 0x7f11600bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f1f82b39640 1 -- 172.21.15.31:0/2505665805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c0b14d0 msgr2=0x7f1f7c0b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116e5a4640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600d5500 0x7f11600bf540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f115800d830 tx=0x7f115800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f115e7fc640 1 -- 172.21.15.31:0/1470099096 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115800b6c0 con 0x7f11600d5500 2023-12-22T08:40:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f115e7fc640 1 -- 172.21.15.31:0/1470099096 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115800b840 con 0x7f11600d5500 2023-12-22T08:40:51.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f115e7fc640 1 -- 172.21.15.31:0/1470099096 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115800bbf0 con 0x7f11600d5500 2023-12-22T08:40:51.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11600d0b30 con 0x7f11600d5500 2023-12-22T08:40:51.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1160035b80 con 0x7f11600d5500 2023-12-22T08:40:51.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.751+0000 7f0996a7d640 1 -- start start 2023-12-22T08:40:51.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7fbb09d9b640 1 -- 172.21.15.31:0/380146416 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400a2d0 con 0x7fbb0c06ef80 2023-12-22T08:40:51.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1488af1640 1 -- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 msgr2=0x7f147c162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1488af1640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c162630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1488af1640 1 -- 172.21.15.31:0/3488339943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f147c007540 msgr2=0x7f147c1620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f85534b9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c1da880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7fbb09d9b640 1 -- 172.21.15.31:0/380146416 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0400a430 con 0x7fbb0c06ef80 2023-12-22T08:40:51.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7fbb09d9b640 1 -- 172.21.15.31:0/380146416 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400a800 con 0x7fbb0c06ef80 2023-12-22T08:40:51.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1488af1640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f147c007540 0x7f147c1620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1488af1640 1 -- 172.21.15.31:0/3488339943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009400 con 0x7f147c007160 2023-12-22T08:40:51.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1f82b39640 1 --2- 172.21.15.31:0/2505665805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c0b14d0 0x7f1f7c0b7ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009e50 tx=0x7f1f7402bf80 comp rx=0 tx=0).stop 2023-12-22T08:40:51.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1483fff640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f147c007540 0x7f147c1620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:51.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7fa00effd640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0000040a0 0x7fa0000047c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc007f20 tx=0x7fa0000057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b240397e63ff1e19 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1488af1640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f147c007160 0x7f147c0d0100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f148404f5d0 tx=0x7f1484067050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1f82b39640 1 -- 172.21.15.31:0/2505665805 shutdown_connections 2023-12-22T08:40:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1f82b39640 1 --2- 172.21.15.31:0/2505665805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c0b14d0 0x7f1f7c0b7ef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f1f82b39640 1 -- 172.21.15.31:0/2505665805 >> 172.21.15.31:0/2505665805 conn(0x7f1f7c0b8810 msgr2=0x7f1f7c0b8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f85524b7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c1da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f85524b7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c1da880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:57052/0 (socket says 172.21.15.31:57052) 2023-12-22T08:40:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f85534b9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f854c0bab60 0x7f854c142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc02c900 con 0x7fa0000040a0 2023-12-22T08:40:51.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f85524b7640 1 -- 172.21.15.31:0/1881102653 learned_addr learned my addr 172.21.15.31:0/1881102653 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f0996a7d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0988006db0 0x7f098816dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f0996a7d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0988007190 0x7f09880d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f0996a7d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f09880d53e0 0x7f09880cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc02ca60 con 0x7fa0000040a0 2023-12-22T08:40:51.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f85534b9640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c149230 0x7f854c1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f0996a7d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880d8e20 con 0x7f0988006db0 2023-12-22T08:40:51.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f0996a7d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880d6b20 con 0x7f0988007190 2023-12-22T08:40:51.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f0996a7d640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880d27a0 con 0x7f09880d53e0 2023-12-22T08:40:51.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.752+0000 7f4687fc9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46800b0dc0 0x7f46801414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f099501a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f09880d53e0 0x7f09880cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4687fc9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46800b7a90 0x7f46801dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0988006db0 0x7f098816dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7fa00e7fc640 1 -- 172.21.15.31:0/1695122386 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc02ce10 con 0x7fa0000040a0 2023-12-22T08:40:51.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f115e7fc640 1 -- 172.21.15.31:0/1470099096 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f115800bd50 con 0x7f11600d5500 2023-12-22T08:40:51.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1160008290 con 0x7f11600d5500 2023-12-22T08:40:51.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f8551cb6640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f854c0bab60 0x7f854c142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f8552cb8640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c149230 0x7f854c1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f85534b9640 1 -- 172.21.15.31:0/1881102653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c1dadc0 con 0x7f854c0bab60 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f85534b9640 1 -- 172.21.15.31:0/1881102653 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c1e7540 con 0x7f854c149230 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f85534b9640 1 -- 172.21.15.31:0/1881102653 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c1e4810 con 0x7f854c0b4f50 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f8551cb6640 1 -- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 msgr2=0x7f854c1da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f8551cb6640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c1da880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f8551cb6640 1 -- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c149230 msgr2=0x7f854c1427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f8551cb6640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c149230 0x7f854c1427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f8551cb6640 1 -- 172.21.15.31:0/1881102653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0094d0 con 0x7f854c0bab60 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f1f82b39640 1 -- 172.21.15.31:0/2505665805 shutdown_connections 2023-12-22T08:40:51.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f1f82b39640 1 -- 172.21.15.31:0/2505665805 wait complete. 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0988006db0 0x7f098816dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54440/0 (socket says 172.21.15.31:54440) 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f099501a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f09880d53e0 0x7f09880cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:57068/0 (socket says 172.21.15.31:57068) 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 -- 172.21.15.31:0/3264220027 learned_addr learned my addr 172.21.15.31:0/3264220027 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 -- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f09880d53e0 msgr2=0x7f09880cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f09880d53e0 0x7f09880cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 -- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0988007190 msgr2=0x7f09880d88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0988007190 0x7f09880d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 -- 172.21.15.31:0/3264220027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c009400 con 0x7f0988006db0 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f0994819640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0988006db0 0x7f098816dde0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0990066b10 tx=0x7f0990067050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f098d7fa640 1 -- 172.21.15.31:0/3264220027 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099006cea0 con 0x7f0988006db0 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f098d7fa640 1 -- 172.21.15.31:0/3264220027 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990067180 con 0x7f0988006db0 2023-12-22T08:40:51.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098816e3c0 con 0x7f0988006db0 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09880d6d30 con 0x7f0988006db0 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f098d7fa640 1 -- 172.21.15.31:0/3264220027 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990073970 con 0x7f0988006db0 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7fbb109f5640 1 -- 172.21.15.31:0/380146416 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 msgr2=0x7fbb0c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7fbb109f5640 1 --2- 172.21.15.31:0/380146416 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c06fd60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c2e0 tx=0x7fbb0402c2a0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7fbb109f5640 1 -- 172.21.15.31:0/380146416 shutdown_connections 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7fbb109f5640 1 --2- 172.21.15.31:0/380146416 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c06fd60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7fbb109f5640 1 --2- 172.21.15.31:0/380146416 >> v2:172.21.15.69:3300/0 conn(0x7fbb0c0b2a20 0x7fbb0c06f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7fbb109f5640 1 -- 172.21.15.31:0/380146416 >> 172.21.15.31:0/380146416 conn(0x7fbb0c0b8890 msgr2=0x7fbb0c0b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7fbb109f5640 1 -- 172.21.15.31:0/380146416 shutdown_connections 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f14817fa640 1 -- 172.21.15.31:0/3488339943 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148408e070 con 0x7f147c007160 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f14817fa640 1 -- 172.21.15.31:0/3488339943 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484067180 con 0x7f147c007160 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f14817fa640 1 -- 172.21.15.31:0/3488339943 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148406cea0 con 0x7f147c007160 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c0cdab0 con 0x7f147c007160 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c0ce070 con 0x7f147c007160 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4687fc9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4680140ba0 0x7f46801dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4687fc9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680141a30 con 0x7f46800b0dc0 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4687fc9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46801db7f0 con 0x7f46800b7a90 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4687fc9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4680142950 con 0x7f4680140ba0 2023-12-22T08:40:51.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4686566640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4680140ba0 0x7f46801dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4686566640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4680140ba0 0x7f46801dc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:57076/0 (socket says 172.21.15.31:57076) 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4686566640 1 -- 172.21.15.31:0/3221587035 learned_addr learned my addr 172.21.15.31:0/3221587035 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.753+0000 7f4685d65640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46800b0dc0 0x7f46801414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f4685d65640 1 -- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4680140ba0 msgr2=0x7f46801dc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f4685d65640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4680140ba0 0x7f46801dc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f4685d65640 1 -- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46800b7a90 msgr2=0x7f46801dbca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f4685d65640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46800b7a90 0x7f46801dbca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f4685d65640 1 -- 172.21.15.31:0/3221587035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467400a570 con 0x7f46800b0dc0 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7f4685d65640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46800b0dc0 0x7f46801414f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f467000bd50 tx=0x7f467000be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7fa016238640 1 -- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0000040a0 msgr2=0x7fa0000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7fa016238640 1 --2- 172.21.15.31:0/1695122386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0000040a0 0x7fa0000047c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc007f20 tx=0x7fa0000057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7fa00ffff640 1 -- 172.21.15.31:0/1695122386 reap_dead start 2023-12-22T08:40:51.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7fa016238640 1 -- 172.21.15.31:0/1695122386 shutdown_connections 2023-12-22T08:40:51.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7fa016238640 1 -- 172.21.15.31:0/1695122386 >> 172.21.15.31:0/1695122386 conn(0x7fa008005da0 msgr2=0x7fa0080061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:51.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7fa016238640 1 -- 172.21.15.31:0/1695122386 shutdown_connections 2023-12-22T08:40:51.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.754+0000 7fa016238640 1 -- 172.21.15.31:0/1695122386 wait complete. 2023-12-22T08:40:51.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f115e7fc640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f114c06a430 0x7f114c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f115e7fc640 1 -- 172.21.15.31:0/1470099096 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1158088e00 con 0x7f11600d5500 2023-12-22T08:40:51.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f116dda3640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f114c06a430 0x7f114c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f85524b7640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c1da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f8551cb6640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f854c0bab60 0x7f854c142260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f854400efc0 tx=0x7f854400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f1f82b39640 1 Processor -- start 2023-12-22T08:40:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f1f82b39640 1 -- start start 2023-12-22T08:40:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0970005250 con 0x7f0988006db0 2023-12-22T08:40:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f467e7fc640 1 -- 172.21.15.31:0/3221587035 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467000ce90 con 0x7f46800b0dc0 2023-12-22T08:40:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f467e7fc640 1 -- 172.21.15.31:0/3221587035 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4670014440 con 0x7f46800b0dc0 2023-12-22T08:40:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f467e7fc640 1 -- 172.21.15.31:0/3221587035 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700147f0 con 0x7f46800b0dc0 2023-12-22T08:40:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.756+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4680142c30 con 0x7f46800b0dc0 2023-12-22T08:40:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.756+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4680142f10 con 0x7f46800b0dc0 2023-12-22T08:40:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.756+0000 7f116dda3640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f114c06a430 0x7f114c06c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1164036000 tx=0x7f1164008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.756+0000 7f8552cb8640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c149230 0x7f854c1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:51.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.756+0000 7f8542ffd640 1 -- 172.21.15.31:0/1881102653 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544009c00 con 0x7f854c0bab60 2023-12-22T08:40:51.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.756+0000 7f8542ffd640 1 -- 172.21.15.31:0/1881102653 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854400f040 con 0x7f854c0bab60 2023-12-22T08:40:51.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.756+0000 7f8542ffd640 1 -- 172.21.15.31:0/1881102653 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440146c0 con 0x7f854c0bab60 2023-12-22T08:40:51.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7fbb109f5640 1 -- 172.21.15.31:0/380146416 wait complete. 2023-12-22T08:40:51.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.755+0000 7f146effd640 1 -- 172.21.15.31:0/3488339943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c0ce200 con 0x7f147c007160 2023-12-22T08:40:51.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.756+0000 7f14817fa640 1 -- 172.21.15.31:0/3488339943 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1484073970 con 0x7f147c007160 2023-12-22T08:40:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f14817fa640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f146806a500 0x7f146806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f098d7fa640 1 -- 172.21.15.31:0/3264220027 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f099008f070 con 0x7f0988006db0 2023-12-22T08:40:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f82b39640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1f7c0b14d0 0x7f1f7c148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7fa016238640 1 Processor -- start 2023-12-22T08:40:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f14817fa640 1 -- 172.21.15.31:0/3488339943 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1484101cb0 con 0x7f147c007160 2023-12-22T08:40:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f82b39640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b7a90 0x7f1f7c141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7fbb109f5640 1 Processor -- start 2023-12-22T08:40:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f82b39640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c140ba0 0x7f1f7c141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7fa016238640 1 -- start start 2023-12-22T08:40:51.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f098d7fa640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f097406a500 0x7f097406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f098d7fa640 1 -- 172.21.15.31:0/3264220027 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0990101c50 con 0x7f0988006db0 2023-12-22T08:40:51.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f098ffff640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f097406a500 0x7f097406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f82b39640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c141f80 con 0x7f1f7c0b7a90 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f82b39640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c1483f0 con 0x7f1f7c140ba0 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f82b39640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c149170 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f808d5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1f7c0b14d0 0x7f1f7c148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f808d5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1f7c0b14d0 0x7f1f7c148c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:57078/0 (socket says 172.21.15.31:57078) 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1f808d5640 1 -- 172.21.15.31:0/1788506920 learned_addr learned my addr 172.21.15.31:0/1788506920 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f1f810d6640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c140ba0 0x7f1f7c141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f1f808d5640 1 -- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c140ba0 msgr2=0x7f1f7c141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f1f808d5640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c140ba0 0x7f1f7c141a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f1f808d5640 1 -- 172.21.15.31:0/1788506920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b7a90 msgr2=0x7f1f7c141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f1f808d5640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b7a90 0x7f1f7c141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f1f808d5640 1 -- 172.21.15.31:0/1788506920 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f74009b30 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7fbb109f5640 1 -- start start 2023-12-22T08:40:51.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f1f808d5640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1f7c0b14d0 0x7f1f7c148c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c400 tx=0x7f1f7000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f467e7fc640 1 -- 172.21.15.31:0/3221587035 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4670014950 con 0x7f46800b0dc0 2023-12-22T08:40:51.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f85534b9640 1 -- 172.21.15.31:0/1881102653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c1e4af0 con 0x7f854c0bab60 2023-12-22T08:40:51.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f85534b9640 1 -- 172.21.15.31:0/1881102653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c0b85c0 con 0x7f854c0bab60 2023-12-22T08:40:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fa016238640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa008036dd0 0x7fa0080cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fa016238640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0080cdc50 0x7fa008165780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.757+0000 7f1483fff640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f146806a500 0x7f146806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7f1483fff640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f146806a500 0x7f146806c9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1470034000 tx=0x7f1470008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fa016238640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0080308a0 0x7fa008165cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fa016238640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00815c9c0 con 0x7fa0080cdc50 2023-12-22T08:40:51.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fa016238640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa008162210 con 0x7fa0080308a0 2023-12-22T08:40:51.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fa016238640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081624b0 con 0x7fa008036dd0 2023-12-22T08:40:51.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fbb109f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb0c06caa0 0x7fbb0c0866d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fbb109f5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c07d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4680061910 con 0x7f46800b0dc0 2023-12-22T08:40:51.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fbb109f5640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb0c0b2a20 0x7fbb0c07ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7f098ffff640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f097406a500 0x7f097406c9c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f097c036000 tx=0x7f097c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fbb109f5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c086c10 con 0x7fbb0c06caa0 2023-12-22T08:40:51.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fbb109f5640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b5550 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.758+0000 7fbb109f5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0b4400 con 0x7fbb0c06ef80 2023-12-22T08:40:51.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0b59e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb0c0b2a20 0x7fbb0c07ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00f7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa008036dd0 0x7fa0080cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00f7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa008036dd0 0x7fa0080cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:57100/0 (socket says 172.21.15.31:57100) 2023-12-22T08:40:51.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00f7fe640 1 -- 172.21.15.31:0/166409071 learned_addr learned my addr 172.21.15.31:0/166409071 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0b59e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb0c0b2a20 0x7fbb0c07ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53466/0 (socket says 172.21.15.31:53466) 2023-12-22T08:40:51.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0b59e640 1 -- 172.21.15.31:0/1881520311 learned_addr learned my addr 172.21.15.31:0/1881520311 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:51.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0a59c640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c07d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00ffff640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0080308a0 0x7fa008165cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0ad9d640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb0c06caa0 0x7fbb0c0866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7f467e7fc640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f466c06a500 0x7f466c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00effd640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0080cdc50 0x7fa008165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7f467e7fc640 1 -- 172.21.15.31:0/3221587035 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4670088ba0 con 0x7f46800b0dc0 2023-12-22T08:40:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0b59e640 1 -- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 msgr2=0x7fbb0c07d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0b59e640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c07d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0b59e640 1 -- 172.21.15.31:0/1881520311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb0c06caa0 msgr2=0x7fbb0c0866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0b59e640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb0c06caa0 0x7fbb0c0866d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0b59e640 1 -- 172.21.15.31:0/1881520311 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0400c050 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00f7fe640 1 -- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0080308a0 msgr2=0x7fa008165cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00f7fe640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0080308a0 0x7fa008165cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00f7fe640 1 -- 172.21.15.31:0/166409071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0080cdc50 msgr2=0x7fa008165780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:51.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00f7fe640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0080cdc50 0x7fa008165780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:51.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fa00f7fe640 1 -- 172.21.15.31:0/166409071 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa008162790 con 0x7fa008036dd0 2023-12-22T08:40:51.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7fbb0a59c640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c07d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:51.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.759+0000 7f4685564640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f466c06a500 0x7f466c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.760+0000 7fbb0b59e640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb0c0b2a20 0x7fbb0c07ddd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c2e0 tx=0x7fbb04004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.760+0000 7fa00f7fe640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa008036dd0 0x7fa0080cd710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa01004ee30 tx=0x7fa010067280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.760+0000 7f85534b9640 1 -- 172.21.15.31:0/1881102653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c1e7740 con 0x7f854c0bab60 2023-12-22T08:40:51.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.760+0000 7f4685564640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f466c06a500 0x7f466c06c9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46801d9310 tx=0x7f4678006c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.760+0000 7f1f797fa640 1 -- 172.21.15.31:0/1788506920 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f700052d0 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7f9ffbfff640 1 -- 172.21.15.31:0/166409071 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01008e070 con 0x7fa008036dd0 2023-12-22T08:40:51.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c149430 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7f1f797fa640 1 -- 172.21.15.31:0/1788506920 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f70005430 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7f9ffbfff640 1 -- 172.21.15.31:0/166409071 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa010073930 con 0x7fa008036dd0 2023-12-22T08:40:51.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7fa016238640 1 -- 172.21.15.31:0/166409071 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa008162a70 con 0x7fa008036dd0 2023-12-22T08:40:51.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7f115e7fc640 1 -- 172.21.15.31:0/1470099096 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1158054350 con 0x7f11600d5500 2023-12-22T08:40:51.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7f1f797fa640 1 -- 172.21.15.31:0/1788506920 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70003830 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7fa016238640 1 -- 172.21.15.31:0/166409071 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00803eaf0 con 0x7fa008036dd0 2023-12-22T08:40:51.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c149710 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.761+0000 7f9ffbfff640 1 -- 172.21.15.31:0/166409071 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01006cea0 con 0x7fa008036dd0 2023-12-22T08:40:51.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.762+0000 7fbaf37fe640 1 -- 172.21.15.31:0/1881520311 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04034b30 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.762+0000 7fbaf37fe640 1 -- 172.21.15.31:0/1881520311 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb04034c90 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.762+0000 7fbaf37fe640 1 -- 172.21.15.31:0/1881520311 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04040470 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.762+0000 7fa016238640 1 -- 172.21.15.31:0/166409071 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff0005250 con 0x7fa008036dd0 2023-12-22T08:40:51.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.762+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c0bb1b0 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.762+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c07d0f0 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.763+0000 7f14817fa640 1 -- 172.21.15.31:0/3488339943 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f14840cd280 con 0x7f147c007160 2023-12-22T08:40:51.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.763+0000 7f1f797fa640 1 -- 172.21.15.31:0/1788506920 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1f70003990 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.763+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c1485b0 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.763+0000 7f9ffbfff640 1 -- 172.21.15.31:0/166409071 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa01009d3f0 con 0x7fa008036dd0 2023-12-22T08:40:51.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.763+0000 7f1f797fa640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1f6806a430 0x7f1f6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7f1f797fa640 1 -- 172.21.15.31:0/1788506920 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f70087ed0 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7f1f7bfff640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1f6806a430 0x7f1f6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7f9ffbfff640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ff406a460 0x7f9ff406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c0bafd0 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7f9ffbfff640 1 -- 172.21.15.31:0/166409071 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa010102570 con 0x7fa008036dd0 2023-12-22T08:40:51.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7f1f7bfff640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1f6806a430 0x7f1f6806c8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c000f60 tx=0x7f1f6c0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7f098d7fa640 1 -- 172.21.15.31:0/3264220027 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f09900cd2b0 con 0x7f0988006db0 2023-12-22T08:40:51.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7fa00effd640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ff406a460 0x7f9ff406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.764+0000 7fbaf37fe640 1 -- 172.21.15.31:0/1881520311 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb040405d0 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.765+0000 7fbaf37fe640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbaf806a480 0x7fbaf806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.765+0000 7fbaf37fe640 1 -- 172.21.15.31:0/1881520311 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb040abe70 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.765+0000 7fa00effd640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ff406a460 0x7f9ff406c920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc036000 tx=0x7f9ffc009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.766+0000 7fbb0ad9d640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbaf806a480 0x7fbaf806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.766+0000 7f8542ffd640 1 -- 172.21.15.31:0/1881102653 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8544014820 con 0x7f854c0bab60 2023-12-22T08:40:51.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.766+0000 7fbb0ad9d640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbaf806a480 0x7fbaf806c940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbafc000f60 tx=0x7fbafc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.766+0000 7f8542ffd640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f853006a480 0x7f853006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:51.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.767+0000 7f85524b7640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f853006a480 0x7f853006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:51.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.767+0000 7f85524b7640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f853006a480 0x7f853006c940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f853c000c00 tx=0x7f853c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:51.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.768+0000 7f1f797fa640 1 -- 172.21.15.31:0/1788506920 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1f700534b0 con 0x7f1f7c0b14d0 2023-12-22T08:40:51.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.770+0000 7fbaf37fe640 1 -- 172.21.15.31:0/1881520311 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbb040776a0 con 0x7fbb0c0b2a20 2023-12-22T08:40:51.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.772+0000 7f9ffbfff640 1 -- 172.21.15.31:0/166409071 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa0100cda30 con 0x7fa008036dd0 2023-12-22T08:40:51.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.774+0000 7f467e7fc640 1 -- 172.21.15.31:0/3221587035 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4670054170 con 0x7f46800b0dc0 2023-12-22T08:40:51.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.775+0000 7f8542ffd640 1 -- 172.21.15.31:0/1881102653 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8544059640 con 0x7f854c0bab60 2023-12-22T08:40:51.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:51.784+0000 7f8542ffd640 1 -- 172.21.15.31:0/1881102653 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8544055280 con 0x7f854c0bab60 2023-12-22T08:40:52.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.173+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f11600bdcb0 con 0x7f11600d5500 2023-12-22T08:40:52.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.173+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0970005500 con 0x7f0988006db0 2023-12-22T08:40:52.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.174+0000 7f115e7fc640 1 -- 172.21.15.31:0/1470099096 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1158057970 con 0x7f11600d5500 2023-12-22T08:40:52.176 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-12-22T08:40:52.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.174+0000 7f098d7fa640 1 -- 172.21.15.31:0/3264220027 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09900d08d0 con 0x7f0988006db0 2023-12-22T08:40:52.177 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-12-22T08:40:52.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.175+0000 7f146effd640 1 -- 172.21.15.31:0/3488339943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f147c0056b0 con 0x7f147c007160 2023-12-22T08:40:52.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.175+0000 7f14817fa640 1 -- 172.21.15.31:0/3488339943 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1484097070 con 0x7f147c007160 2023-12-22T08:40:52.178 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-12-22T08:40:52.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f114c06a430 msgr2=0x7f114c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f116eda5640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f114c06a430 0x7f114c06c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1164036000 tx=0x7f1164008030 comp rx=0 tx=0).stop 2023-12-22T08:40:52.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600d5500 msgr2=0x7f11600bf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f116eda5640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600d5500 0x7f11600bf540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f115800d830 tx=0x7f115800dcf0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f097406a500 msgr2=0x7f097406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f0996a7d640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f097406a500 0x7f097406c9c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f097c036000 tx=0x7f097c030000 comp rx=0 tx=0).stop 2023-12-22T08:40:52.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0988006db0 msgr2=0x7f098816dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 shutdown_connections 2023-12-22T08:40:52.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.177+0000 7f0996a7d640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0988006db0 0x7f098816dde0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0990066b10 tx=0x7f0990067050 comp rx=0 tx=0).stop 2023-12-22T08:40:52.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f116eda5640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f114c06a430 0x7f114c06c8f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f116eda5640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f11600d5500 0x7f11600bf540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f116eda5640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11600072b0 0x7f11600bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f116eda5640 1 --2- 172.21.15.31:0/1470099096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1160006ed0 0x7f11600d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 shutdown_connections 2023-12-22T08:40:52.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 >> 172.21.15.31:0/1470099096 conn(0x7f116003ef10 msgr2=0x7f1160005590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f0996a7d640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f097406a500 0x7f097406c9c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 shutdown_connections 2023-12-22T08:40:52.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f0996a7d640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f09880d53e0 0x7f09880cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f0996a7d640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0988007190 0x7f09880d88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f0996a7d640 1 --2- 172.21.15.31:0/3264220027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0988006db0 0x7f098816dde0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 >> 172.21.15.31:0/3264220027 conn(0x7f098803edf0 msgr2=0x7f09880cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f116eda5640 1 -- 172.21.15.31:0/1470099096 wait complete. 2023-12-22T08:40:52.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 shutdown_connections 2023-12-22T08:40:52.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.178+0000 7f0996a7d640 1 -- 172.21.15.31:0/3264220027 wait complete. 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.179+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f146806a500 msgr2=0x7f146806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.179+0000 7f148ad55640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f146806a500 0x7f146806c9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1470034000 tx=0x7f1470008030 comp rx=0 tx=0).stop 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.179+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f147c007160 msgr2=0x7f147c0d0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.179+0000 7f148ad55640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f147c007160 0x7f147c0d0100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f148404f5d0 tx=0x7f1484067050 comp rx=0 tx=0).stop 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.179+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 shutdown_connections 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.180+0000 7f148ad55640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f146806a500 0x7f146806c9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.180+0000 7f148ad55640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f147c03c290 0x7f147c162630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.180+0000 7f148ad55640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f147c007540 0x7f147c1620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.180+0000 7f148ad55640 1 --2- 172.21.15.31:0/3488339943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f147c007160 0x7f147c0d0100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.180+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 >> 172.21.15.31:0/3488339943 conn(0x7f147c041000 msgr2=0x7f147c043d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.180+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 shutdown_connections 2023-12-22T08:40:52.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.180+0000 7f148ad55640 1 -- 172.21.15.31:0/3488339943 wait complete. 2023-12-22T08:40:52.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.181+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1f7c061910 con 0x7f1f7c0b14d0 2023-12-22T08:40:52.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.181+0000 7f1f797fa640 1 -- 172.21.15.31:0/1788506920 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f70017020 con 0x7f1f7c0b14d0 2023-12-22T08:40:52.187 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-12-22T08:40:52.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.185+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1f6806a430 msgr2=0x7f1f6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.185+0000 7f1f82b39640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1f6806a430 0x7f1f6806c8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c000f60 tx=0x7f1f6c0079b0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1f7c0b14d0 msgr2=0x7f1f7c148c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1f7c0b14d0 0x7f1f7c148c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f7000c400 tx=0x7f1f7000c8c0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 shutdown_connections 2023-12-22T08:40:52.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f1f6806a430 0x7f1f6806c8f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb0c061910 con 0x7fbb0c0b2a20 2023-12-22T08:40:52.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f7c140ba0 0x7f1f7c141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f7c0b7a90 0x7f1f7c141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 --2- 172.21.15.31:0/1788506920 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1f7c0b14d0 0x7f1f7c148c30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 >> 172.21.15.31:0/1788506920 conn(0x7f1f7c0b8810 msgr2=0x7f1f7c144910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 shutdown_connections 2023-12-22T08:40:52.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.186+0000 7f1f82b39640 1 -- 172.21.15.31:0/1788506920 wait complete. 2023-12-22T08:40:52.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.187+0000 7fbaf37fe640 1 -- 172.21.15.31:0/1881520311 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb0407acc0 con 0x7fbb0c0b2a20 2023-12-22T08:40:52.191 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:52.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.188+0000 7fa016238640 1 -- 172.21.15.31:0/166409071 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9ff0005500 con 0x7fa008036dd0 2023-12-22T08:40:52.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.189+0000 7f9ffbfff640 1 -- 172.21.15.31:0/166409071 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0100d1050 con 0x7fa008036dd0 2023-12-22T08:40:52.192 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-12-22T08:40:52.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.190+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4680144560 con 0x7f46800b0dc0 2023-12-22T08:40:52.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.190+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbaf806a480 msgr2=0x7fbaf806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.190+0000 7fbb109f5640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbaf806a480 0x7fbaf806c940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbafc000f60 tx=0x7fbafc009040 comp rx=0 tx=0).stop 2023-12-22T08:40:52.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb0c0b2a20 msgr2=0x7fbb0c07ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb0c0b2a20 0x7fbb0c07ddd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c2e0 tx=0x7fbb04004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:52.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7f467e7fc640 1 -- 172.21.15.31:0/3221587035 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4670019030 con 0x7f46800b0dc0 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 shutdown_connections 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbaf806a480 0x7fbaf806c940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb0c0b2a20 0x7fbb0c07ddd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb0c06ef80 0x7fbb0c07d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 --2- 172.21.15.31:0/1881520311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb0c06caa0 0x7fbb0c0866d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 >> 172.21.15.31:0/1881520311 conn(0x7fbb0c0b8890 msgr2=0x7fbb0c156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 shutdown_connections 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.191+0000 7fbb109f5640 1 -- 172.21.15.31:0/1881520311 wait complete. 2023-12-22T08:40:52.195 INFO:teuthology.orchestra.run.smithi031.stdout:55834574852 2023-12-22T08:40:52.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 -- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ff406a460 msgr2=0x7f9ff406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f466c06a500 msgr2=0x7f466c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f466c06a500 0x7f466c06c9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46801d9310 tx=0x7f4678006c20 comp rx=0 tx=0).stop 2023-12-22T08:40:52.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46800b0dc0 msgr2=0x7f46801414f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46800b0dc0 0x7f46801414f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f467000bd50 tx=0x7f467000be40 comp rx=0 tx=0).stop 2023-12-22T08:40:52.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ff406a460 0x7f9ff406c920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc036000 tx=0x7f9ffc009030 comp rx=0 tx=0).stop 2023-12-22T08:40:52.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 -- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa008036dd0 msgr2=0x7fa0080cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa008036dd0 0x7fa0080cd710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa01004ee30 tx=0x7fa010067280 comp rx=0 tx=0).stop 2023-12-22T08:40:52.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 shutdown_connections 2023-12-22T08:40:52.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f466c06a500 0x7f466c06c9c0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46801d9310 tx=0x7f4678006c20 comp rx=0 tx=0).stop 2023-12-22T08:40:52.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4680140ba0 0x7f46801dc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46800b7a90 0x7f46801dbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 --2- 172.21.15.31:0/3221587035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46800b0dc0 0x7f46801414f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 >> 172.21.15.31:0/3221587035 conn(0x7f46800b8810 msgr2=0x7f468006f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 -- 172.21.15.31:0/166409071 shutdown_connections 2023-12-22T08:40:52.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ff406a460 0x7f9ff406c920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0080308a0 0x7fa008165cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0080cdc50 0x7fa008165780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 --2- 172.21.15.31:0/166409071 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa008036dd0 0x7fa0080cd710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 -- 172.21.15.31:0/166409071 >> 172.21.15.31:0/166409071 conn(0x7fa008005da0 msgr2=0x7fa0080c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 shutdown_connections 2023-12-22T08:40:52.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f4687fc9640 1 -- 172.21.15.31:0/3221587035 wait complete. 2023-12-22T08:40:52.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 -- 172.21.15.31:0/166409071 shutdown_connections 2023-12-22T08:40:52.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f9ff9ffb640 1 -- 172.21.15.31:0/166409071 wait complete. 2023-12-22T08:40:52.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.195+0000 7f85534b9640 1 -- 172.21.15.31:0/1881102653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f854c1e7700 con 0x7f854c0bab60 2023-12-22T08:40:52.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.196+0000 7f8542ffd640 1 -- 172.21.15.31:0/1881102653 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8544055280 con 0x7f854c0bab60 2023-12-22T08:40:52.202 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-12-22T08:40:52.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-22T08:40:52.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-12-22T08:40:52.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 -- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f853006a480 msgr2=0x7f853006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f853006a480 0x7f853006c940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f853c000c00 tx=0x7f853c008030 comp rx=0 tx=0).stop 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 -- 172.21.15.31:0/1881102653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f854c0bab60 msgr2=0x7f854c142260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f854c0bab60 0x7f854c142260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f854400efc0 tx=0x7f854400c490 comp rx=0 tx=0).stop 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 -- 172.21.15.31:0/1881102653 shutdown_connections 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f853006a480 0x7f853006c940 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f853c000c00 tx=0x7f853c008030 comp rx=0 tx=0).stop 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f854c149230 0x7f854c1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f854c0bab60 0x7f854c142260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 --2- 172.21.15.31:0/1881102653 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f854c0b4f50 0x7f854c1da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 -- 172.21.15.31:0/1881102653 >> 172.21.15.31:0/1881102653 conn(0x7f854c069d00 msgr2=0x7f854c146760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:52.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 -- 172.21.15.31:0/1881102653 shutdown_connections 2023-12-22T08:40:52.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:52.201+0000 7f8540ff9640 1 -- 172.21.15.31:0/1881102653 wait complete. 2023-12-22T08:40:52.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-12-22T08:40:52.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-12-22T08:40:52.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-12-22T08:40:52.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-12-22T08:40:52.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-12-22T08:40:53.203 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-22T08:40:53.204 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-22T08:40:53.205 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-22T08:40:53.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-22T08:40:53.219 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-22T08:40:53.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-22T08:40:53.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-22T08:40:53.221 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-22T08:40:53.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.378+0000 7fb56514e640 1 Processor -- start 2023-12-22T08:40:53.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.378+0000 7fb56514e640 1 -- start start 2023-12-22T08:40:53.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.378+0000 7f6c4abae640 1 Processor -- start 2023-12-22T08:40:53.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7fb56514e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb56006a150 0x7fb5600b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7fb56514e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5600b6130 0x7fb56014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7fb56514e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56006f210 con 0x7fb56006a530 2023-12-22T08:40:53.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7fb56514e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb560071090 con 0x7fb56006a150 2023-12-22T08:40:53.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7fb56514e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56006f4b0 con 0x7fb5600b6130 2023-12-22T08:40:53.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7fb55ed9d640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb56006a150 0x7fb5600b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7fb55ed9d640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb56006a150 0x7fb5600b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53492/0 (socket says 172.21.15.31:53492) 2023-12-22T08:40:53.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7fb55ed9d640 1 -- 172.21.15.31:0/372684612 learned_addr learned my addr 172.21.15.31:0/372684612 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7fb55ed9d640 1 -- 172.21.15.31:0/372684612 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5600b6130 msgr2=0x7fb56014a1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-22T08:40:53.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7fb55ed9d640 1 --2- 172.21.15.31:0/372684612 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5600b6130 0x7fb56014a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7fb55ed9d640 1 -- 172.21.15.31:0/372684612 >> v1:172.21.15.31:6789/0 conn(0x7fb56006a530 legacy=0x7fb560070290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-22T08:40:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7f6c4abae640 1 -- start start 2023-12-22T08:40:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f6c4abae640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c440b8810 0x7f6c44152860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f6c4abae640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c440b8c80 con 0x7f6c4406af80 2023-12-22T08:40:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f6c4abae640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c44070360 con 0x7f6c44152da0 2023-12-22T08:40:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f6c4abae640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c44152440 con 0x7f6c440b8810 2023-12-22T08:40:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f6c4a3ad640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6c44152da0 0x7f6c441597b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:55310/0 (socket says 172.21.15.31:55310) 2023-12-22T08:40:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f6c4a3ad640 1 -- 172.21.15.31:0/178228036 learned_addr learned my addr 172.21.15.31:0/178228036 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7f6c493ab640 1 --2- 172.21.15.31:0/178228036 >> v2:172.21.15.31:3300/0 conn(0x7f6c440b8810 0x7f6c44152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7f396df39640 1 Processor -- start 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.379+0000 7f396df39640 1 -- start start 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f396df39640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39680a0cc0 0x7f39680b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f396df39640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f396df39640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39681498f0 con 0x7f3968142f20 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f396df39640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39680b37e0 con 0x7f39680a0cc0 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f396df39640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3968148fc0 con 0x7f3968148a50 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f3966ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39680a0cc0 0x7f39680b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f39677fe640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f3968142f20 0x7f39680b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:55294/0 (socket says 172.21.15.31:55294) 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f39677fe640 1 -- 172.21.15.31:0/2153685685 learned_addr learned my addr 172.21.15.31:0/2153685685 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.380+0000 7f3967fff640 1 --2- 172.21.15.31:0/2153685685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7f3967fff640 1 -- 172.21.15.31:0/2153685685 >> v2:172.21.15.31:3300/0 conn(0x7f39680a0cc0 msgr2=0x7f39680b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7f3967fff640 1 --2- 172.21.15.31:0/2153685685 >> v2:172.21.15.31:3300/0 conn(0x7f39680a0cc0 0x7f39680b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7f3967fff640 1 -- 172.21.15.31:0/2153685685 >> v1:172.21.15.69:6789/0 conn(0x7f3968142f20 legacy=0x7f39680b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7f3967fff640 1 -- 172.21.15.31:0/2153685685 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39681492a0 con 0x7f3968148a50 2023-12-22T08:40:53.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7f6c493ab640 1 -- 172.21.15.31:0/178228036 >> v1:172.21.15.69:6789/0 conn(0x7f6c44152da0 legacy=0x7f6c441597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7f6c493ab640 1 -- 172.21.15.31:0/178228036 >> v1:172.21.15.31:6789/0 conn(0x7f6c4406af80 legacy=0x7f6c44148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7f6c493ab640 1 -- 172.21.15.31:0/178228036 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44070e50 con 0x7f6c440b8810 2023-12-22T08:40:53.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.382+0000 7f3967fff640 1 --2- 172.21.15.31:0/2153685685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680b92e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3960009d90 tx=0x7f396002bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408af519c3cbbb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.381+0000 7fb55ed9d640 1 -- 172.21.15.31:0/372684612 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56006f790 con 0x7fb56006a150 2023-12-22T08:40:53.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.383+0000 7f39667fc640 1 -- 172.21.15.31:0/2153685685 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396002cac0 con 0x7f3968148a50 2023-12-22T08:40:53.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.383+0000 7f39667fc640 1 -- 172.21.15.31:0/2153685685 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396002cc20 con 0x7f3968148a50 2023-12-22T08:40:53.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.383+0000 7f6c493ab640 1 --2- 172.21.15.31:0/178228036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 0x7f6c44152860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009720 tx=0x7f6c4002b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722be227f56b94eb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f39667fc640 1 -- 172.21.15.31:0/2153685685 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3960034440 con 0x7f3968148a50 2023-12-22T08:40:53.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f6c48baa640 1 -- 172.21.15.31:0/178228036 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40030710 con 0x7f6c440b8810 2023-12-22T08:40:53.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7fb55ed9d640 1 --2- 172.21.15.31:0/372684612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 0x7fb5600b5bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb550008870 tx=0x7fb55002e060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37948a1a139bf5d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f6c48baa640 1 -- 172.21.15.31:0/178228036 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4002e050 con 0x7f6c440b8810 2023-12-22T08:40:53.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f396df39640 1 -- 172.21.15.31:0/2153685685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 msgr2=0x7f39680b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7fb55dd9b640 1 -- 172.21.15.31:0/372684612 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55002ee10 con 0x7fb56006a150 2023-12-22T08:40:53.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7fb55dd9b640 1 -- 172.21.15.31:0/372684612 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb550032070 con 0x7fb56006a150 2023-12-22T08:40:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f396df39640 1 --2- 172.21.15.31:0/2153685685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680b92e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3960009d90 tx=0x7f396002bd90 comp rx=0 tx=0).stop 2023-12-22T08:40:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7fb55dd9b640 1 -- 172.21.15.31:0/372684612 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550038620 con 0x7fb56006a150 2023-12-22T08:40:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.385+0000 7f6c4abae640 1 -- 172.21.15.31:0/178228036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 msgr2=0x7f6c44152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f396df39640 1 -- 172.21.15.31:0/2153685685 shutdown_connections 2023-12-22T08:40:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f396df39640 1 --2- 172.21.15.31:0/2153685685 >> v2:172.21.15.31:3300/0 conn(0x7f39680a0cc0 0x7f39680b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f396df39640 1 --2- 172.21.15.31:0/2153685685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680b92e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f396df39640 1 -- 172.21.15.31:0/2153685685 >> 172.21.15.31:0/2153685685 conn(0x7f39680be1e0 msgr2=0x7f39680be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f396df39640 1 -- 172.21.15.31:0/2153685685 shutdown_connections 2023-12-22T08:40:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.384+0000 7f396df39640 1 -- 172.21.15.31:0/2153685685 wait complete. 2023-12-22T08:40:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.385+0000 7f6c4abae640 1 --2- 172.21.15.31:0/178228036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 0x7f6c44152860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009720 tx=0x7f6c4002b690 comp rx=0 tx=0).stop 2023-12-22T08:40:53.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7f396df39640 1 Processor -- start 2023-12-22T08:40:53.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7f6c4abae640 1 -- 172.21.15.31:0/178228036 shutdown_connections 2023-12-22T08:40:53.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7f6c4abae640 1 --2- 172.21.15.31:0/178228036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 0x7f6c44152860 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7f6c4abae640 1 -- 172.21.15.31:0/178228036 >> 172.21.15.31:0/178228036 conn(0x7f6c440b9100 msgr2=0x7f6c440b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7f6c4abae640 1 -- 172.21.15.31:0/178228036 shutdown_connections 2023-12-22T08:40:53.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7fb56514e640 1 -- 172.21.15.31:0/372684612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 msgr2=0x7fb5600b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7fb56514e640 1 --2- 172.21.15.31:0/372684612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 0x7fb5600b5bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb550008870 tx=0x7fb55002e060 comp rx=0 tx=0).stop 2023-12-22T08:40:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7fb56514e640 1 -- 172.21.15.31:0/372684612 shutdown_connections 2023-12-22T08:40:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.387+0000 7fb56514e640 1 --2- 172.21.15.31:0/372684612 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5600b6130 0x7fb56014a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.387+0000 7fb56514e640 1 --2- 172.21.15.31:0/372684612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 0x7fb5600b5bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.387+0000 7fb56514e640 1 -- 172.21.15.31:0/372684612 >> 172.21.15.31:0/372684612 conn(0x7fb5600bc120 msgr2=0x7fb5600bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7f6c4abae640 1 -- 172.21.15.31:0/178228036 wait complete. 2023-12-22T08:40:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.386+0000 7f396df39640 1 -- start start 2023-12-22T08:40:53.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.387+0000 7f396df39640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39680a0cc0 0x7f39680b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.387+0000 7fb56514e640 1 -- 172.21.15.31:0/372684612 shutdown_connections 2023-12-22T08:40:53.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f39677fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39680a0cc0 0x7f39680b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f6c4abae640 1 Processor -- start 2023-12-22T08:40:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f39677fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39680a0cc0 0x7f39680b61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54548/0 (socket says 172.21.15.31:54548) 2023-12-22T08:40:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f39677fe640 1 -- 172.21.15.31:0/1309100226 learned_addr learned my addr 172.21.15.31:0/1309100226 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f396df39640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3968142f20 0x7f39680b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f396df39640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680b6730 con 0x7f39680a0cc0 2023-12-22T08:40:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968147bf0 con 0x7f3968142f20 2023-12-22T08:40:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680b56c0 con 0x7f3968148a50 2023-12-22T08:40:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f3967fff640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.388+0000 7f6c4abae640 1 -- start start 2023-12-22T08:40:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4abae640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c4406af80 0x7f6c44146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4abae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 0x7f6c44150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4abae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c44152da0 0x7f6c4413a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4abae640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44147930 con 0x7f6c440b8810 2023-12-22T08:40:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4abae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441481d0 con 0x7f6c44152da0 2023-12-22T08:40:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4abae640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44147b80 con 0x7f6c4406af80 2023-12-22T08:40:53.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.387+0000 7fb56514e640 1 -- 172.21.15.31:0/372684612 wait complete. 2023-12-22T08:40:53.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4a3ad640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c44152da0 0x7f6c4413a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.400 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c49bac640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c4406af80 0x7f6c44146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4a3ad640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c44152da0 0x7f6c4413a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53504/0 (socket says 172.21.15.31:53504) 2023-12-22T08:40:53.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c4a3ad640 1 -- 172.21.15.31:0/3943530330 learned_addr learned my addr 172.21.15.31:0/3943530330 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.390+0000 7fb56514e640 1 Processor -- start 2023-12-22T08:40:53.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f6c493ab640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 0x7f6c44150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.390+0000 7f6c493ab640 1 -- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c4406af80 msgr2=0x7f6c44146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.390+0000 7f6c493ab640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c4406af80 0x7f6c44146a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.390+0000 7f6c493ab640 1 -- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c44152da0 msgr2=0x7f6c4413a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.390+0000 7f6c493ab640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c44152da0 0x7f6c4413a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.390+0000 7f6c493ab640 1 -- 172.21.15.31:0/3943530330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009400 con 0x7f6c440b8810 2023-12-22T08:40:53.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.390+0000 7fb56514e640 1 -- start start 2023-12-22T08:40:53.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f39677fe640 1 -- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 msgr2=0x7f39680a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.389+0000 7f39677fe640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680a25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb56514e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 0x7fb56013eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.390+0000 7f6c493ab640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 0x7f6c44150030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c40032000 tx=0x7f6c400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb56514e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb56006a530 0x7fb5601e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb56514e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5600b6130 0x7fb5601e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7f6c3a7fc640 1 -- 172.21.15.31:0/3943530330 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4003c410 con 0x7f6c440b8810 2023-12-22T08:40:53.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb56514e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56013f070 con 0x7fb5600b6130 2023-12-22T08:40:53.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb56514e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56013ce40 con 0x7fb56006a150 2023-12-22T08:40:53.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb55f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5600b6130 0x7fb5601e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb55f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5600b6130 0x7fb5601e1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54568/0 (socket says 172.21.15.31:54568) 2023-12-22T08:40:53.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb55f59e640 1 -- 172.21.15.31:0/786754343 learned_addr learned my addr 172.21.15.31:0/786754343 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7f6c4abae640 1 -- 172.21.15.31:0/3943530330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c44147e60 con 0x7f6c440b8810 2023-12-22T08:40:53.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7f6c4abae640 1 -- 172.21.15.31:0/3943530330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c441dc190 con 0x7f6c440b8810 2023-12-22T08:40:53.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.391+0000 7fb56514e640 1 -- 172.21.15.31:0/786754343 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5601e2190 con 0x7fb56006a530 2023-12-22T08:40:53.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.392+0000 7fb55ed9d640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 0x7fb56013eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.392+0000 7fb55e59c640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb56006a530 0x7fb5601e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.392+0000 7f3966ffd640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3968142f20 0x7f39680b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.392+0000 7f39677fe640 1 -- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3968142f20 msgr2=0x7f39680b7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.392+0000 7f39677fe640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3968142f20 0x7f39680b7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.392+0000 7f39677fe640 1 -- 172.21.15.31:0/1309100226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960009a70 con 0x7f39680a0cc0 2023-12-22T08:40:53.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.392+0000 7f3967fff640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.392+0000 7f3966ffd640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3968142f20 0x7f39680b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7fb55e59c640 1 -- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 msgr2=0x7fb56013eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7fb55e59c640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 0x7fb56013eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7f6c4abae640 1 -- 172.21.15.31:0/3943530330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c44147ff0 con 0x7f6c440b8810 2023-12-22T08:40:53.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7fb55e59c640 1 -- 172.21.15.31:0/786754343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5600b6130 msgr2=0x7fb5601e1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7fb55e59c640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5600b6130 0x7fb5601e1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7f6c3a7fc640 1 -- 172.21.15.31:0/3943530330 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4003c570 con 0x7f6c440b8810 2023-12-22T08:40:53.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7fb55e59c640 1 -- 172.21.15.31:0/786754343 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550008550 con 0x7fb56006a530 2023-12-22T08:40:53.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7f6c3a7fc640 1 -- 172.21.15.31:0/3943530330 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4003c920 con 0x7f6c440b8810 2023-12-22T08:40:53.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.394+0000 7f6c3a7fc640 1 -- 172.21.15.31:0/3943530330 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c40039070 con 0x7f6c440b8810 2023-12-22T08:40:53.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.393+0000 7fb55f59e640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5600b6130 0x7fb5601e1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:53.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.394+0000 7fb55e59c640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb56006a530 0x7fb5601e1710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb55800be20 tx=0x7fb558009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.394+0000 7fb5477fe640 1 -- 172.21.15.31:0/786754343 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558014440 con 0x7fb56006a530 2023-12-22T08:40:53.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.394+0000 7fb5477fe640 1 -- 172.21.15.31:0/786754343 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5580145a0 con 0x7fb56006a530 2023-12-22T08:40:53.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.394+0000 7fb5477fe640 1 -- 172.21.15.31:0/786754343 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558014440 con 0x7fb56006a530 2023-12-22T08:40:53.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.394+0000 7fb56514e640 1 -- 172.21.15.31:0/786754343 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5600b7210 con 0x7fb56006a530 2023-12-22T08:40:53.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.394+0000 7fb56514e640 1 -- 172.21.15.31:0/786754343 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5600b6fa0 con 0x7fb56006a530 2023-12-22T08:40:53.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.395+0000 7f6c3a7fc640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c2806a500 0x7f6c2806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.395+0000 7f6c3a7fc640 1 -- 172.21.15.31:0/3943530330 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c400aa9c0 con 0x7f6c440b8810 2023-12-22T08:40:53.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.396+0000 7f39677fe640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39680a0cc0 0x7f39680b61f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f395800c940 tx=0x7f395800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.396+0000 7fb56514e640 1 -- 172.21.15.31:0/786754343 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb560066630 con 0x7fb56006a530 2023-12-22T08:40:53.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.397+0000 7fb5477fe640 1 -- 172.21.15.31:0/786754343 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb55801d3b0 con 0x7fb56006a530 2023-12-22T08:40:53.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.398+0000 7fb5477fe640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb54c06a4f0 0x7fb54c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.398+0000 7f6c49bac640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c2806a500 0x7f6c2806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.398+0000 7fb5477fe640 1 -- 172.21.15.31:0/786754343 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb558057970 con 0x7fb56006a530 2023-12-22T08:40:53.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.398+0000 7fb55ed9d640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb54c06a4f0 0x7fb54c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.399+0000 7fb55ed9d640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb54c06a4f0 0x7fb54c06c9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb550039000 tx=0x7fb550008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.399+0000 7f6c49bac640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c2806a500 0x7f6c2806c9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c34003d90 tx=0x7f6c34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.402+0000 7f6c3a7fc640 1 -- 172.21.15.31:0/3943530330 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6c40075f90 con 0x7f6c440b8810 2023-12-22T08:40:53.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.402+0000 7f394ffff640 1 -- 172.21.15.31:0/1309100226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580072d0 con 0x7f39680a0cc0 2023-12-22T08:40:53.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.402+0000 7f394ffff640 1 -- 172.21.15.31:0/1309100226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958007430 con 0x7f39680a0cc0 2023-12-22T08:40:53.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.402+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39680b59a0 con 0x7f39680a0cc0 2023-12-22T08:40:53.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.403+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3968147880 con 0x7f39680a0cc0 2023-12-22T08:40:53.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.403+0000 7fb5477fe640 1 -- 172.21.15.31:0/786754343 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb558054440 con 0x7fb56006a530 2023-12-22T08:40:53.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.406+0000 7f394ffff640 1 -- 172.21.15.31:0/1309100226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580047e0 con 0x7f39680a0cc0 2023-12-22T08:40:53.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.406+0000 7f394ffff640 1 -- 172.21.15.31:0/1309100226 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3958004a00 con 0x7f39680a0cc0 2023-12-22T08:40:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.407+0000 7f394ffff640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f395406a580 0x7f395406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.407+0000 7f394ffff640 1 -- 172.21.15.31:0/1309100226 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3958088350 con 0x7f39680a0cc0 2023-12-22T08:40:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.409+0000 7f3966ffd640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f395406a580 0x7f395406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.409+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3948005250 con 0x7f39680a0cc0 2023-12-22T08:40:53.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.418+0000 7f394ffff640 1 -- 172.21.15.31:0/1309100226 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3958018020 con 0x7f39680a0cc0 2023-12-22T08:40:53.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.421+0000 7f3966ffd640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f395406a580 0x7f395406ca40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f395c006fd0 tx=0x7f395c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.430+0000 7ff456829640 1 Processor -- start 2023-12-22T08:40:53.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.431+0000 7ff456829640 1 -- start start 2023-12-22T08:40:53.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.432+0000 7ff456829640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff448006f80 0x7ff4480d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.432+0000 7ff456829640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff44803aab0 0x7ff4480dfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.432+0000 7ff456829640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44803af40 con 0x7ff4480049d0 2023-12-22T08:40:53.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.432+0000 7ff456829640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44803c7c0 con 0x7ff448006f80 2023-12-22T08:40:53.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.432+0000 7ff456829640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44803caa0 con 0x7ff44803aab0 2023-12-22T08:40:53.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.432+0000 7ff456028640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff44803aab0 0x7ff4480dfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.432+0000 7ff456028640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff44803aab0 0x7ff4480dfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:57152/0 (socket says 172.21.15.31:57152) 2023-12-22T08:40:53.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.432+0000 7ff456028640 1 -- 172.21.15.31:0/3616989895 learned_addr learned my addr 172.21.15.31:0/3616989895 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.433+0000 7ff456028640 1 -- 172.21.15.31:0/3616989895 >> v2:172.21.15.31:3300/0 conn(0x7ff448006f80 msgr2=0x7ff4480d5380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-22T08:40:53.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.433+0000 7ff455827640 1 --2- 172.21.15.31:0/3616989895 >> v2:172.21.15.31:3300/0 conn(0x7ff448006f80 0x7ff4480d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.433+0000 7ff456028640 1 --2- 172.21.15.31:0/3616989895 >> v2:172.21.15.31:3300/0 conn(0x7ff448006f80 0x7ff4480d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.433+0000 7ff456028640 1 -- 172.21.15.31:0/3616989895 >> v1:172.21.15.31:6789/0 conn(0x7ff4480049d0 legacy=0x7ff4480cf320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-22T08:40:53.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.433+0000 7ff456028640 1 -- 172.21.15.31:0/3616989895 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44803a2b0 con 0x7ff44803aab0 2023-12-22T08:40:53.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.434+0000 7ff455827640 1 --2- 172.21.15.31:0/3616989895 >> v2:172.21.15.31:3300/0 conn(0x7ff448006f80 0x7ff4480d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.434+0000 7ff456028640 1 --2- 172.21.15.31:0/3616989895 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff44803aab0 0x7ff4480dfcc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff450068620 tx=0x7ff450067530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d7c8c5f21d6868a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.435+0000 7ff454825640 1 -- 172.21.15.31:0/3616989895 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45006cea0 con 0x7ff44803aab0 2023-12-22T08:40:53.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.435+0000 7ff454825640 1 -- 172.21.15.31:0/3616989895 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4500ab930 con 0x7ff44803aab0 2023-12-22T08:40:53.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.436+0000 7ff454825640 1 -- 172.21.15.31:0/3616989895 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4500abd60 con 0x7ff44803aab0 2023-12-22T08:40:53.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.436+0000 7ff28a1f1640 1 Processor -- start 2023-12-22T08:40:53.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.436+0000 7f12c257e640 1 Processor -- start 2023-12-22T08:40:53.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.436+0000 7ff456829640 1 -- 172.21.15.31:0/3616989895 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff44803aab0 msgr2=0x7ff4480dfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.436+0000 7f12c257e640 1 -- start start 2023-12-22T08:40:53.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7f12c257e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f12b4006f80 0x7f12b40d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7f12c257e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12b40049d0 0x7f12b403aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7f12c257e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 0x7f12b403e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7f12c257e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b403c7c0 con 0x7f12b4006f80 2023-12-22T08:40:53.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7f12c257e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b403caa0 con 0x7f12b40049d0 2023-12-22T08:40:53.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7f12c257e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b403a2b0 con 0x7f12b40cf320 2023-12-22T08:40:53.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.436+0000 7ff28a1f1640 1 -- start start 2023-12-22T08:40:53.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7ff28a1f1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 0x7ff2840b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7ff28a1f1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff2840b6130 0x7ff28414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7ff28a1f1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff28406a530 0x7ff28414a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7ff28a1f1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff284071090 con 0x7ff28406a530 2023-12-22T08:40:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7ff28a1f1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28406f210 con 0x7ff2840b6130 2023-12-22T08:40:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.437+0000 7ff28a1f1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28406f4b0 con 0x7ff28406a150 2023-12-22T08:40:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.436+0000 7ff456829640 1 --2- 172.21.15.31:0/3616989895 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff44803aab0 0x7ff4480dfcc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff450068620 tx=0x7ff450067530 comp rx=0 tx=0).stop 2023-12-22T08:40:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff456829640 1 -- 172.21.15.31:0/3616989895 shutdown_connections 2023-12-22T08:40:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff456829640 1 --2- 172.21.15.31:0/3616989895 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff44803aab0 0x7ff4480dfcc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff2837fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 0x7ff2840b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff283fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff28406a530 0x7ff28414a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff456829640 1 --2- 172.21.15.31:0/3616989895 >> v2:172.21.15.31:3300/0 conn(0x7ff448006f80 0x7ff4480d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff283fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff28406a530 0x7ff28414a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54604/0 (socket says 172.21.15.31:54604) 2023-12-22T08:40:53.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff283fff640 1 -- 172.21.15.31:0/647272004 learned_addr learned my addr 172.21.15.31:0/647272004 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff456829640 1 -- 172.21.15.31:0/3616989895 >> 172.21.15.31:0/3616989895 conn(0x7ff4480061f0 msgr2=0x7ff448006600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff456829640 1 -- 172.21.15.31:0/3616989895 shutdown_connections 2023-12-22T08:40:53.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7f12bb7fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12b40049d0 0x7f12b403aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7f12bb7fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12b40049d0 0x7f12b403aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53526/0 (socket says 172.21.15.31:53526) 2023-12-22T08:40:53.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7f12bb7fe640 1 -- 172.21.15.31:0/2816787928 learned_addr learned my addr 172.21.15.31:0/2816787928 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7fd84f010640 1 Processor -- start 2023-12-22T08:40:53.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7fd84f010640 1 -- start start 2023-12-22T08:40:53.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff2837fe640 1 -- 172.21.15.31:0/647272004 >> v2:172.21.15.69:3300/0 conn(0x7ff2840b6130 msgr2=0x7ff28414a1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-22T08:40:53.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff2837fe640 1 --2- 172.21.15.31:0/647272004 >> v2:172.21.15.69:3300/0 conn(0x7ff2840b6130 0x7ff28414a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff2837fe640 1 -- 172.21.15.31:0/647272004 >> v2:172.21.15.31:3300/0 conn(0x7ff28406a530 msgr2=0x7ff28414a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff2837fe640 1 --2- 172.21.15.31:0/647272004 >> v2:172.21.15.31:3300/0 conn(0x7ff28406a530 0x7ff28414a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.438+0000 7ff456829640 1 -- 172.21.15.31:0/3616989895 wait complete. 2023-12-22T08:40:53.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7ff2837fe640 1 -- 172.21.15.31:0/647272004 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28406f790 con 0x7ff28406a150 2023-12-22T08:40:53.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7f12bb7fe640 1 -- 172.21.15.31:0/2816787928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 msgr2=0x7f12b403e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7f12bb7fe640 1 --2- 172.21.15.31:0/2816787928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 0x7f12b403e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7f12bb7fe640 1 -- 172.21.15.31:0/2816787928 >> v2:172.21.15.31:3300/0 conn(0x7f12b4006f80 msgr2=0x7f12b40d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7f12bbfff640 1 --2- 172.21.15.31:0/2816787928 >> v2:172.21.15.31:3300/0 conn(0x7f12b4006f80 0x7f12b40d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7f12bb7fe640 1 --2- 172.21.15.31:0/2816787928 >> v2:172.21.15.31:3300/0 conn(0x7f12b4006f80 0x7f12b40d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7f12bb7fe640 1 -- 172.21.15.31:0/2816787928 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b403a590 con 0x7f12b40049d0 2023-12-22T08:40:53.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7f12bbfff640 1 --2- 172.21.15.31:0/2816787928 >> v2:172.21.15.31:3300/0 conn(0x7f12b4006f80 0x7f12b40d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.439+0000 7fd84f010640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8480b8cf0 0x7fd8481478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84f010640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd848147e30 0x7fd848141700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84f010640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84806c960 con 0x7fd848070f80 2023-12-22T08:40:53.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84cdac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8480b8cf0 0x7fd8481478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7ff456829640 1 Processor -- start 2023-12-22T08:40:53.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84cdac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8480b8cf0 0x7fd8481478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54612/0 (socket says 172.21.15.31:54612) 2023-12-22T08:40:53.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84d5ad640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd848070f80 0x7fd84806fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48038/0 (socket says 172.21.15.31:48038) 2023-12-22T08:40:53.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84cdac640 1 -- 172.21.15.31:0/1421232606 learned_addr learned my addr 172.21.15.31:0/1421232606 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84f010640 1 -- 172.21.15.31:0/1421232606 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84806cbb0 con 0x7fd8480b8cf0 2023-12-22T08:40:53.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84f010640 1 -- 172.21.15.31:0/1421232606 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84806ce90 con 0x7fd848147e30 2023-12-22T08:40:53.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7f12bb7fe640 1 --2- 172.21.15.31:0/2816787928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 0x7f12b403aab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f12b403f210 tx=0x7f12a802b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27ab72fe3367e369 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd847fff640 1 --2- 172.21.15.31:0/1421232606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd848147e30 0x7fd848141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84cdac640 1 -- 172.21.15.31:0/1421232606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd848147e30 msgr2=0x7fd848141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84cdac640 1 --2- 172.21.15.31:0/1421232606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd848147e30 0x7fd848141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84cdac640 1 -- 172.21.15.31:0/1421232606 >> v1:172.21.15.31:6789/0 conn(0x7fd848070f80 legacy=0x7fd84806fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd84cdac640 1 -- 172.21.15.31:0/1421232606 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84806d170 con 0x7fd8480b8cf0 2023-12-22T08:40:53.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7fd847fff640 1 --2- 172.21.15.31:0/1421232606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd848147e30 0x7fd848141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7f12baffd640 1 -- 172.21.15.31:0/2816787928 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8031890 con 0x7f12b40049d0 2023-12-22T08:40:53.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7f12baffd640 1 -- 172.21.15.31:0/2816787928 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a80319f0 con 0x7f12b40049d0 2023-12-22T08:40:53.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7f12baffd640 1 -- 172.21.15.31:0/2816787928 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8031d80 con 0x7f12b40049d0 2023-12-22T08:40:53.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff2837fe640 1 --2- 172.21.15.31:0/647272004 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 0x7ff2840b5bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff28406aa40 tx=0x7ff27802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=820e3d84e19ae6bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.440+0000 7ff456829640 1 -- start start 2023-12-22T08:40:53.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff2827fc640 1 -- 172.21.15.31:0/647272004 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278031640 con 0x7ff28406a150 2023-12-22T08:40:53.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff6a9304640 1 Processor -- start 2023-12-22T08:40:53.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff2827fc640 1 -- 172.21.15.31:0/647272004 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2780317a0 con 0x7ff28406a150 2023-12-22T08:40:53.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff6a9304640 1 -- start start 2023-12-22T08:40:53.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff2827fc640 1 -- 172.21.15.31:0/647272004 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278031b30 con 0x7ff28406a150 2023-12-22T08:40:53.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7fd84cdac640 1 --2- 172.21.15.31:0/1421232606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8480b8cf0 0x7fd8481478f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd840009e50 tx=0x7fd84002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8b2b24cd4fdc9b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff456829640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4480049d0 0x7ff44801dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff456829640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff448006f80 0x7ff4480cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff456829640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44803aab0 0x7ff44801c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff6a9304640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c00a8d0 0x7ff69c0d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff456829640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44801c190 con 0x7ff44803aab0 2023-12-22T08:40:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff6a9304640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff69c0d2d00 0x7ff69c0d99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff6a9304640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c03e610 con 0x7ff69c007d60 2023-12-22T08:40:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff6a9304640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c00acd0 con 0x7ff69c0d2d00 2023-12-22T08:40:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff6a9304640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0d3130 con 0x7ff69c00a8d0 2023-12-22T08:40:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff456829640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448039610 con 0x7ff4480049d0 2023-12-22T08:40:53.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7fd8477fe640 1 -- 172.21.15.31:0/1421232606 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84002cb90 con 0x7fd8480b8cf0 2023-12-22T08:40:53.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff28a1f1640 1 -- 172.21.15.31:0/647272004 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 msgr2=0x7ff2840b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/647272004 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 0x7ff2840b5bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff28406aa40 tx=0x7ff27802b8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff6a3fff640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff69c007d60 0x7ff69c0d1be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:55326/0 (socket says 172.21.15.31:55326) 2023-12-22T08:40:53.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff6a3fff640 1 -- 172.21.15.31:0/18380527 learned_addr learned my addr 172.21.15.31:0/18380527 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:53.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff6a8b03640 1 --2- 172.21.15.31:0/18380527 >> v2:172.21.15.31:3300/0 conn(0x7ff69c0d2d00 0x7ff69c0d99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7fd8477fe640 1 -- 172.21.15.31:0/1421232606 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84002ccf0 con 0x7fd8480b8cf0 2023-12-22T08:40:53.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7fd8477fe640 1 -- 172.21.15.31:0/1421232606 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840034610 con 0x7fd8480b8cf0 2023-12-22T08:40:53.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 -- 172.21.15.31:0/2816787928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 msgr2=0x7f12b403aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff6a37fe640 1 --2- 172.21.15.31:0/18380527 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c00a8d0 0x7ff69c0d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff28a1f1640 1 -- 172.21.15.31:0/647272004 shutdown_connections 2023-12-22T08:40:53.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/647272004 >> v2:172.21.15.31:3300/0 conn(0x7ff28406a530 0x7ff28414a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/647272004 >> v2:172.21.15.69:3300/0 conn(0x7ff2840b6130 0x7ff28414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/647272004 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 0x7ff2840b5bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff28a1f1640 1 -- 172.21.15.31:0/647272004 >> 172.21.15.31:0/647272004 conn(0x7ff2840bc120 msgr2=0x7ff2840bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 --2- 172.21.15.31:0/2816787928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 0x7f12b403aab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f12b403f210 tx=0x7f12a802b930 comp rx=0 tx=0).stop 2023-12-22T08:40:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff28a1f1640 1 -- 172.21.15.31:0/647272004 shutdown_connections 2023-12-22T08:40:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 -- 172.21.15.31:0/2816787928 shutdown_connections 2023-12-22T08:40:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 --2- 172.21.15.31:0/2816787928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 0x7f12b403e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 --2- 172.21.15.31:0/2816787928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 0x7f12b403aab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 --2- 172.21.15.31:0/2816787928 >> v2:172.21.15.31:3300/0 conn(0x7f12b4006f80 0x7f12b40d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 -- 172.21.15.31:0/2816787928 >> 172.21.15.31:0/2816787928 conn(0x7f12b40061f0 msgr2=0x7f12b4006600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff28a1f1640 1 -- 172.21.15.31:0/647272004 wait complete. 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff456829640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44801e0e0 con 0x7ff448006f80 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff456028640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44803aab0 0x7ff44801c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.441+0000 7ff456028640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44803aab0 0x7ff44801c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54626/0 (socket says 172.21.15.31:54626) 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff456028640 1 -- 172.21.15.31:0/1547988754 learned_addr learned my addr 172.21.15.31:0/1547988754 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff456028640 1 -- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff448006f80 msgr2=0x7ff4480cd860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff456028640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff448006f80 0x7ff4480cd860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff456028640 1 -- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4480049d0 msgr2=0x7ff44801dae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff456028640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4480049d0 0x7ff44801dae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.442+0000 7ff456028640 1 -- 172.21.15.31:0/1547988754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450072f90 con 0x7ff44803aab0 2023-12-22T08:40:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff6a8b03640 1 -- 172.21.15.31:0/18380527 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c00a8d0 msgr2=0x7ff69c0d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff6a8b03640 1 --2- 172.21.15.31:0/18380527 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c00a8d0 0x7ff69c0d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff6a2ffd640 1 -- 172.21.15.31:0/18380527 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119206166 0 0) 0x7ff69c03e610 con 0x7ff69c007d60 2023-12-22T08:40:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff6a8b03640 1 -- 172.21.15.31:0/18380527 >> v1:172.21.15.69:6789/0 conn(0x7ff69c007d60 legacy=0x7ff69c0d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff6a8b03640 1 -- 172.21.15.31:0/18380527 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c03dfc0 con 0x7ff69c0d2d00 2023-12-22T08:40:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7ff6a37fe640 1 --2- 172.21.15.31:0/18380527 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c00a8d0 0x7ff69c0d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 -- 172.21.15.31:0/2816787928 shutdown_connections 2023-12-22T08:40:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7f12c257e640 1 -- 172.21.15.31:0/2816787928 wait complete. 2023-12-22T08:40:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7ff456028640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44803aab0 0x7ff44801c950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4500728a0 tx=0x7ff450072d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.443+0000 7fd84f010640 1 -- 172.21.15.31:0/1421232606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8480b8cf0 msgr2=0x7fd8481478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7fd84f010640 1 --2- 172.21.15.31:0/1421232606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8480b8cf0 0x7fd8481478f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd840009e50 tx=0x7fd84002bff0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7fd84f010640 1 -- 172.21.15.31:0/1421232606 shutdown_connections 2023-12-22T08:40:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7fd84f010640 1 --2- 172.21.15.31:0/1421232606 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd848147e30 0x7fd848141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7fd84f010640 1 --2- 172.21.15.31:0/1421232606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8480b8cf0 0x7fd8481478f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7fd84f010640 1 -- 172.21.15.31:0/1421232606 >> 172.21.15.31:0/1421232606 conn(0x7fd84806ae10 msgr2=0x7fd84806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7ff4467fc640 1 -- 172.21.15.31:0/1547988754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4500b3a50 con 0x7ff44803aab0 2023-12-22T08:40:53.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7ff4467fc640 1 -- 172.21.15.31:0/1547988754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4500b8070 con 0x7ff44803aab0 2023-12-22T08:40:53.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7ff4467fc640 1 -- 172.21.15.31:0/1547988754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4500b3e10 con 0x7ff44803aab0 2023-12-22T08:40:53.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7fd84f010640 1 -- 172.21.15.31:0/1421232606 shutdown_connections 2023-12-22T08:40:53.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7fd84f010640 1 -- 172.21.15.31:0/1421232606 wait complete. 2023-12-22T08:40:53.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7ff28a1f1640 1 Processor -- start 2023-12-22T08:40:53.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7ff6a8b03640 1 --2- 172.21.15.31:0/18380527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c0d2d00 0x7ff69c0d99f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097a0 tx=0x7ff69802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d470a5518d2be875 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.445+0000 7f12c257e640 1 Processor -- start 2023-12-22T08:40:53.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.445+0000 7ff6a2ffd640 1 -- 172.21.15.31:0/18380527 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698030610 con 0x7ff69c0d2d00 2023-12-22T08:40:53.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.445+0000 7ff6a2ffd640 1 -- 172.21.15.31:0/18380527 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff698030770 con 0x7ff69c0d2d00 2023-12-22T08:40:53.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.445+0000 7f12c257e640 1 -- start start 2023-12-22T08:40:53.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.445+0000 7ff6a2ffd640 1 -- 172.21.15.31:0/18380527 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff698030b00 con 0x7ff69c0d2d00 2023-12-22T08:40:53.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.444+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44801c430 con 0x7ff44803aab0 2023-12-22T08:40:53.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.445+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4480e0640 con 0x7ff44803aab0 2023-12-22T08:40:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.445+0000 7ff28a1f1640 1 -- start start 2023-12-22T08:40:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff28a1f1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 0x7ff28413eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff28a1f1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff28406a530 0x7ff2840b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff28a1f1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2840b6130 0x7ff284136060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff28a1f1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28413efe0 con 0x7ff28406a530 2023-12-22T08:40:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff28a1f1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840b3ff0 con 0x7ff2840b6130 2023-12-22T08:40:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff28a1f1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840b3a30 con 0x7ff28406a150 2023-12-22T08:40:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7fd84f010640 1 Processor -- start 2023-12-22T08:40:53.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff283fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2840b6130 0x7ff284136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff283fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2840b6130 0x7ff284136060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53528/0 (socket says 172.21.15.31:53528) 2023-12-22T08:40:53.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff283fff640 1 -- 172.21.15.31:0/3476849466 learned_addr learned my addr 172.21.15.31:0/3476849466 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7ff282ffd640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff28406a530 0x7ff2840b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.446+0000 7f12c257e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 0x7f12b40d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12c257e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b4006f80 0x7f12b403dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7fd84f010640 1 -- start start 2023-12-22T08:40:53.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12bbfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 0x7f12b40d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12bbfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 0x7f12b40d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53536/0 (socket says 172.21.15.31:53536) 2023-12-22T08:40:53.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12bbfff640 1 -- 172.21.15.31:0/3869410996 learned_addr learned my addr 172.21.15.31:0/3869410996 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12c257e640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 0x7f12b415c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12c257e640 1 -- 172.21.15.31:0/3869410996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b416f3b0 con 0x7f12b4006f80 2023-12-22T08:40:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12c257e640 1 -- 172.21.15.31:0/3869410996 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b416ef20 con 0x7f12b40049d0 2023-12-22T08:40:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7ff283fff640 1 -- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 msgr2=0x7ff28413eaa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-22T08:40:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7ff283fff640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 0x7ff28413eaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7ff283fff640 1 -- 172.21.15.31:0/3476849466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff28406a530 msgr2=0x7ff2840b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7ff283fff640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff28406a530 0x7ff2840b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7ff283fff640 1 -- 172.21.15.31:0/3476849466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009400 con 0x7ff2840b6130 2023-12-22T08:40:53.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12c0b1b640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 0x7f12b415c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12c257e640 1 -- 172.21.15.31:0/3869410996 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b403e2a0 con 0x7f12b40cf320 2023-12-22T08:40:53.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7f12bb7fe640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b4006f80 0x7f12b403dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7ff6a9304640 1 -- 172.21.15.31:0/18380527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c0d2d00 msgr2=0x7ff69c0d99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.447+0000 7ff6a9304640 1 --2- 172.21.15.31:0/18380527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c0d2d00 0x7ff69c0d99f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff6980097a0 tx=0x7ff69802b960 comp rx=0 tx=0).stop 2023-12-22T08:40:53.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff283fff640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2840b6130 0x7ff284136060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00efc0 tx=0x7ff27c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff6a9304640 1 -- 172.21.15.31:0/18380527 shutdown_connections 2023-12-22T08:40:53.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff6a9304640 1 --2- 172.21.15.31:0/18380527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c0d2d00 0x7ff69c0d99f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff26bfff640 1 -- 172.21.15.31:0/3476849466 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00cd20 con 0x7ff2840b6130 2023-12-22T08:40:53.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff6a9304640 1 --2- 172.21.15.31:0/18380527 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c00a8d0 0x7ff69c0d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff6a9304640 1 -- 172.21.15.31:0/18380527 >> 172.21.15.31:0/18380527 conn(0x7ff69c009db0 msgr2=0x7ff69c00a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2840b3d10 con 0x7ff2840b6130 2023-12-22T08:40:53.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2841db5c0 con 0x7ff2840b6130 2023-12-22T08:40:53.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff26bfff640 1 -- 172.21.15.31:0/3476849466 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c00f040 con 0x7ff2840b6130 2023-12-22T08:40:53.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff4467fc640 1 -- 172.21.15.31:0/1547988754 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4500bf480 con 0x7ff44803aab0 2023-12-22T08:40:53.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff438005250 con 0x7ff44803aab0 2023-12-22T08:40:53.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7ff6a9304640 1 -- 172.21.15.31:0/18380527 shutdown_connections 2023-12-22T08:40:53.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7ff6a9304640 1 -- 172.21.15.31:0/18380527 wait complete. 2023-12-22T08:40:53.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7fd84f010640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd848070f80 0x7fd848142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7fd84cdac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd848070f80 0x7fd848142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7fd84cdac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd848070f80 0x7fd848142950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54664/0 (socket says 172.21.15.31:54664) 2023-12-22T08:40:53.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7ff4467fc640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff43406a500 0x7ff43406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7fd84cdac640 1 -- 172.21.15.31:0/3467463455 learned_addr learned my addr 172.21.15.31:0/3467463455 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7fd84f010640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd8480b8cf0 0x7fd848143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.449+0000 7ff26bfff640 1 -- 172.21.15.31:0/3476849466 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c003b90 con 0x7ff2840b6130 2023-12-22T08:40:53.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7fd84f010640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd848147e30 0x7fd8480b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7fd847fff640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd8480b8cf0 0x7fd848143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481dc4a0 con 0x7fd848070f80 2023-12-22T08:40:53.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7f12bb7fe640 1 -- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 msgr2=0x7f12b415c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7f12bb7fe640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 0x7f12b415c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7f12bb7fe640 1 -- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 msgr2=0x7f12b40d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7f12bb7fe640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 0x7f12b40d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7fd84d5ad640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd848147e30 0x7fd8480b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.448+0000 7f12bb7fe640 1 -- 172.21.15.31:0/3869410996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a80094d0 con 0x7f12b4006f80 2023-12-22T08:40:53.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7f12c0b1b640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 0x7f12b415c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:53.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7f12bb7fe640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b4006f80 0x7f12b403dd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f12a8033000 tx=0x7f12a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481dc8c0 con 0x7fd848147e30 2023-12-22T08:40:53.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480b2a80 con 0x7fd8480b8cf0 2023-12-22T08:40:53.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.450+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff264005250 con 0x7ff2840b6130 2023-12-22T08:40:53.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7ff6a9304640 1 Processor -- start 2023-12-22T08:40:53.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7ff26bfff640 1 -- 172.21.15.31:0/3476849466 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff27c004030 con 0x7ff2840b6130 2023-12-22T08:40:53.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7ff4467fc640 1 -- 172.21.15.31:0/1547988754 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4500ba070 con 0x7ff44803aab0 2023-12-22T08:40:53.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7ff6a9304640 1 -- start start 2023-12-22T08:40:53.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7fd84cdac640 1 -- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd8480b8cf0 msgr2=0x7fd848143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7fd84cdac640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd8480b8cf0 0x7fd848143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7fd84cdac640 1 -- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd848147e30 msgr2=0x7fd8480b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7fd84cdac640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd848147e30 0x7fd8480b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7fd84cdac640 1 -- 172.21.15.31:0/3467463455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009b30 con 0x7fd848070f80 2023-12-22T08:40:53.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7ff26bfff640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff27006a500 0x7ff27006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.451+0000 7fd847fff640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd8480b8cf0 0x7fd848143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff26bfff640 1 -- 172.21.15.31:0/3476849466 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff27c088e90 con 0x7ff2840b6130 2023-12-22T08:40:53.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7fd84d5ad640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd848147e30 0x7fd8480b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:53.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff2837fe640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff27006a500 0x7ff27006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff455827640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff43406a500 0x7ff43406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7fd84cdac640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd848070f80 0x7fd848142950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd840009e50 tx=0x7fd840004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff2837fe640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff27006a500 0x7ff27006c9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff278036000 tx=0x7ff278008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff6a9304640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff69c007d60 0x7ff69c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff6a9304640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c00a8d0 0x7ff69c162da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff455827640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff43406a500 0x7ff43406c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00a8b0 tx=0x7ff44c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff6a3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff69c007d60 0x7ff69c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff6a3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff69c007d60 0x7ff69c0ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53550/0 (socket says 172.21.15.31:53550) 2023-12-22T08:40:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.452+0000 7ff6a37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c00a8d0 0x7ff69c162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.453+0000 7ff6a37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c00a8d0 0x7ff69c162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54668/0 (socket says 172.21.15.31:54668) 2023-12-22T08:40:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.453+0000 7ff6a3fff640 1 -- 172.21.15.31:0/1852417516 learned_addr learned my addr 172.21.15.31:0/1852417516 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.453+0000 7ff6a9304640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c0d2d00 0x7ff69c0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.453+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c1623b0 con 0x7ff69c00a8d0 2023-12-22T08:40:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.453+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c028300 con 0x7ff69c007d60 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.453+0000 7ff6a8b03640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c0d2d00 0x7ff69c0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.453+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0cd510 con 0x7ff69c0d2d00 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.454+0000 7ff6a3fff640 1 -- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c0d2d00 msgr2=0x7ff69c0c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.454+0000 7ff6a3fff640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c0d2d00 0x7ff69c0c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.454+0000 7ff6a3fff640 1 -- 172.21.15.31:0/1852417516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c00a8d0 msgr2=0x7ff69c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.454+0000 7ff6a3fff640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c00a8d0 0x7ff69c162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.454+0000 7ff6a3fff640 1 -- 172.21.15.31:0/1852417516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4072f90 con 0x7ff69c007d60 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.454+0000 7ff6a37fe640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c00a8d0 0x7ff69c162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.454+0000 7ff6a3fff640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff69c007d60 0x7ff69c0ccfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff69000c420 tx=0x7ff69000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.456+0000 7ff6a0ff9640 1 -- 172.21.15.31:0/1852417516 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900075a0 con 0x7ff69c007d60 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.456+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff698009400 con 0x7ff69c007d60 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.456+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c1632e0 con 0x7ff69c007d60 2023-12-22T08:40:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.456+0000 7ff6a0ff9640 1 -- 172.21.15.31:0/1852417516 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6900047e0 con 0x7ff69c007d60 2023-12-22T08:40:53.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.456+0000 7ff26bfff640 1 -- 172.21.15.31:0/3476849466 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff27c054520 con 0x7ff2840b6130 2023-12-22T08:40:53.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7fd8457fa640 1 -- 172.21.15.31:0/3467463455 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840009510 con 0x7fd848070f80 2023-12-22T08:40:53.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7fd8457fa640 1 -- 172.21.15.31:0/3467463455 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840007e10 con 0x7fd848070f80 2023-12-22T08:40:53.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7fd8457fa640 1 -- 172.21.15.31:0/3467463455 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840034a90 con 0x7fd848070f80 2023-12-22T08:40:53.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7f12b8ff9640 1 -- 172.21.15.31:0/3869410996 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a803ad70 con 0x7f12b4006f80 2023-12-22T08:40:53.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7f12b8ff9640 1 -- 172.21.15.31:0/3869410996 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a80443f0 con 0x7f12b4006f80 2023-12-22T08:40:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7f12b8ff9640 1 -- 172.21.15.31:0/3869410996 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8044780 con 0x7f12b4006f80 2023-12-22T08:40:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.458+0000 7f12c257e640 1 -- 172.21.15.31:0/3869410996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b40cb240 con 0x7f12b4006f80 2023-12-22T08:40:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.458+0000 7f12c257e640 1 -- 172.21.15.31:0/3869410996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b416e8d0 con 0x7f12b4006f80 2023-12-22T08:40:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480b27a0 con 0x7fd848070f80 2023-12-22T08:40:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.458+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8481dbde0 con 0x7fd848070f80 2023-12-22T08:40:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7ff6a0ff9640 1 -- 172.21.15.31:0/1852417516 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690004c10 con 0x7ff69c007d60 2023-12-22T08:40:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.457+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c0057d0 con 0x7ff69c007d60 2023-12-22T08:40:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.458+0000 7ff6a0ff9640 1 -- 172.21.15.31:0/1852417516 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6900133c0 con 0x7ff69c007d60 2023-12-22T08:40:53.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.458+0000 7ff6a0ff9640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff68806a430 0x7ff68806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.459+0000 7ff4467fc640 1 -- 172.21.15.31:0/1547988754 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff4500f0070 con 0x7ff44803aab0 2023-12-22T08:40:53.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.459+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd848073a40 con 0x7fd848070f80 2023-12-22T08:40:53.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.460+0000 7ff6a37fe640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff68806a430 0x7ff68806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.460+0000 7ff6a0ff9640 1 -- 172.21.15.31:0/1852417516 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff690057f80 con 0x7ff69c007d60 2023-12-22T08:40:53.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.461+0000 7fd8457fa640 1 -- 172.21.15.31:0/3467463455 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd840034bf0 con 0x7fd848070f80 2023-12-22T08:40:53.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.461+0000 7fd8457fa640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd83406e910 0x7fd834070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.462+0000 7fd8457fa640 1 -- 172.21.15.31:0/3467463455 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8400abeb0 con 0x7fd848070f80 2023-12-22T08:40:53.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.462+0000 7f12b8ff9640 1 -- 172.21.15.31:0/3869410996 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12a804d450 con 0x7f12b4006f80 2023-12-22T08:40:53.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.462+0000 7f12a67fc640 1 -- 172.21.15.31:0/3869410996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b4007830 con 0x7f12b4006f80 2023-12-22T08:40:53.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.462+0000 7fd847fff640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd83406e910 0x7fd834070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.462+0000 7f12b8ff9640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f12a006a500 0x7f12a006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:53.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.463+0000 7ff6a37fe640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff68806a430 0x7ff68806c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40693d0 tx=0x7ff6a408b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.463+0000 7f12b8ff9640 1 -- 172.21.15.31:0/3869410996 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12a80aaf50 con 0x7f12b4006f80 2023-12-22T08:40:53.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.463+0000 7f12bbfff640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f12a006a500 0x7f12a006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:53.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.463+0000 7fd847fff640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd83406e910 0x7fd834070dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd83c006fd0 tx=0x7fd83c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.464+0000 7f12bbfff640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f12a006a500 0x7f12a006c9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f12b000ac20 tx=0x7f12b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:53.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.465+0000 7ff6a0ff9640 1 -- 172.21.15.31:0/1852417516 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff690054350 con 0x7ff69c007d60 2023-12-22T08:40:53.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.470+0000 7fd8457fa640 1 -- 172.21.15.31:0/3467463455 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd840077630 con 0x7fd848070f80 2023-12-22T08:40:53.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.479+0000 7f12b8ff9640 1 -- 172.21.15.31:0/3869410996 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12a8076520 con 0x7f12b4006f80 2023-12-22T08:40:53.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.799+0000 7fb56514e640 1 -- 172.21.15.31:0/786754343 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb560073a40 con 0x7fb56006a530 2023-12-22T08:40:53.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.800+0000 7fb5477fe640 1 -- 172.21.15.31:0/786754343 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb558054440 con 0x7fb56006a530 2023-12-22T08:40:53.802 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-12-22T08:40:53.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 -- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb54c06a4f0 msgr2=0x7fb54c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb54c06a4f0 0x7fb54c06c9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb550039000 tx=0x7fb550008040 comp rx=0 tx=0).stop 2023-12-22T08:40:53.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 -- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb56006a530 msgr2=0x7fb5601e1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb56006a530 0x7fb5601e1710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb55800be20 tx=0x7fb558009f70 comp rx=0 tx=0).stop 2023-12-22T08:40:53.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 -- 172.21.15.31:0/786754343 shutdown_connections 2023-12-22T08:40:53.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb54c06a4f0 0x7fb54c06c9b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5600b6130 0x7fb5601e1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb56006a530 0x7fb5601e1710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 --2- 172.21.15.31:0/786754343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56006a150 0x7fb56013eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.803+0000 7fb5457fa640 1 -- 172.21.15.31:0/786754343 >> 172.21.15.31:0/786754343 conn(0x7fb5600bc120 msgr2=0x7fb5600b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.804+0000 7fb5457fa640 1 -- 172.21.15.31:0/786754343 shutdown_connections 2023-12-22T08:40:53.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.804+0000 7fb5457fa640 1 -- 172.21.15.31:0/786754343 wait complete. 2023-12-22T08:40:53.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.813+0000 7f6c4abae640 1 -- 172.21.15.31:0/3943530330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6c440b8c80 con 0x7f6c440b8810 2023-12-22T08:40:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.814+0000 7f6c3a7fc640 1 -- 172.21.15.31:0/3943530330 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c440b8c80 con 0x7f6c440b8810 2023-12-22T08:40:53.816 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:53.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.817+0000 7f6c27fff640 1 -- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c2806a500 msgr2=0x7f6c2806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.817+0000 7f6c27fff640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c2806a500 0x7f6c2806c9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c34003d90 tx=0x7f6c34009040 comp rx=0 tx=0).stop 2023-12-22T08:40:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.817+0000 7f6c27fff640 1 -- 172.21.15.31:0/3943530330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 msgr2=0x7f6c44150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.817+0000 7f6c27fff640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 0x7f6c44150030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c40032000 tx=0x7f6c400046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.818+0000 7f6c27fff640 1 -- 172.21.15.31:0/3943530330 shutdown_connections 2023-12-22T08:40:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.818+0000 7f6c27fff640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c2806a500 0x7f6c2806c9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.818+0000 7f6c27fff640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c44152da0 0x7f6c4413a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.818+0000 7f6c27fff640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c440b8810 0x7f6c44150030 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.818+0000 7f6c27fff640 1 --2- 172.21.15.31:0/3943530330 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c4406af80 0x7f6c44146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.818+0000 7f6c27fff640 1 -- 172.21.15.31:0/3943530330 >> 172.21.15.31:0/3943530330 conn(0x7f6c440b9100 msgr2=0x7f6c441416b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.818+0000 7f6c27fff640 1 -- 172.21.15.31:0/3943530330 shutdown_connections 2023-12-22T08:40:53.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.818+0000 7f6c27fff640 1 -- 172.21.15.31:0/3943530330 wait complete. 2023-12-22T08:40:53.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-12-22T08:40:53.823 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:53.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.831+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3948005500 con 0x7f39680a0cc0 2023-12-22T08:40:53.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.832+0000 7f394ffff640 1 -- 172.21.15.31:0/1309100226 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3958053890 con 0x7f39680a0cc0 2023-12-22T08:40:53.834 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:53.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-12-22T08:40:53.836 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.834+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f395406a580 msgr2=0x7f395406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.834+0000 7f396df39640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f395406a580 0x7f395406ca40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f395c006fd0 tx=0x7f395c008040 comp rx=0 tx=0).stop 2023-12-22T08:40:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.834+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39680a0cc0 msgr2=0x7f39680b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.834+0000 7f396df39640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39680a0cc0 0x7f39680b61f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f395800c940 tx=0x7f395800ce00 comp rx=0 tx=0).stop 2023-12-22T08:40:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.834+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 shutdown_connections 2023-12-22T08:40:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.835+0000 7f396df39640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f395406a580 0x7f395406ca40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.835+0000 7f396df39640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3968148a50 0x7f39680a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.835+0000 7f396df39640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3968142f20 0x7f39680b7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.835+0000 7f396df39640 1 --2- 172.21.15.31:0/1309100226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39680a0cc0 0x7f39680b61f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.835+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 >> 172.21.15.31:0/1309100226 conn(0x7f39680be1e0 msgr2=0x7f39680bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.835+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 shutdown_connections 2023-12-22T08:40:53.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.835+0000 7f396df39640 1 -- 172.21.15.31:0/1309100226 wait complete. 2023-12-22T08:40:53.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-12-22T08:40:53.850 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:53.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.851+0000 7f12a67fc640 1 -- 172.21.15.31:0/3869410996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12b40056b0 con 0x7f12b4006f80 2023-12-22T08:40:53.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.851+0000 7f12b8ff9640 1 -- 172.21.15.31:0/3869410996 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12a8035090 con 0x7f12b4006f80 2023-12-22T08:40:53.854 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:53.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 -- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f12a006a500 msgr2=0x7f12a006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f12a006a500 0x7f12a006c9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f12b000ac20 tx=0x7f12b0008040 comp rx=0 tx=0).stop 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 -- 172.21.15.31:0/3869410996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b4006f80 msgr2=0x7f12b403dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b4006f80 0x7f12b403dd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f12a8033000 tx=0x7f12a80046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 -- 172.21.15.31:0/3869410996 shutdown_connections 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f12a006a500 0x7f12a006c9c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f12b40cf320 0x7f12b415c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12b4006f80 0x7f12b403dd60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 --2- 172.21.15.31:0/3869410996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12b40049d0 0x7f12b40d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 -- 172.21.15.31:0/3869410996 >> 172.21.15.31:0/3869410996 conn(0x7f12b40061f0 msgr2=0x7f12b41619c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 -- 172.21.15.31:0/3869410996 shutdown_connections 2023-12-22T08:40:53.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.853+0000 7f12a67fc640 1 -- 172.21.15.31:0/3869410996 wait complete. 2023-12-22T08:40:53.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-12-22T08:40:53.866 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:53.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.864+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff438005500 con 0x7ff44803aab0 2023-12-22T08:40:53.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.865+0000 7ff4467fc640 1 -- 172.21.15.31:0/1547988754 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4500af090 con 0x7ff44803aab0 2023-12-22T08:40:53.867 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:53.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff43406a500 msgr2=0x7ff43406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff43406a500 0x7ff43406c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00a8b0 tx=0x7ff44c008040 comp rx=0 tx=0).stop 2023-12-22T08:40:53.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44803aab0 msgr2=0x7ff44801c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44803aab0 0x7ff44801c950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4500728a0 tx=0x7ff450072d40 comp rx=0 tx=0).stop 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 shutdown_connections 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff43406a500 0x7ff43406c9c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44803aab0 0x7ff44801c950 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff448006f80 0x7ff4480cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 --2- 172.21.15.31:0/1547988754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4480049d0 0x7ff44801dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 >> 172.21.15.31:0/1547988754 conn(0x7ff4480061f0 msgr2=0x7ff4480d44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 shutdown_connections 2023-12-22T08:40:53.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.868+0000 7ff456829640 1 -- 172.21.15.31:0/1547988754 wait complete. 2023-12-22T08:40:53.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.869+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff264005500 con 0x7ff2840b6130 2023-12-22T08:40:53.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.869+0000 7ff26bfff640 1 -- 172.21.15.31:0/3476849466 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff27c057b40 con 0x7ff2840b6130 2023-12-22T08:40:53.872 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-12-22T08:40:53.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff27006a500 msgr2=0x7ff27006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff27006a500 0x7ff27006c9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff278036000 tx=0x7ff278008030 comp rx=0 tx=0).stop 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2840b6130 msgr2=0x7ff284136060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2840b6130 0x7ff284136060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00efc0 tx=0x7ff27c00c490 comp rx=0 tx=0).stop 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 shutdown_connections 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff27006a500 0x7ff27006c9c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2840b6130 0x7ff284136060 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff28406a530 0x7ff2840b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 --2- 172.21.15.31:0/3476849466 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff28406a150 0x7ff28413eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.872+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 >> 172.21.15.31:0/3476849466 conn(0x7ff2840bc120 msgr2=0x7ff2841385b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.873+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 shutdown_connections 2023-12-22T08:40:53.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.873+0000 7ff28a1f1640 1 -- 172.21.15.31:0/3476849466 wait complete. 2023-12-22T08:40:53.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.876+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff69c0cd950 con 0x7ff69c007d60 2023-12-22T08:40:53.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.877+0000 7ff6a0ff9640 1 -- 172.21.15.31:0/1852417516 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6900544f0 con 0x7ff69c007d60 2023-12-22T08:40:53.879 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-12-22T08:40:53.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff68806a430 msgr2=0x7ff68806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff68806a430 0x7ff68806c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40693d0 tx=0x7ff6a408b040 comp rx=0 tx=0).stop 2023-12-22T08:40:53.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff69c007d60 msgr2=0x7ff69c0ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff69c007d60 0x7ff69c0ccfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff69000c420 tx=0x7ff69000c820 comp rx=0 tx=0).stop 2023-12-22T08:40:53.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 shutdown_connections 2023-12-22T08:40:53.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff68806a430 0x7ff68806c8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff69c0d2d00 0x7ff69c0c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff69c00a8d0 0x7ff69c162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 --2- 172.21.15.31:0/1852417516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff69c007d60 0x7ff69c0ccfd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 >> 172.21.15.31:0/1852417516 conn(0x7ff69c009db0 msgr2=0x7ff69c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.879+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 shutdown_connections 2023-12-22T08:40:53.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.880+0000 7ff6a9304640 1 -- 172.21.15.31:0/1852417516 wait complete. 2023-12-22T08:40:53.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-12-22T08:40:53.884 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:53.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.889+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd848069f20 con 0x7fd848070f80 2023-12-22T08:40:53.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.889+0000 7fd8457fa640 1 -- 172.21.15.31:0/3467463455 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd840043020 con 0x7fd848070f80 2023-12-22T08:40:53.892 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-12-22T08:40:53.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-12-22T08:40:53.893 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd83406e910 msgr2=0x7fd834070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd83406e910 0x7fd834070dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd83c006fd0 tx=0x7fd83c008040 comp rx=0 tx=0).stop 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd848070f80 msgr2=0x7fd848142950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd848070f80 0x7fd848142950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd840009e50 tx=0x7fd840004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 shutdown_connections 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd83406e910 0x7fd834070dd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd848147e30 0x7fd8480b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd8480b8cf0 0x7fd848143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 --2- 172.21.15.31:0/3467463455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd848070f80 0x7fd848142950 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:53.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 >> 172.21.15.31:0/3467463455 conn(0x7fd84806ae10 msgr2=0x7fd84806a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 shutdown_connections 2023-12-22T08:40:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:53.892+0000 7fd84f010640 1 -- 172.21.15.31:0/3467463455 wait complete. 2023-12-22T08:40:53.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-12-22T08:40:53.896 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:53.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-12-22T08:40:53.905 DEBUG:teuthology.parallel:result is None 2023-12-22T08:40:53.906 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-22T08:40:53.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:54.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.050+0000 7fcbba9d2640 1 Processor -- start 2023-12-22T08:40:54.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.050+0000 7fcbba9d2640 1 -- start start 2023-12-22T08:40:54.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.050+0000 7fcbba9d2640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcbb40ba550 0x7fcbb40b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.050+0000 7fcbba9d2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcbb40ba000 0x7fcbb41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.050+0000 7fcbba9d2640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb40bb310 con 0x7fcbb406a6d0 2023-12-22T08:40:54.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbba9d2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40bf960 con 0x7fcbb40ba000 2023-12-22T08:40:54.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbba9d2640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40bb5b0 con 0x7fcbb40ba550 2023-12-22T08:40:54.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbb8f6f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcbb40ba000 0x7fcbb41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbb8f6f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcbb40ba000 0x7fcbb41554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54684/0 (socket says 172.21.15.31:54684) 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbb8f6f640 1 -- 172.21.15.31:0/4186983055 learned_addr learned my addr 172.21.15.31:0/4186983055 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbb37fe640 1 --2- 172.21.15.31:0/4186983055 >> v2:172.21.15.69:3300/0 conn(0x7fcbb40ba550 0x7fcbb40b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbb8f6f640 1 -- 172.21.15.31:0/4186983055 >> v2:172.21.15.69:3300/0 conn(0x7fcbb40ba550 msgr2=0x7fcbb40b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbb8f6f640 1 --2- 172.21.15.31:0/4186983055 >> v2:172.21.15.69:3300/0 conn(0x7fcbb40ba550 0x7fcbb40b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbb8f6f640 1 -- 172.21.15.31:0/4186983055 >> v1:172.21.15.69:6789/0 conn(0x7fcbb406a6d0 legacy=0x7fcbb414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.051+0000 7fcbb8f6f640 1 -- 172.21.15.31:0/4186983055 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40c0120 con 0x7fcbb40ba000 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbb8f6f640 1 --2- 172.21.15.31:0/4186983055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb40ba000 0x7fcbb41554e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40bde10 tx=0x7fcbac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234533fc1b9ba252 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbb2ffd640 1 -- 172.21.15.31:0/4186983055 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac02ca80 con 0x7fcbb40ba000 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbb2ffd640 1 -- 172.21.15.31:0/4186983055 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac02cbe0 con 0x7fcbb40ba000 2023-12-22T08:40:54.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbb2ffd640 1 -- 172.21.15.31:0/4186983055 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0343f0 con 0x7fcbb40ba000 2023-12-22T08:40:54.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbba9d2640 1 -- 172.21.15.31:0/4186983055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb40ba000 msgr2=0x7fcbb41554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/4186983055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb40ba000 0x7fcbb41554e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40bde10 tx=0x7fcbac02bee0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbba9d2640 1 -- 172.21.15.31:0/4186983055 shutdown_connections 2023-12-22T08:40:54.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/4186983055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb40ba000 0x7fcbb41554e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/4186983055 >> v2:172.21.15.69:3300/0 conn(0x7fcbb40ba550 0x7fcbb40b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbba9d2640 1 -- 172.21.15.31:0/4186983055 >> 172.21.15.31:0/4186983055 conn(0x7fcbb40c0350 msgr2=0x7fcbb40c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.052+0000 7fcbba9d2640 1 -- 172.21.15.31:0/4186983055 shutdown_connections 2023-12-22T08:40:54.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.053+0000 7fcbba9d2640 1 -- 172.21.15.31:0/4186983055 wait complete. 2023-12-22T08:40:54.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.053+0000 7fcbba9d2640 1 Processor -- start 2023-12-22T08:40:54.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbba9d2640 1 -- start start 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbba9d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb406a6d0 0x7fcbb4147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbba9d2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbb40ba000 0x7fcbb4145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbba9d2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbb40ba550 0x7fcbb41dff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbba9d2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb41df8b0 con 0x7fcbb406a6d0 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbba9d2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4144c80 con 0x7fcbb40ba550 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbba9d2640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb414dff0 con 0x7fcbb40ba000 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbb3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb406a6d0 0x7fcbb4147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbb3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb406a6d0 0x7fcbb4147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54700/0 (socket says 172.21.15.31:54700) 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.054+0000 7fcbb3fff640 1 -- 172.21.15.31:0/2070903726 learned_addr learned my addr 172.21.15.31:0/2070903726 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb8f6f640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbb40ba550 0x7fcbb41dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb37fe640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbb40ba000 0x7fcbb4145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb3fff640 1 -- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbb40ba000 msgr2=0x7fcbb4145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb3fff640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbb40ba000 0x7fcbb4145160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb3fff640 1 -- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbb40ba550 msgr2=0x7fcbb41dff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb3fff640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbb40ba550 0x7fcbb41dff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb3fff640 1 -- 172.21.15.31:0/2070903726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009b30 con 0x7fcbb406a6d0 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb8f6f640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbb40ba550 0x7fcbb41dff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb37fe640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbb40ba000 0x7fcbb4145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb3fff640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb406a6d0 0x7fcbb4147230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c430 tx=0x7fcba800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb0ff9640 1 -- 172.21.15.31:0/2070903726 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8011790 con 0x7fcbb406a6d0 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb0ff9640 1 -- 172.21.15.31:0/2070903726 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba80118f0 con 0x7fcbb406a6d0 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb414e2d0 con 0x7fcbb406a6d0 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbb0ff9640 1 -- 172.21.15.31:0/2070903726 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8011ce0 con 0x7fcbb406a6d0 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.055+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb414e5b0 con 0x7fcbb406a6d0 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.056+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb4146870 con 0x7fcbb406a6d0 2023-12-22T08:40:54.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.057+0000 7fcbb0ff9640 1 -- 172.21.15.31:0/2070903726 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcba801c460 con 0x7fcbb406a6d0 2023-12-22T08:40:54.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.057+0000 7fcbb0ff9640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcba006a460 0x7fcba006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.057+0000 7fcbb0ff9640 1 -- 172.21.15.31:0/2070903726 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcba80888b0 con 0x7fcbb406a6d0 2023-12-22T08:40:54.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.057+0000 7fcbb37fe640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcba006a460 0x7fcba006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.058+0000 7fcbb37fe640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcba006a460 0x7fcba006c920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcba4006fd0 tx=0x7fcba4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.061+0000 7fcbb0ff9640 1 -- 172.21.15.31:0/2070903726 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcba8053e10 con 0x7fcbb406a6d0 2023-12-22T08:40:54.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.235+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbb414b3c0 con 0x7fcba006a460 2023-12-22T08:40:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.242+0000 7fcbb0ff9640 1 -- 172.21.15.31:0/2070903726 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7fcba4009550 con 0x7fcba006a460 2023-12-22T08:40:54.248 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:40:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcba006a460 msgr2=0x7fcba006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcba006a460 0x7fcba006c920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcba4006fd0 tx=0x7fcba4008040 comp rx=0 tx=0).stop 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb406a6d0 msgr2=0x7fcbb4147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb406a6d0 0x7fcbb4147230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c430 tx=0x7fcba800c8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 shutdown_connections 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcba006a460 0x7fcba006c920 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbb40ba550 0x7fcbb41dff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbb40ba000 0x7fcbb4145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 --2- 172.21.15.31:0/2070903726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbb406a6d0 0x7fcbb4147230 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 >> 172.21.15.31:0/2070903726 conn(0x7fcbb40c0350 msgr2=0x7fcbb40b7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 shutdown_connections 2023-12-22T08:40:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.245+0000 7fcbba9d2640 1 -- 172.21.15.31:0/2070903726 wait complete. 2023-12-22T08:40:54.259 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-22T08:40:53.784688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218440,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756280,"statfs":{"total":773094113280,"available":772870430720,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002104"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398792+0000","last_change":"2023-12-22T08:40:45.883952+0000","last_active":"2023-12-22T08:40:48.398792+0000","last_peered":"2023-12-22T08:40:48.398792+0000","last_clean":"2023-12-22T08:40:48.398792+0000","last_became_active":"2023-12-22T08:40:45.883513+0000","last_became_peered":"2023-12-22T08:40:45.883513+0000","last_unstale":"2023-12-22T08:40:48.398792+0000","last_undegraded":"2023-12-22T08:40:48.398792+0000","last_fullsized":"2023-12-22T08:40:48.398792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:30.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398236+0000","last_change":"2023-12-22T08:40:45.878775+0000","last_active":"2023-12-22T08:40:48.398236+0000","last_peered":"2023-12-22T08:40:48.398236+0000","last_clean":"2023-12-22T08:40:48.398236+0000","last_became_active":"2023-12-22T08:40:45.878528+0000","last_became_peered":"2023-12-22T08:40:45.878528+0000","last_unstale":"2023-12-22T08:40:48.398236+0000","last_undegraded":"2023-12-22T08:40:48.398236+0000","last_fullsized":"2023-12-22T08:40:48.398236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868312+0000","last_change":"2023-12-22T08:40:45.880293+0000","last_active":"2023-12-22T08:40:46.868312+0000","last_peered":"2023-12-22T08:40:46.868312+0000","last_clean":"2023-12-22T08:40:46.868312+0000","last_became_active":"2023-12-22T08:40:45.880038+0000","last_became_peered":"2023-12-22T08:40:45.880038+0000","last_unstale":"2023-12-22T08:40:46.868312+0000","last_undegraded":"2023-12-22T08:40:46.868312+0000","last_fullsized":"2023-12-22T08:40:46.868312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947206+0000","last_change":"2023-12-22T08:40:45.892847+0000","last_active":"2023-12-22T08:40:47.947206+0000","last_peered":"2023-12-22T08:40:47.947206+0000","last_clean":"2023-12-22T08:40:47.947206+0000","last_became_active":"2023-12-22T08:40:45.892443+0000","last_became_peered":"2023-12-22T08:40:45.892443+0000","last_unstale":"2023-12-22T08:40:47.947206+0000","last_undegraded":"2023-12-22T08:40:47.947206+0000","last_fullsized":"2023-12-22T08:40:47.947206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:33.421892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398449+0000","last_change":"2023-12-22T08:40:45.884154+0000","last_active":"2023-12-22T08:40:48.398449+0000","last_peered":"2023-12-22T08:40:48.398449+0000","last_clean":"2023-12-22T08:40:48.398449+0000","last_became_active":"2023-12-22T08:40:45.883879+0000","last_became_peered":"2023-12-22T08:40:45.883879+0000","last_unstale":"2023-12-22T08:40:48.398449+0000","last_undegraded":"2023-12-22T08:40:48.398449+0000","last_fullsized":"2023-12-22T08:40:48.398449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:30.540430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.946964+0000","last_change":"2023-12-22T08:40:45.889896+0000","last_active":"2023-12-22T08:40:47.946964+0000","last_peered":"2023-12-22T08:40:47.946964+0000","last_clean":"2023-12-22T08:40:47.946964+0000","last_became_active":"2023-12-22T08:40:45.888864+0000","last_became_peered":"2023-12-22T08:40:45.888864+0000","last_unstale":"2023-12-22T08:40:47.946964+0000","last_undegraded":"2023-12-22T08:40:47.946964+0000","last_fullsized":"2023-12-22T08:40:47.946964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398256+0000","last_change":"2023-12-22T08:40:45.881811+0000","last_active":"2023-12-22T08:40:48.398256+0000","last_peered":"2023-12-22T08:40:48.398256+0000","last_clean":"2023-12-22T08:40:48.398256+0000","last_became_active":"2023-12-22T08:40:45.881578+0000","last_became_peered":"2023-12-22T08:40:45.881578+0000","last_unstale":"2023-12-22T08:40:48.398256+0000","last_undegraded":"2023-12-22T08:40:48.398256+0000","last_fullsized":"2023-12-22T08:40:48.398256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:16.186426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868647+0000","last_change":"2023-12-22T08:40:45.892116+0000","last_active":"2023-12-22T08:40:46.868647+0000","last_peered":"2023-12-22T08:40:46.868647+0000","last_clean":"2023-12-22T08:40:46.868647+0000","last_became_active":"2023-12-22T08:40:45.891946+0000","last_became_peered":"2023-12-22T08:40:45.891946+0000","last_unstale":"2023-12-22T08:40:46.868647+0000","last_undegraded":"2023-12-22T08:40:46.868647+0000","last_fullsized":"2023-12-22T08:40:46.868647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398786+0000","last_change":"2023-12-22T08:40:45.890365+0000","last_active":"2023-12-22T08:40:48.398786+0000","last_peered":"2023-12-22T08:40:48.398786+0000","last_clean":"2023-12-22T08:40:48.398786+0000","last_became_active":"2023-12-22T08:40:45.890130+0000","last_became_peered":"2023-12-22T08:40:45.890130+0000","last_unstale":"2023-12-22T08:40:48.398786+0000","last_undegraded":"2023-12-22T08:40:48.398786+0000","last_fullsized":"2023-12-22T08:40:48.398786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:13.809967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975214+0000","last_change":"2023-12-22T08:40:45.889288+0000","last_active":"2023-12-22T08:40:47.975214+0000","last_peered":"2023-12-22T08:40:47.975214+0000","last_clean":"2023-12-22T08:40:47.975214+0000","last_became_active":"2023-12-22T08:40:45.889044+0000","last_became_peered":"2023-12-22T08:40:45.889044+0000","last_unstale":"2023-12-22T08:40:47.975214+0000","last_undegraded":"2023-12-22T08:40:47.975214+0000","last_fullsized":"2023-12-22T08:40:47.975214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975064+0000","last_change":"2023-12-22T08:40:45.890399+0000","last_active":"2023-12-22T08:40:47.975064+0000","last_peered":"2023-12-22T08:40:47.975064+0000","last_clean":"2023-12-22T08:40:47.975064+0000","last_became_active":"2023-12-22T08:40:45.890142+0000","last_became_peered":"2023-12-22T08:40:45.890142+0000","last_unstale":"2023-12-22T08:40:47.975064+0000","last_undegraded":"2023-12-22T08:40:47.975064+0000","last_fullsized":"2023-12-22T08:40:47.975064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869515+0000","last_change":"2023-12-22T08:40:45.877838+0000","last_active":"2023-12-22T08:40:46.869515+0000","last_peered":"2023-12-22T08:40:46.869515+0000","last_clean":"2023-12-22T08:40:46.869515+0000","last_became_active":"2023-12-22T08:40:45.877514+0000","last_became_peered":"2023-12-22T08:40:45.877514+0000","last_unstale":"2023-12-22T08:40:46.869515+0000","last_undegraded":"2023-12-22T08:40:46.869515+0000","last_fullsized":"2023-12-22T08:40:46.869515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:05.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868964+0000","last_change":"2023-12-22T08:40:45.891488+0000","last_active":"2023-12-22T08:40:46.868964+0000","last_peered":"2023-12-22T08:40:46.868964+0000","last_clean":"2023-12-22T08:40:46.868964+0000","last_became_active":"2023-12-22T08:40:45.891337+0000","last_became_peered":"2023-12-22T08:40:45.891337+0000","last_unstale":"2023-12-22T08:40:46.868964+0000","last_undegraded":"2023-12-22T08:40:46.868964+0000","last_fullsized":"2023-12-22T08:40:46.868964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868225+0000","last_change":"2023-12-22T08:40:45.878437+0000","last_active":"2023-12-22T08:40:46.868225+0000","last_peered":"2023-12-22T08:40:46.868225+0000","last_clean":"2023-12-22T08:40:46.868225+0000","last_became_active":"2023-12-22T08:40:45.878165+0000","last_became_peered":"2023-12-22T08:40:45.878165+0000","last_unstale":"2023-12-22T08:40:46.868225+0000","last_undegraded":"2023-12-22T08:40:46.868225+0000","last_fullsized":"2023-12-22T08:40:46.868225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398069+0000","last_change":"2023-12-22T08:40:45.878993+0000","last_active":"2023-12-22T08:40:48.398069+0000","last_peered":"2023-12-22T08:40:48.398069+0000","last_clean":"2023-12-22T08:40:48.398069+0000","last_became_active":"2023-12-22T08:40:45.878204+0000","last_became_peered":"2023-12-22T08:40:45.878204+0000","last_unstale":"2023-12-22T08:40:48.398069+0000","last_undegraded":"2023-12-22T08:40:48.398069+0000","last_fullsized":"2023-12-22T08:40:48.398069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.946898+0000","last_change":"2023-12-22T08:40:45.886532+0000","last_active":"2023-12-22T08:40:47.946898+0000","last_peered":"2023-12-22T08:40:47.946898+0000","last_clean":"2023-12-22T08:40:47.946898+0000","last_became_active":"2023-12-22T08:40:45.886207+0000","last_became_peered":"2023-12-22T08:40:45.886207+0000","last_unstale":"2023-12-22T08:40:47.946898+0000","last_undegraded":"2023-12-22T08:40:47.946898+0000","last_fullsized":"2023-12-22T08:40:47.946898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947576+0000","last_change":"2023-12-22T08:40:45.887660+0000","last_active":"2023-12-22T08:40:47.947576+0000","last_peered":"2023-12-22T08:40:47.947576+0000","last_clean":"2023-12-22T08:40:47.947576+0000","last_became_active":"2023-12-22T08:40:45.887406+0000","last_became_peered":"2023-12-22T08:40:45.887406+0000","last_unstale":"2023-12-22T08:40:47.947576+0000","last_undegraded":"2023-12-22T08:40:47.947576+0000","last_fullsized":"2023-12-22T08:40:47.947576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397941+0000","last_change":"2023-12-22T08:40:45.887556+0000","last_active":"2023-12-22T08:40:48.397941+0000","last_peered":"2023-12-22T08:40:48.397941+0000","last_clean":"2023-12-22T08:40:48.397941+0000","last_became_active":"2023-12-22T08:40:45.887294+0000","last_became_peered":"2023-12-22T08:40:45.887294+0000","last_unstale":"2023-12-22T08:40:48.397941+0000","last_undegraded":"2023-12-22T08:40:48.397941+0000","last_fullsized":"2023-12-22T08:40:48.397941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:45.489511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398722+0000","last_change":"2023-12-22T08:40:45.883598+0000","last_active":"2023-12-22T08:40:48.398722+0000","last_peered":"2023-12-22T08:40:48.398722+0000","last_clean":"2023-12-22T08:40:48.398722+0000","last_became_active":"2023-12-22T08:40:45.883319+0000","last_became_peered":"2023-12-22T08:40:45.883319+0000","last_unstale":"2023-12-22T08:40:48.398722+0000","last_undegraded":"2023-12-22T08:40:48.398722+0000","last_fullsized":"2023-12-22T08:40:48.398722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:33.421892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975025+0000","last_change":"2023-12-22T08:40:45.881672+0000","last_active":"2023-12-22T08:40:47.975025+0000","last_peered":"2023-12-22T08:40:47.975025+0000","last_clean":"2023-12-22T08:40:47.975025+0000","last_became_active":"2023-12-22T08:40:45.881403+0000","last_became_peered":"2023-12-22T08:40:45.881403+0000","last_unstale":"2023-12-22T08:40:47.975025+0000","last_undegraded":"2023-12-22T08:40:47.975025+0000","last_fullsized":"2023-12-22T08:40:47.975025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868566+0000","last_change":"2023-12-22T08:40:45.875815+0000","last_active":"2023-12-22T08:40:46.868566+0000","last_peered":"2023-12-22T08:40:46.868566+0000","last_clean":"2023-12-22T08:40:46.868566+0000","last_became_active":"2023-12-22T08:40:45.875552+0000","last_became_peered":"2023-12-22T08:40:45.875552+0000","last_unstale":"2023-12-22T08:40:46.868566+0000","last_undegraded":"2023-12-22T08:40:46.868566+0000","last_fullsized":"2023-12-22T08:40:46.868566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947204+0000","last_change":"2023-12-22T08:40:45.889509+0000","last_active":"2023-12-22T08:40:47.947204+0000","last_peered":"2023-12-22T08:40:47.947204+0000","last_clean":"2023-12-22T08:40:47.947204+0000","last_became_active":"2023-12-22T08:40:45.889147+0000","last_became_peered":"2023-12-22T08:40:45.889147+0000","last_unstale":"2023-12-22T08:40:47.947204+0000","last_undegraded":"2023-12-22T08:40:47.947204+0000","last_fullsized":"2023-12-22T08:40:47.947204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868668+0000","last_change":"2023-12-22T08:40:45.888792+0000","last_active":"2023-12-22T08:40:46.868668+0000","last_peered":"2023-12-22T08:40:46.868668+0000","last_clean":"2023-12-22T08:40:46.868668+0000","last_became_active":"2023-12-22T08:40:45.888190+0000","last_became_peered":"2023-12-22T08:40:45.888190+0000","last_unstale":"2023-12-22T08:40:46.868668+0000","last_undegraded":"2023-12-22T08:40:46.868668+0000","last_fullsized":"2023-12-22T08:40:46.868668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:14:22.484265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947028+0000","last_change":"2023-12-22T08:40:45.893300+0000","last_active":"2023-12-22T08:40:47.947028+0000","last_peered":"2023-12-22T08:40:47.947028+0000","last_clean":"2023-12-22T08:40:47.947028+0000","last_became_active":"2023-12-22T08:40:45.892789+0000","last_became_peered":"2023-12-22T08:40:45.892789+0000","last_unstale":"2023-12-22T08:40:47.947028+0000","last_undegraded":"2023-12-22T08:40:47.947028+0000","last_fullsized":"2023-12-22T08:40:47.947028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:30.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869172+0000","last_change":"2023-12-22T08:40:45.888716+0000","last_active":"2023-12-22T08:40:46.869172+0000","last_peered":"2023-12-22T08:40:46.869172+0000","last_clean":"2023-12-22T08:40:46.869172+0000","last_became_active":"2023-12-22T08:40:45.888164+0000","last_became_peered":"2023-12-22T08:40:45.888164+0000","last_unstale":"2023-12-22T08:40:46.869172+0000","last_undegraded":"2023-12-22T08:40:46.869172+0000","last_fullsized":"2023-12-22T08:40:46.869172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975264+0000","last_change":"2023-12-22T08:40:45.875528+0000","last_active":"2023-12-22T08:40:47.975264+0000","last_peered":"2023-12-22T08:40:47.975264+0000","last_clean":"2023-12-22T08:40:47.975264+0000","last_became_active":"2023-12-22T08:40:45.875275+0000","last_became_peered":"2023-12-22T08:40:45.875275+0000","last_unstale":"2023-12-22T08:40:47.975264+0000","last_undegraded":"2023-12-22T08:40:47.975264+0000","last_fullsized":"2023-12-22T08:40:47.975264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398211+0000","last_change":"2023-12-22T08:40:45.884223+0000","last_active":"2023-12-22T08:40:48.398211+0000","last_peered":"2023-12-22T08:40:48.398211+0000","last_clean":"2023-12-22T08:40:48.398211+0000","last_became_active":"2023-12-22T08:40:45.883970+0000","last_became_peered":"2023-12-22T08:40:45.883970+0000","last_unstale":"2023-12-22T08:40:48.398211+0000","last_undegraded":"2023-12-22T08:40:48.398211+0000","last_fullsized":"2023-12-22T08:40:48.398211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868912+0000","last_change":"2023-12-22T08:40:45.882599+0000","last_active":"2023-12-22T08:40:46.868912+0000","last_peered":"2023-12-22T08:40:46.868912+0000","last_clean":"2023-12-22T08:40:46.868912+0000","last_became_active":"2023-12-22T08:40:45.882327+0000","last_became_peered":"2023-12-22T08:40:45.882327+0000","last_unstale":"2023-12-22T08:40:46.868912+0000","last_undegraded":"2023-12-22T08:40:46.868912+0000","last_fullsized":"2023-12-22T08:40:46.868912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868649+0000","last_change":"2023-12-22T08:40:45.889519+0000","last_active":"2023-12-22T08:40:46.868649+0000","last_peered":"2023-12-22T08:40:46.868649+0000","last_clean":"2023-12-22T08:40:46.868649+0000","last_became_active":"2023-12-22T08:40:45.889215+0000","last_became_peered":"2023-12-22T08:40:45.889215+0000","last_unstale":"2023-12-22T08:40:46.868649+0000","last_undegraded":"2023-12-22T08:40:46.868649+0000","last_fullsized":"2023-12-22T08:40:46.868649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947237+0000","last_change":"2023-12-22T08:40:45.893059+0000","last_active":"2023-12-22T08:40:47.947237+0000","last_peered":"2023-12-22T08:40:47.947237+0000","last_clean":"2023-12-22T08:40:47.947237+0000","last_became_active":"2023-12-22T08:40:45.892669+0000","last_became_peered":"2023-12-22T08:40:45.892669+0000","last_unstale":"2023-12-22T08:40:47.947237+0000","last_undegraded":"2023-12-22T08:40:47.947237+0000","last_fullsized":"2023-12-22T08:40:47.947237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:13.809967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397775+0000","last_change":"2023-12-22T08:40:45.889241+0000","last_active":"2023-12-22T08:40:48.397775+0000","last_peered":"2023-12-22T08:40:48.397775+0000","last_clean":"2023-12-22T08:40:48.397775+0000","last_became_active":"2023-12-22T08:40:45.888986+0000","last_became_peered":"2023-12-22T08:40:45.888986+0000","last_unstale":"2023-12-22T08:40:48.397775+0000","last_undegraded":"2023-12-22T08:40:48.397775+0000","last_fullsized":"2023-12-22T08:40:48.397775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:05.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974913+0000","last_change":"2023-12-22T08:40:45.881924+0000","last_active":"2023-12-22T08:40:47.974913+0000","last_peered":"2023-12-22T08:40:47.974913+0000","last_clean":"2023-12-22T08:40:47.974913+0000","last_became_active":"2023-12-22T08:40:45.880927+0000","last_became_peered":"2023-12-22T08:40:45.880927+0000","last_unstale":"2023-12-22T08:40:47.974913+0000","last_undegraded":"2023-12-22T08:40:47.974913+0000","last_fullsized":"2023-12-22T08:40:47.974913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868974+0000","last_change":"2023-12-22T08:40:45.878836+0000","last_active":"2023-12-22T08:40:46.868974+0000","last_peered":"2023-12-22T08:40:46.868974+0000","last_clean":"2023-12-22T08:40:46.868974+0000","last_became_active":"2023-12-22T08:40:45.878561+0000","last_became_peered":"2023-12-22T08:40:45.878561+0000","last_unstale":"2023-12-22T08:40:46.868974+0000","last_undegraded":"2023-12-22T08:40:46.868974+0000","last_fullsized":"2023-12-22T08:40:46.868974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:26.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869042+0000","last_change":"2023-12-22T08:40:45.512780+0000","last_active":"2023-12-22T08:40:46.869042+0000","last_peered":"2023-12-22T08:40:46.869042+0000","last_clean":"2023-12-22T08:40:46.869042+0000","last_became_active":"2023-12-22T08:40:45.512502+0000","last_became_peered":"2023-12-22T08:40:45.512502+0000","last_unstale":"2023-12-22T08:40:46.869042+0000","last_undegraded":"2023-12-22T08:40:46.869042+0000","last_fullsized":"2023-12-22T08:40:46.869042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:27.751410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868831+0000","last_change":"2023-12-22T08:40:45.876753+0000","last_active":"2023-12-22T08:40:46.868831+0000","last_peered":"2023-12-22T08:40:46.868831+0000","last_clean":"2023-12-22T08:40:46.868831+0000","last_became_active":"2023-12-22T08:40:45.876192+0000","last_became_peered":"2023-12-22T08:40:45.876192+0000","last_unstale":"2023-12-22T08:40:46.868831+0000","last_undegraded":"2023-12-22T08:40:46.868831+0000","last_fullsized":"2023-12-22T08:40:46.868831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974998+0000","last_change":"2023-12-22T08:40:45.509309+0000","last_active":"2023-12-22T08:40:47.974998+0000","last_peered":"2023-12-22T08:40:47.974998+0000","last_clean":"2023-12-22T08:40:47.974998+0000","last_became_active":"2023-12-22T08:40:45.508805+0000","last_became_peered":"2023-12-22T08:40:45.508805+0000","last_unstale":"2023-12-22T08:40:47.974998+0000","last_undegraded":"2023-12-22T08:40:47.974998+0000","last_fullsized":"2023-12-22T08:40:47.974998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868799+0000","last_change":"2023-12-22T08:40:45.511261+0000","last_active":"2023-12-22T08:40:46.868799+0000","last_peered":"2023-12-22T08:40:46.868799+0000","last_clean":"2023-12-22T08:40:46.868799+0000","last_became_active":"2023-12-22T08:40:45.510991+0000","last_became_peered":"2023-12-22T08:40:45.510991+0000","last_unstale":"2023-12-22T08:40:46.868799+0000","last_undegraded":"2023-12-22T08:40:46.868799+0000","last_fullsized":"2023-12-22T08:40:46.868799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868743+0000","last_change":"2023-12-22T08:40:45.885554+0000","last_active":"2023-12-22T08:40:46.868743+0000","last_peered":"2023-12-22T08:40:46.868743+0000","last_clean":"2023-12-22T08:40:46.868743+0000","last_became_active":"2023-12-22T08:40:45.885316+0000","last_became_peered":"2023-12-22T08:40:45.885316+0000","last_unstale":"2023-12-22T08:40:46.868743+0000","last_undegraded":"2023-12-22T08:40:46.868743+0000","last_fullsized":"2023-12-22T08:40:46.868743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947033+0000","last_change":"2023-12-22T08:40:45.504497+0000","last_active":"2023-12-22T08:40:47.947033+0000","last_peered":"2023-12-22T08:40:47.947033+0000","last_clean":"2023-12-22T08:40:47.947033+0000","last_became_active":"2023-12-22T08:40:45.504227+0000","last_became_peered":"2023-12-22T08:40:45.504227+0000","last_unstale":"2023-12-22T08:40:47.947033+0000","last_undegraded":"2023-12-22T08:40:47.947033+0000","last_fullsized":"2023-12-22T08:40:47.947033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397985+0000","last_change":"2023-12-22T08:40:45.884410+0000","last_active":"2023-12-22T08:40:48.397985+0000","last_peered":"2023-12-22T08:40:48.397985+0000","last_clean":"2023-12-22T08:40:48.397985+0000","last_became_active":"2023-12-22T08:40:45.884074+0000","last_became_peered":"2023-12-22T08:40:45.884074+0000","last_unstale":"2023-12-22T08:40:48.397985+0000","last_undegraded":"2023-12-22T08:40:48.397985+0000","last_fullsized":"2023-12-22T08:40:48.397985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975082+0000","last_change":"2023-12-22T08:40:45.511242+0000","last_active":"2023-12-22T08:40:47.975082+0000","last_peered":"2023-12-22T08:40:47.975082+0000","last_clean":"2023-12-22T08:40:47.975082+0000","last_became_active":"2023-12-22T08:40:45.510960+0000","last_became_peered":"2023-12-22T08:40:45.510960+0000","last_unstale":"2023-12-22T08:40:47.975082+0000","last_undegraded":"2023-12-22T08:40:47.975082+0000","last_fullsized":"2023-12-22T08:40:47.975082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947286+0000","last_change":"2023-12-22T08:40:45.888628+0000","last_active":"2023-12-22T08:40:47.947286+0000","last_peered":"2023-12-22T08:40:47.947286+0000","last_clean":"2023-12-22T08:40:47.947286+0000","last_became_active":"2023-12-22T08:40:45.888351+0000","last_became_peered":"2023-12-22T08:40:45.888351+0000","last_unstale":"2023-12-22T08:40:47.947286+0000","last_undegraded":"2023-12-22T08:40:47.947286+0000","last_fullsized":"2023-12-22T08:40:47.947286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:16.186426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947394+0000","last_change":"2023-12-22T08:40:45.507232+0000","last_active":"2023-12-22T08:40:47.947394+0000","last_peered":"2023-12-22T08:40:47.947394+0000","last_clean":"2023-12-22T08:40:47.947394+0000","last_became_active":"2023-12-22T08:40:45.506953+0000","last_became_peered":"2023-12-22T08:40:45.506953+0000","last_unstale":"2023-12-22T08:40:47.947394+0000","last_undegraded":"2023-12-22T08:40:47.947394+0000","last_fullsized":"2023-12-22T08:40:47.947394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868557+0000","last_change":"2023-12-22T08:40:45.890659+0000","last_active":"2023-12-22T08:40:46.868557+0000","last_peered":"2023-12-22T08:40:46.868557+0000","last_clean":"2023-12-22T08:40:46.868557+0000","last_became_active":"2023-12-22T08:40:45.889673+0000","last_became_peered":"2023-12-22T08:40:45.889673+0000","last_unstale":"2023-12-22T08:40:46.868557+0000","last_undegraded":"2023-12-22T08:40:46.868557+0000","last_fullsized":"2023-12-22T08:40:46.868557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398207+0000","last_change":"2023-12-22T08:40:45.507641+0000","last_active":"2023-12-22T08:40:48.398207+0000","last_peered":"2023-12-22T08:40:48.398207+0000","last_clean":"2023-12-22T08:40:48.398207+0000","last_became_active":"2023-12-22T08:40:45.507322+0000","last_became_peered":"2023-12-22T08:40:45.507322+0000","last_unstale":"2023-12-22T08:40:48.398207+0000","last_undegraded":"2023-12-22T08:40:48.398207+0000","last_fullsized":"2023-12-22T08:40:48.398207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:25.292485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869520+0000","last_change":"2023-12-22T08:40:45.877133+0000","last_active":"2023-12-22T08:40:46.869520+0000","last_peered":"2023-12-22T08:40:46.869520+0000","last_clean":"2023-12-22T08:40:46.869520+0000","last_became_active":"2023-12-22T08:40:45.876811+0000","last_became_peered":"2023-12-22T08:40:45.876811+0000","last_unstale":"2023-12-22T08:40:46.869520+0000","last_undegraded":"2023-12-22T08:40:46.869520+0000","last_fullsized":"2023-12-22T08:40:46.869520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:45.181460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975130+0000","last_change":"2023-12-22T08:40:45.515520+0000","last_active":"2023-12-22T08:40:47.975130+0000","last_peered":"2023-12-22T08:40:47.975130+0000","last_clean":"2023-12-22T08:40:47.975130+0000","last_became_active":"2023-12-22T08:40:45.515191+0000","last_became_peered":"2023-12-22T08:40:45.515191+0000","last_unstale":"2023-12-22T08:40:47.975130+0000","last_undegraded":"2023-12-22T08:40:47.975130+0000","last_fullsized":"2023-12-22T08:40:47.975130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398510+0000","last_change":"2023-12-22T08:40:45.884908+0000","last_active":"2023-12-22T08:40:48.398510+0000","last_peered":"2023-12-22T08:40:48.398510+0000","last_clean":"2023-12-22T08:40:48.398510+0000","last_became_active":"2023-12-22T08:40:45.884670+0000","last_became_peered":"2023-12-22T08:40:45.884670+0000","last_unstale":"2023-12-22T08:40:48.398510+0000","last_undegraded":"2023-12-22T08:40:48.398510+0000","last_fullsized":"2023-12-22T08:40:48.398510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:17.567380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868744+0000","last_change":"2023-12-22T08:40:45.509332+0000","last_active":"2023-12-22T08:40:46.868744+0000","last_peered":"2023-12-22T08:40:46.868744+0000","last_clean":"2023-12-22T08:40:46.868744+0000","last_became_active":"2023-12-22T08:40:45.509052+0000","last_became_peered":"2023-12-22T08:40:45.509052+0000","last_unstale":"2023-12-22T08:40:46.868744+0000","last_undegraded":"2023-12-22T08:40:46.868744+0000","last_fullsized":"2023-12-22T08:40:46.868744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:27.751410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868335+0000","last_change":"2023-12-22T08:40:45.875255+0000","last_active":"2023-12-22T08:40:46.868335+0000","last_peered":"2023-12-22T08:40:46.868335+0000","last_clean":"2023-12-22T08:40:46.868335+0000","last_became_active":"2023-12-22T08:40:45.875014+0000","last_became_peered":"2023-12-22T08:40:45.875014+0000","last_unstale":"2023-12-22T08:40:46.868335+0000","last_undegraded":"2023-12-22T08:40:46.868335+0000","last_fullsized":"2023-12-22T08:40:46.868335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947312+0000","last_change":"2023-12-22T08:40:45.513554+0000","last_active":"2023-12-22T08:40:47.947312+0000","last_peered":"2023-12-22T08:40:47.947312+0000","last_clean":"2023-12-22T08:40:47.947312+0000","last_became_active":"2023-12-22T08:40:45.513255+0000","last_became_peered":"2023-12-22T08:40:45.513255+0000","last_unstale":"2023-12-22T08:40:47.947312+0000","last_undegraded":"2023-12-22T08:40:47.947312+0000","last_fullsized":"2023-12-22T08:40:47.947312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398497+0000","last_change":"2023-12-22T08:40:45.886788+0000","last_active":"2023-12-22T08:40:48.398497+0000","last_peered":"2023-12-22T08:40:48.398497+0000","last_clean":"2023-12-22T08:40:48.398497+0000","last_became_active":"2023-12-22T08:40:45.886544+0000","last_became_peered":"2023-12-22T08:40:45.886544+0000","last_unstale":"2023-12-22T08:40:48.398497+0000","last_undegraded":"2023-12-22T08:40:48.398497+0000","last_fullsized":"2023-12-22T08:40:48.398497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974941+0000","last_change":"2023-12-22T08:40:45.508706+0000","last_active":"2023-12-22T08:40:47.974941+0000","last_peered":"2023-12-22T08:40:47.974941+0000","last_clean":"2023-12-22T08:40:47.974941+0000","last_became_active":"2023-12-22T08:40:45.508419+0000","last_became_peered":"2023-12-22T08:40:45.508419+0000","last_unstale":"2023-12-22T08:40:47.974941+0000","last_undegraded":"2023-12-22T08:40:47.974941+0000","last_fullsized":"2023-12-22T08:40:47.974941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974937+0000","last_change":"2023-12-22T08:40:45.881751+0000","last_active":"2023-12-22T08:40:47.974937+0000","last_peered":"2023-12-22T08:40:47.974937+0000","last_clean":"2023-12-22T08:40:47.974937+0000","last_became_active":"2023-12-22T08:40:45.881474+0000","last_became_peered":"2023-12-22T08:40:45.881474+0000","last_unstale":"2023-12-22T08:40:47.974937+0000","last_undegraded":"2023-12-22T08:40:47.974937+0000","last_fullsized":"2023-12-22T08:40:47.974937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397769+0000","last_change":"2023-12-22T08:40:45.505971+0000","last_active":"2023-12-22T08:40:48.397769+0000","last_peered":"2023-12-22T08:40:48.397769+0000","last_clean":"2023-12-22T08:40:48.397769+0000","last_became_active":"2023-12-22T08:40:45.505672+0000","last_became_peered":"2023-12-22T08:40:45.505672+0000","last_unstale":"2023-12-22T08:40:48.397769+0000","last_undegraded":"2023-12-22T08:40:48.397769+0000","last_fullsized":"2023-12-22T08:40:48.397769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398260+0000","last_change":"2023-12-22T08:40:45.879566+0000","last_active":"2023-12-22T08:40:48.398260+0000","last_peered":"2023-12-22T08:40:48.398260+0000","last_clean":"2023-12-22T08:40:48.398260+0000","last_became_active":"2023-12-22T08:40:45.879319+0000","last_became_peered":"2023-12-22T08:40:45.879319+0000","last_unstale":"2023-12-22T08:40:48.398260+0000","last_undegraded":"2023-12-22T08:40:48.398260+0000","last_fullsized":"2023-12-22T08:40:48.398260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:41:59.148169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869645+0000","last_change":"2023-12-22T08:40:45.511686+0000","last_active":"2023-12-22T08:40:46.869645+0000","last_peered":"2023-12-22T08:40:46.869645+0000","last_clean":"2023-12-22T08:40:46.869645+0000","last_became_active":"2023-12-22T08:40:45.511341+0000","last_became_peered":"2023-12-22T08:40:45.511341+0000","last_unstale":"2023-12-22T08:40:46.869645+0000","last_undegraded":"2023-12-22T08:40:46.869645+0000","last_fullsized":"2023-12-22T08:40:46.869645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:34:01.717358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398720+0000","last_change":"2023-12-22T08:40:45.882380+0000","last_active":"2023-12-22T08:40:48.398720+0000","last_peered":"2023-12-22T08:40:48.398720+0000","last_clean":"2023-12-22T08:40:48.398720+0000","last_became_active":"2023-12-22T08:40:45.882119+0000","last_became_peered":"2023-12-22T08:40:45.882119+0000","last_unstale":"2023-12-22T08:40:48.398720+0000","last_undegraded":"2023-12-22T08:40:48.398720+0000","last_fullsized":"2023-12-22T08:40:48.398720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398030+0000","last_change":"2023-12-22T08:40:45.513658+0000","last_active":"2023-12-22T08:40:48.398030+0000","last_peered":"2023-12-22T08:40:48.398030+0000","last_clean":"2023-12-22T08:40:48.398030+0000","last_became_active":"2023-12-22T08:40:45.513339+0000","last_became_peered":"2023-12-22T08:40:45.513339+0000","last_unstale":"2023-12-22T08:40:48.398030+0000","last_undegraded":"2023-12-22T08:40:48.398030+0000","last_fullsized":"2023-12-22T08:40:48.398030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398866+0000","last_change":"2023-12-22T08:40:45.885859+0000","last_active":"2023-12-22T08:40:48.398866+0000","last_peered":"2023-12-22T08:40:48.398866+0000","last_clean":"2023-12-22T08:40:48.398866+0000","last_became_active":"2023-12-22T08:40:45.885570+0000","last_became_peered":"2023-12-22T08:40:45.885570+0000","last_unstale":"2023-12-22T08:40:48.398866+0000","last_undegraded":"2023-12-22T08:40:48.398866+0000","last_fullsized":"2023-12-22T08:40:48.398866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398284+0000","last_change":"2023-12-22T08:40:45.505894+0000","last_active":"2023-12-22T08:40:48.398284+0000","last_peered":"2023-12-22T08:40:48.398284+0000","last_clean":"2023-12-22T08:40:48.398284+0000","last_became_active":"2023-12-22T08:40:45.505632+0000","last_became_peered":"2023-12-22T08:40:45.505632+0000","last_unstale":"2023-12-22T08:40:48.398284+0000","last_undegraded":"2023-12-22T08:40:48.398284+0000","last_fullsized":"2023-12-22T08:40:48.398284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947422+0000","last_change":"2023-12-22T08:40:45.892678+0000","last_active":"2023-12-22T08:40:47.947422+0000","last_peered":"2023-12-22T08:40:47.947422+0000","last_clean":"2023-12-22T08:40:47.947422+0000","last_became_active":"2023-12-22T08:40:45.892124+0000","last_became_peered":"2023-12-22T08:40:45.892124+0000","last_unstale":"2023-12-22T08:40:47.947422+0000","last_undegraded":"2023-12-22T08:40:47.947422+0000","last_fullsized":"2023-12-22T08:40:47.947422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:30.540430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398091+0000","last_change":"2023-12-22T08:40:45.508702+0000","last_active":"2023-12-22T08:40:48.398091+0000","last_peered":"2023-12-22T08:40:48.398091+0000","last_clean":"2023-12-22T08:40:48.398091+0000","last_became_active":"2023-12-22T08:40:45.508363+0000","last_became_peered":"2023-12-22T08:40:45.508363+0000","last_unstale":"2023-12-22T08:40:48.398091+0000","last_undegraded":"2023-12-22T08:40:48.398091+0000","last_fullsized":"2023-12-22T08:40:48.398091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398572+0000","last_change":"2023-12-22T08:40:45.891244+0000","last_active":"2023-12-22T08:40:48.398572+0000","last_peered":"2023-12-22T08:40:48.398572+0000","last_clean":"2023-12-22T08:40:48.398572+0000","last_became_active":"2023-12-22T08:40:45.890987+0000","last_became_peered":"2023-12-22T08:40:45.890987+0000","last_unstale":"2023-12-22T08:40:48.398572+0000","last_undegraded":"2023-12-22T08:40:48.398572+0000","last_fullsized":"2023-12-22T08:40:48.398572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:57.963627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:40:45.872970+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:40:45.872970+0000","last_peered":"2023-12-22T08:40:45.872970+0000","last_clean":"2023-12-22T08:40:45.872970+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:40:45.872970+0000","last_undegraded":"2023-12-22T08:40:45.872970+0000","last_fullsized":"2023-12-22T08:40:45.872970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947033+0000","last_change":"2023-12-22T08:40:45.502151+0000","last_active":"2023-12-22T08:40:47.947033+0000","last_peered":"2023-12-22T08:40:47.947033+0000","last_clean":"2023-12-22T08:40:47.947033+0000","last_became_active":"2023-12-22T08:40:45.501868+0000","last_became_peered":"2023-12-22T08:40:45.501868+0000","last_unstale":"2023-12-22T08:40:47.947033+0000","last_undegraded":"2023-12-22T08:40:47.947033+0000","last_fullsized":"2023-12-22T08:40:47.947033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868537+0000","last_change":"2023-12-22T08:40:45.892243+0000","last_active":"2023-12-22T08:40:46.868537+0000","last_peered":"2023-12-22T08:40:46.868537+0000","last_clean":"2023-12-22T08:40:46.868537+0000","last_became_active":"2023-12-22T08:40:45.892042+0000","last_became_peered":"2023-12-22T08:40:45.892042+0000","last_unstale":"2023-12-22T08:40:46.868537+0000","last_undegraded":"2023-12-22T08:40:46.868537+0000","last_fullsized":"2023-12-22T08:40:46.868537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398193+0000","last_change":"2023-12-22T08:40:45.508515+0000","last_active":"2023-12-22T08:40:48.398193+0000","last_peered":"2023-12-22T08:40:48.398193+0000","last_clean":"2023-12-22T08:40:48.398193+0000","last_became_active":"2023-12-22T08:40:45.508155+0000","last_became_peered":"2023-12-22T08:40:45.508155+0000","last_unstale":"2023-12-22T08:40:48.398193+0000","last_undegraded":"2023-12-22T08:40:48.398193+0000","last_fullsized":"2023-12-22T08:40:48.398193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868150+0000","last_change":"2023-12-22T08:40:45.875984+0000","last_active":"2023-12-22T08:40:46.868150+0000","last_peered":"2023-12-22T08:40:46.868150+0000","last_clean":"2023-12-22T08:40:46.868150+0000","last_became_active":"2023-12-22T08:40:45.875646+0000","last_became_peered":"2023-12-22T08:40:45.875646+0000","last_unstale":"2023-12-22T08:40:46.868150+0000","last_undegraded":"2023-12-22T08:40:46.868150+0000","last_fullsized":"2023-12-22T08:40:46.868150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397864+0000","last_change":"2023-12-22T08:40:45.513879+0000","last_active":"2023-12-22T08:40:48.397864+0000","last_peered":"2023-12-22T08:40:48.397864+0000","last_clean":"2023-12-22T08:40:48.397864+0000","last_became_active":"2023-12-22T08:40:45.513329+0000","last_became_peered":"2023-12-22T08:40:45.513329+0000","last_unstale":"2023-12-22T08:40:48.397864+0000","last_undegraded":"2023-12-22T08:40:48.397864+0000","last_fullsized":"2023-12-22T08:40:48.397864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398049+0000","last_change":"2023-12-22T08:40:45.883287+0000","last_active":"2023-12-22T08:40:48.398049+0000","last_peered":"2023-12-22T08:40:48.398049+0000","last_clean":"2023-12-22T08:40:48.398049+0000","last_became_active":"2023-12-22T08:40:45.883029+0000","last_became_peered":"2023-12-22T08:40:45.883029+0000","last_unstale":"2023-12-22T08:40:48.398049+0000","last_undegraded":"2023-12-22T08:40:48.398049+0000","last_fullsized":"2023-12-22T08:40:48.398049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:51:18.636850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947366+0000","last_change":"2023-12-22T08:40:45.506897+0000","last_active":"2023-12-22T08:40:47.947366+0000","last_peered":"2023-12-22T08:40:47.947366+0000","last_clean":"2023-12-22T08:40:47.947366+0000","last_became_active":"2023-12-22T08:40:45.506629+0000","last_became_peered":"2023-12-22T08:40:45.506629+0000","last_unstale":"2023-12-22T08:40:47.947366+0000","last_undegraded":"2023-12-22T08:40:47.947366+0000","last_fullsized":"2023-12-22T08:40:47.947366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869291+0000","last_change":"2023-12-22T08:40:45.881933+0000","last_active":"2023-12-22T08:40:46.869291+0000","last_peered":"2023-12-22T08:40:46.869291+0000","last_clean":"2023-12-22T08:40:46.869291+0000","last_became_active":"2023-12-22T08:40:45.881668+0000","last_became_peered":"2023-12-22T08:40:45.881668+0000","last_unstale":"2023-12-22T08:40:46.869291+0000","last_undegraded":"2023-12-22T08:40:46.869291+0000","last_fullsized":"2023-12-22T08:40:46.869291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:45.489511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398192+0000","last_change":"2023-12-22T08:40:45.510517+0000","last_active":"2023-12-22T08:40:48.398192+0000","last_peered":"2023-12-22T08:40:48.398192+0000","last_clean":"2023-12-22T08:40:48.398192+0000","last_became_active":"2023-12-22T08:40:45.510251+0000","last_became_peered":"2023-12-22T08:40:45.510251+0000","last_unstale":"2023-12-22T08:40:48.398192+0000","last_undegraded":"2023-12-22T08:40:48.398192+0000","last_fullsized":"2023-12-22T08:40:48.398192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:04.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947392+0000","last_change":"2023-12-22T08:40:45.893451+0000","last_active":"2023-12-22T08:40:47.947392+0000","last_peered":"2023-12-22T08:40:47.947392+0000","last_clean":"2023-12-22T08:40:47.947392+0000","last_became_active":"2023-12-22T08:40:45.893164+0000","last_became_peered":"2023-12-22T08:40:45.893164+0000","last_unstale":"2023-12-22T08:40:47.947392+0000","last_undegraded":"2023-12-22T08:40:47.947392+0000","last_fullsized":"2023-12-22T08:40:47.947392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:41:59.148169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398723+0000","last_change":"2023-12-22T08:40:45.512956+0000","last_active":"2023-12-22T08:40:48.398723+0000","last_peered":"2023-12-22T08:40:48.398723+0000","last_clean":"2023-12-22T08:40:48.398723+0000","last_became_active":"2023-12-22T08:40:45.512647+0000","last_became_peered":"2023-12-22T08:40:45.512647+0000","last_unstale":"2023-12-22T08:40:48.398723+0000","last_undegraded":"2023-12-22T08:40:48.398723+0000","last_fullsized":"2023-12-22T08:40:48.398723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:12:03.015743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398318+0000","last_change":"2023-12-22T08:40:45.879030+0000","last_active":"2023-12-22T08:40:48.398318+0000","last_peered":"2023-12-22T08:40:48.398318+0000","last_clean":"2023-12-22T08:40:48.398318+0000","last_became_active":"2023-12-22T08:40:45.878738+0000","last_became_peered":"2023-12-22T08:40:45.878738+0000","last_unstale":"2023-12-22T08:40:48.398318+0000","last_undegraded":"2023-12-22T08:40:48.398318+0000","last_fullsized":"2023-12-22T08:40:48.398318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.799237+0000","last_change":"2023-12-22T08:40:45.504141+0000","last_active":"2023-12-22T08:40:48.799237+0000","last_peered":"2023-12-22T08:40:48.799237+0000","last_clean":"2023-12-22T08:40:48.799237+0000","last_became_active":"2023-12-22T08:40:45.503853+0000","last_became_peered":"2023-12-22T08:40:45.503853+0000","last_unstale":"2023-12-22T08:40:48.799237+0000","last_undegraded":"2023-12-22T08:40:48.799237+0000","last_fullsized":"2023-12-22T08:40:48.799237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869172+0000","last_change":"2023-12-22T08:40:45.886077+0000","last_active":"2023-12-22T08:40:46.869172+0000","last_peered":"2023-12-22T08:40:46.869172+0000","last_clean":"2023-12-22T08:40:46.869172+0000","last_became_active":"2023-12-22T08:40:45.885810+0000","last_became_peered":"2023-12-22T08:40:45.885810+0000","last_unstale":"2023-12-22T08:40:46.869172+0000","last_undegraded":"2023-12-22T08:40:46.869172+0000","last_fullsized":"2023-12-22T08:40:46.869172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975100+0000","last_change":"2023-12-22T08:40:45.508614+0000","last_active":"2023-12-22T08:40:47.975100+0000","last_peered":"2023-12-22T08:40:47.975100+0000","last_clean":"2023-12-22T08:40:47.975100+0000","last_became_active":"2023-12-22T08:40:45.508360+0000","last_became_peered":"2023-12-22T08:40:45.508360+0000","last_unstale":"2023-12-22T08:40:47.975100+0000","last_undegraded":"2023-12-22T08:40:47.975100+0000","last_fullsized":"2023-12-22T08:40:47.975100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868357+0000","last_change":"2023-12-22T08:40:45.873932+0000","last_active":"2023-12-22T08:40:46.868357+0000","last_peered":"2023-12-22T08:40:46.868357+0000","last_clean":"2023-12-22T08:40:46.868357+0000","last_became_active":"2023-12-22T08:40:45.873690+0000","last_became_peered":"2023-12-22T08:40:45.873690+0000","last_unstale":"2023-12-22T08:40:46.868357+0000","last_undegraded":"2023-12-22T08:40:46.868357+0000","last_fullsized":"2023-12-22T08:40:46.868357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:51:49.322300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398164+0000","last_change":"2023-12-22T08:40:45.513413+0000","last_active":"2023-12-22T08:40:48.398164+0000","last_peered":"2023-12-22T08:40:48.398164+0000","last_clean":"2023-12-22T08:40:48.398164+0000","last_became_active":"2023-12-22T08:40:45.512578+0000","last_became_peered":"2023-12-22T08:40:45.512578+0000","last_unstale":"2023-12-22T08:40:48.398164+0000","last_undegraded":"2023-12-22T08:40:48.398164+0000","last_fullsized":"2023-12-22T08:40:48.398164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:04.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869079+0000","last_change":"2023-12-22T08:40:45.884963+0000","last_active":"2023-12-22T08:40:46.869079+0000","last_peered":"2023-12-22T08:40:46.869079+0000","last_clean":"2023-12-22T08:40:46.869079+0000","last_became_active":"2023-12-22T08:40:45.884695+0000","last_became_peered":"2023-12-22T08:40:45.884695+0000","last_unstale":"2023-12-22T08:40:46.869079+0000","last_undegraded":"2023-12-22T08:40:46.869079+0000","last_fullsized":"2023-12-22T08:40:46.869079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:35.519308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398062+0000","last_change":"2023-12-22T08:40:45.507307+0000","last_active":"2023-12-22T08:40:48.398062+0000","last_peered":"2023-12-22T08:40:48.398062+0000","last_clean":"2023-12-22T08:40:48.398062+0000","last_became_active":"2023-12-22T08:40:45.506990+0000","last_became_peered":"2023-12-22T08:40:45.506990+0000","last_unstale":"2023-12-22T08:40:48.398062+0000","last_undegraded":"2023-12-22T08:40:48.398062+0000","last_fullsized":"2023-12-22T08:40:48.398062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868827+0000","last_change":"2023-12-22T08:40:45.884456+0000","last_active":"2023-12-22T08:40:46.868827+0000","last_peered":"2023-12-22T08:40:46.868827+0000","last_clean":"2023-12-22T08:40:46.868827+0000","last_became_active":"2023-12-22T08:40:45.884201+0000","last_became_peered":"2023-12-22T08:40:45.884201+0000","last_unstale":"2023-12-22T08:40:46.868827+0000","last_undegraded":"2023-12-22T08:40:46.868827+0000","last_fullsized":"2023-12-22T08:40:46.868827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398187+0000","last_change":"2023-12-22T08:40:45.515513+0000","last_active":"2023-12-22T08:40:48.398187+0000","last_peered":"2023-12-22T08:40:48.398187+0000","last_clean":"2023-12-22T08:40:48.398187+0000","last_became_active":"2023-12-22T08:40:45.515195+0000","last_became_peered":"2023-12-22T08:40:45.515195+0000","last_unstale":"2023-12-22T08:40:48.398187+0000","last_undegraded":"2023-12-22T08:40:48.398187+0000","last_fullsized":"2023-12-22T08:40:48.398187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869019+0000","last_change":"2023-12-22T08:40:45.887878+0000","last_active":"2023-12-22T08:40:46.869019+0000","last_peered":"2023-12-22T08:40:46.869019+0000","last_clean":"2023-12-22T08:40:46.869019+0000","last_became_active":"2023-12-22T08:40:45.887636+0000","last_became_peered":"2023-12-22T08:40:45.887636+0000","last_unstale":"2023-12-22T08:40:46.869019+0000","last_undegraded":"2023-12-22T08:40:46.869019+0000","last_fullsized":"2023-12-22T08:40:46.869019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398552+0000","last_change":"2023-12-22T08:40:45.508892+0000","last_active":"2023-12-22T08:40:48.398552+0000","last_peered":"2023-12-22T08:40:48.398552+0000","last_clean":"2023-12-22T08:40:48.398552+0000","last_became_active":"2023-12-22T08:40:45.508596+0000","last_became_peered":"2023-12-22T08:40:45.508596+0000","last_unstale":"2023-12-22T08:40:48.398552+0000","last_undegraded":"2023-12-22T08:40:48.398552+0000","last_fullsized":"2023-12-22T08:40:48.398552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:25.292485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974883+0000","last_change":"2023-12-22T08:40:45.882288+0000","last_active":"2023-12-22T08:40:47.974883+0000","last_peered":"2023-12-22T08:40:47.974883+0000","last_clean":"2023-12-22T08:40:47.974883+0000","last_became_active":"2023-12-22T08:40:45.882025+0000","last_became_peered":"2023-12-22T08:40:45.882025+0000","last_unstale":"2023-12-22T08:40:47.974883+0000","last_undegraded":"2023-12-22T08:40:47.974883+0000","last_fullsized":"2023-12-22T08:40:47.974883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947348+0000","last_change":"2023-12-22T08:40:45.889079+0000","last_active":"2023-12-22T08:40:47.947348+0000","last_peered":"2023-12-22T08:40:47.947348+0000","last_clean":"2023-12-22T08:40:47.947348+0000","last_became_active":"2023-12-22T08:40:45.888545+0000","last_became_peered":"2023-12-22T08:40:45.888545+0000","last_unstale":"2023-12-22T08:40:47.947348+0000","last_undegraded":"2023-12-22T08:40:47.947348+0000","last_fullsized":"2023-12-22T08:40:47.947348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398487+0000","last_change":"2023-12-22T08:40:45.510991+0000","last_active":"2023-12-22T08:40:48.398487+0000","last_peered":"2023-12-22T08:40:48.398487+0000","last_clean":"2023-12-22T08:40:48.398487+0000","last_became_active":"2023-12-22T08:40:45.510738+0000","last_became_peered":"2023-12-22T08:40:45.510738+0000","last_unstale":"2023-12-22T08:40:48.398487+0000","last_undegraded":"2023-12-22T08:40:48.398487+0000","last_fullsized":"2023-12-22T08:40:48.398487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:44.484526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947402+0000","last_change":"2023-12-22T08:40:45.890868+0000","last_active":"2023-12-22T08:40:47.947402+0000","last_peered":"2023-12-22T08:40:47.947402+0000","last_clean":"2023-12-22T08:40:47.947402+0000","last_became_active":"2023-12-22T08:40:45.890569+0000","last_became_peered":"2023-12-22T08:40:45.890569+0000","last_unstale":"2023-12-22T08:40:47.947402+0000","last_undegraded":"2023-12-22T08:40:47.947402+0000","last_fullsized":"2023-12-22T08:40:47.947402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398584+0000","last_change":"2023-12-22T08:40:45.511043+0000","last_active":"2023-12-22T08:40:48.398584+0000","last_peered":"2023-12-22T08:40:48.398584+0000","last_clean":"2023-12-22T08:40:48.398584+0000","last_became_active":"2023-12-22T08:40:45.510756+0000","last_became_peered":"2023-12-22T08:40:45.510756+0000","last_unstale":"2023-12-22T08:40:48.398584+0000","last_undegraded":"2023-12-22T08:40:48.398584+0000","last_fullsized":"2023-12-22T08:40:48.398584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868465+0000","last_change":"2023-12-22T08:40:45.890415+0000","last_active":"2023-12-22T08:40:46.868465+0000","last_peered":"2023-12-22T08:40:46.868465+0000","last_clean":"2023-12-22T08:40:46.868465+0000","last_became_active":"2023-12-22T08:40:45.889396+0000","last_became_peered":"2023-12-22T08:40:45.889396+0000","last_unstale":"2023-12-22T08:40:46.868465+0000","last_undegraded":"2023-12-22T08:40:46.868465+0000","last_fullsized":"2023-12-22T08:40:46.868465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869104+0000","last_change":"2023-12-22T08:40:45.515548+0000","last_active":"2023-12-22T08:40:46.869104+0000","last_peered":"2023-12-22T08:40:46.869104+0000","last_clean":"2023-12-22T08:40:46.869104+0000","last_became_active":"2023-12-22T08:40:45.515186+0000","last_became_peered":"2023-12-22T08:40:45.515186+0000","last_unstale":"2023-12-22T08:40:46.869104+0000","last_undegraded":"2023-12-22T08:40:46.869104+0000","last_fullsized":"2023-12-22T08:40:46.869104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868946+0000","last_change":"2023-12-22T08:40:45.891682+0000","last_active":"2023-12-22T08:40:46.868946+0000","last_peered":"2023-12-22T08:40:46.868946+0000","last_clean":"2023-12-22T08:40:46.868946+0000","last_became_active":"2023-12-22T08:40:45.891415+0000","last_became_peered":"2023-12-22T08:40:45.891415+0000","last_unstale":"2023-12-22T08:40:46.868946+0000","last_undegraded":"2023-12-22T08:40:46.868946+0000","last_fullsized":"2023-12-22T08:40:46.868946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868641+0000","last_change":"2023-12-22T08:40:45.510426+0000","last_active":"2023-12-22T08:40:46.868641+0000","last_peered":"2023-12-22T08:40:46.868641+0000","last_clean":"2023-12-22T08:40:46.868641+0000","last_became_active":"2023-12-22T08:40:45.510100+0000","last_became_peered":"2023-12-22T08:40:45.510100+0000","last_unstale":"2023-12-22T08:40:46.868641+0000","last_undegraded":"2023-12-22T08:40:46.868641+0000","last_fullsized":"2023-12-22T08:40:46.868641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:40:54.264 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:40:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.403+0000 7fc4c7aaf640 1 Processor -- start 2023-12-22T08:40:54.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c7aaf640 1 -- start start 2023-12-22T08:40:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c7aaf640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc4c006a6d0 0x7fc4c014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c7aaf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4c014b1f0 0x7fc4c00b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c7aaf640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c00bb310 con 0x7fc4c00ba550 2023-12-22T08:40:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c7aaf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c00bf960 con 0x7fc4c014b1f0 2023-12-22T08:40:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c7aaf640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c00bb5b0 con 0x7fc4c006a6d0 2023-12-22T08:40:54.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c504a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4c014b1f0 0x7fc4c00b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c504a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4c014b1f0 0x7fc4c00b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54710/0 (socket says 172.21.15.31:54710) 2023-12-22T08:40:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.404+0000 7fc4c504a640 1 -- 172.21.15.31:0/176308020 learned_addr learned my addr 172.21.15.31:0/176308020 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.405+0000 7fc4c584b640 1 --2- 172.21.15.31:0/176308020 >> v2:172.21.15.69:3300/0 conn(0x7fc4c006a6d0 0x7fc4c014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.405+0000 7fc4c504a640 1 -- 172.21.15.31:0/176308020 >> v2:172.21.15.69:3300/0 conn(0x7fc4c006a6d0 msgr2=0x7fc4c014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.405+0000 7fc4c504a640 1 --2- 172.21.15.31:0/176308020 >> v2:172.21.15.69:3300/0 conn(0x7fc4c006a6d0 0x7fc4c014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.405+0000 7fc4c504a640 1 -- 172.21.15.31:0/176308020 >> v1:172.21.15.69:6789/0 conn(0x7fc4c00ba550 legacy=0x7fc4c014e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.405+0000 7fc4c504a640 1 -- 172.21.15.31:0/176308020 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c00c0120 con 0x7fc4c014b1f0 2023-12-22T08:40:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.405+0000 7fc4c504a640 1 --2- 172.21.15.31:0/176308020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c00b9ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc4c008a260 tx=0x7fc4b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60f9af79cd34093 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.405+0000 7fc4c4849640 1 -- 172.21.15.31:0/176308020 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0031870 con 0x7fc4c014b1f0 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c4849640 1 -- 172.21.15.31:0/176308020 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b00319d0 con 0x7fc4c014b1f0 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c4849640 1 -- 172.21.15.31:0/176308020 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0031d60 con 0x7fc4c014b1f0 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/176308020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 msgr2=0x7fc4c00b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/176308020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c00b9ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc4c008a260 tx=0x7fc4b002b910 comp rx=0 tx=0).stop 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/176308020 shutdown_connections 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/176308020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c00b9ac0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/176308020 >> v2:172.21.15.69:3300/0 conn(0x7fc4c006a6d0 0x7fc4c014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/176308020 >> 172.21.15.31:0/176308020 conn(0x7fc4c00c0350 msgr2=0x7fc4c00c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/176308020 shutdown_connections 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.406+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/176308020 wait complete. 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.407+0000 7fc4c7aaf640 1 Processor -- start 2023-12-22T08:40:54.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.407+0000 7fc4c7aaf640 1 -- start start 2023-12-22T08:40:54.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c7aaf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc4c006a6d0 0x7fc4c014eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c7aaf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c00ba550 0x7fc4c01445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c7aaf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c7aaf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c014c250 con 0x7fc4c014b1f0 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c7aaf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c014ca60 con 0x7fc4c00ba550 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c7aaf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c014c4a0 con 0x7fc4c006a6d0 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c014cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54724/0 (socket says 172.21.15.31:54724) 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 -- 172.21.15.31:0/1030022827 learned_addr learned my addr 172.21.15.31:0/1030022827 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c504a640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c00ba550 0x7fc4c01445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c584b640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc4c006a6d0 0x7fc4c014eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 -- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc4c006a6d0 msgr2=0x7fc4c014eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc4c006a6d0 0x7fc4c014eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 -- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c00ba550 msgr2=0x7fc4c01445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c00ba550 0x7fc4c01445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 -- 172.21.15.31:0/1030022827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00094d0 con 0x7fc4c014b1f0 2023-12-22T08:40:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.408+0000 7fc4c604c640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c014cda0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800c700 tx=0x7fc4b800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.409+0000 7fc4b67fc640 1 -- 172.21.15.31:0/1030022827 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800aa50 con 0x7fc4c014b1f0 2023-12-22T08:40:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.409+0000 7fc4b67fc640 1 -- 172.21.15.31:0/1030022827 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b800abb0 con 0x7fc4c014b1f0 2023-12-22T08:40:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.409+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c014c780 con 0x7fc4c014b1f0 2023-12-22T08:40:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.409+0000 7fc4b67fc640 1 -- 172.21.15.31:0/1030022827 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800ce10 con 0x7fc4c014b1f0 2023-12-22T08:40:54.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.409+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c014e2e0 con 0x7fc4c014b1f0 2023-12-22T08:40:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.410+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c00a5560 con 0x7fc4c014b1f0 2023-12-22T08:40:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.410+0000 7fc4b67fc640 1 -- 172.21.15.31:0/1030022827 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc4b8012420 con 0x7fc4c014b1f0 2023-12-22T08:40:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.410+0000 7fc4b67fc640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc4a406a430 0x7fc4a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.411+0000 7fc4b67fc640 1 -- 172.21.15.31:0/1030022827 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4b8088c10 con 0x7fc4c014b1f0 2023-12-22T08:40:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.411+0000 7fc4c584b640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc4a406a430 0x7fc4a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.411+0000 7fc4c584b640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc4a406a430 0x7fc4a406c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00aac0 tx=0x7fc4bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.415+0000 7fc4b67fc640 1 -- 172.21.15.31:0/1030022827 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc4c00a5560 con 0x7fc4c014b1f0 2023-12-22T08:40:54.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.588+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4c00c1160 con 0x7fc4a406a430 2023-12-22T08:40:54.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.595+0000 7fc4b67fc640 1 -- 172.21.15.31:0/1030022827 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264559 (secure 0 0 0) 0x7fc4bc00c040 con 0x7fc4a406a430 2023-12-22T08:40:54.600 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:54.602 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:40:54.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc4a406a430 msgr2=0x7fc4a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc4a406a430 0x7fc4a406c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00aac0 tx=0x7fc4bc008040 comp rx=0 tx=0).stop 2023-12-22T08:40:54.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 msgr2=0x7fc4c014cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c014cda0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800c700 tx=0x7fc4b800cbc0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 shutdown_connections 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc4a406a430 0x7fc4a406c8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4c014b1f0 0x7fc4c014cda0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4c00ba550 0x7fc4c01445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 --2- 172.21.15.31:0/1030022827 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc4c006a6d0 0x7fc4c014eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 >> 172.21.15.31:0/1030022827 conn(0x7fc4c00c0350 msgr2=0x7fc4c0146d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 shutdown_connections 2023-12-22T08:40:54.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.598+0000 7fc4c7aaf640 1 -- 172.21.15.31:0/1030022827 wait complete. 2023-12-22T08:40:54.611 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-22T08:40:53.784688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218440,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756280,"statfs":{"total":773094113280,"available":772870430720,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002104"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398792+0000","last_change":"2023-12-22T08:40:45.883952+0000","last_active":"2023-12-22T08:40:48.398792+0000","last_peered":"2023-12-22T08:40:48.398792+0000","last_clean":"2023-12-22T08:40:48.398792+0000","last_became_active":"2023-12-22T08:40:45.883513+0000","last_became_peered":"2023-12-22T08:40:45.883513+0000","last_unstale":"2023-12-22T08:40:48.398792+0000","last_undegraded":"2023-12-22T08:40:48.398792+0000","last_fullsized":"2023-12-22T08:40:48.398792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:30.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398236+0000","last_change":"2023-12-22T08:40:45.878775+0000","last_active":"2023-12-22T08:40:48.398236+0000","last_peered":"2023-12-22T08:40:48.398236+0000","last_clean":"2023-12-22T08:40:48.398236+0000","last_became_active":"2023-12-22T08:40:45.878528+0000","last_became_peered":"2023-12-22T08:40:45.878528+0000","last_unstale":"2023-12-22T08:40:48.398236+0000","last_undegraded":"2023-12-22T08:40:48.398236+0000","last_fullsized":"2023-12-22T08:40:48.398236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868312+0000","last_change":"2023-12-22T08:40:45.880293+0000","last_active":"2023-12-22T08:40:46.868312+0000","last_peered":"2023-12-22T08:40:46.868312+0000","last_clean":"2023-12-22T08:40:46.868312+0000","last_became_active":"2023-12-22T08:40:45.880038+0000","last_became_peered":"2023-12-22T08:40:45.880038+0000","last_unstale":"2023-12-22T08:40:46.868312+0000","last_undegraded":"2023-12-22T08:40:46.868312+0000","last_fullsized":"2023-12-22T08:40:46.868312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947206+0000","last_change":"2023-12-22T08:40:45.892847+0000","last_active":"2023-12-22T08:40:47.947206+0000","last_peered":"2023-12-22T08:40:47.947206+0000","last_clean":"2023-12-22T08:40:47.947206+0000","last_became_active":"2023-12-22T08:40:45.892443+0000","last_became_peered":"2023-12-22T08:40:45.892443+0000","last_unstale":"2023-12-22T08:40:47.947206+0000","last_undegraded":"2023-12-22T08:40:47.947206+0000","last_fullsized":"2023-12-22T08:40:47.947206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:33.421892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398449+0000","last_change":"2023-12-22T08:40:45.884154+0000","last_active":"2023-12-22T08:40:48.398449+0000","last_peered":"2023-12-22T08:40:48.398449+0000","last_clean":"2023-12-22T08:40:48.398449+0000","last_became_active":"2023-12-22T08:40:45.883879+0000","last_became_peered":"2023-12-22T08:40:45.883879+0000","last_unstale":"2023-12-22T08:40:48.398449+0000","last_undegraded":"2023-12-22T08:40:48.398449+0000","last_fullsized":"2023-12-22T08:40:48.398449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:30.540430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.946964+0000","last_change":"2023-12-22T08:40:45.889896+0000","last_active":"2023-12-22T08:40:47.946964+0000","last_peered":"2023-12-22T08:40:47.946964+0000","last_clean":"2023-12-22T08:40:47.946964+0000","last_became_active":"2023-12-22T08:40:45.888864+0000","last_became_peered":"2023-12-22T08:40:45.888864+0000","last_unstale":"2023-12-22T08:40:47.946964+0000","last_undegraded":"2023-12-22T08:40:47.946964+0000","last_fullsized":"2023-12-22T08:40:47.946964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398256+0000","last_change":"2023-12-22T08:40:45.881811+0000","last_active":"2023-12-22T08:40:48.398256+0000","last_peered":"2023-12-22T08:40:48.398256+0000","last_clean":"2023-12-22T08:40:48.398256+0000","last_became_active":"2023-12-22T08:40:45.881578+0000","last_became_peered":"2023-12-22T08:40:45.881578+0000","last_unstale":"2023-12-22T08:40:48.398256+0000","last_undegraded":"2023-12-22T08:40:48.398256+0000","last_fullsized":"2023-12-22T08:40:48.398256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:16.186426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868647+0000","last_change":"2023-12-22T08:40:45.892116+0000","last_active":"2023-12-22T08:40:46.868647+0000","last_peered":"2023-12-22T08:40:46.868647+0000","last_clean":"2023-12-22T08:40:46.868647+0000","last_became_active":"2023-12-22T08:40:45.891946+0000","last_became_peered":"2023-12-22T08:40:45.891946+0000","last_unstale":"2023-12-22T08:40:46.868647+0000","last_undegraded":"2023-12-22T08:40:46.868647+0000","last_fullsized":"2023-12-22T08:40:46.868647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398786+0000","last_change":"2023-12-22T08:40:45.890365+0000","last_active":"2023-12-22T08:40:48.398786+0000","last_peered":"2023-12-22T08:40:48.398786+0000","last_clean":"2023-12-22T08:40:48.398786+0000","last_became_active":"2023-12-22T08:40:45.890130+0000","last_became_peered":"2023-12-22T08:40:45.890130+0000","last_unstale":"2023-12-22T08:40:48.398786+0000","last_undegraded":"2023-12-22T08:40:48.398786+0000","last_fullsized":"2023-12-22T08:40:48.398786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:13.809967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975214+0000","last_change":"2023-12-22T08:40:45.889288+0000","last_active":"2023-12-22T08:40:47.975214+0000","last_peered":"2023-12-22T08:40:47.975214+0000","last_clean":"2023-12-22T08:40:47.975214+0000","last_became_active":"2023-12-22T08:40:45.889044+0000","last_became_peered":"2023-12-22T08:40:45.889044+0000","last_unstale":"2023-12-22T08:40:47.975214+0000","last_undegraded":"2023-12-22T08:40:47.975214+0000","last_fullsized":"2023-12-22T08:40:47.975214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975064+0000","last_change":"2023-12-22T08:40:45.890399+0000","last_active":"2023-12-22T08:40:47.975064+0000","last_peered":"2023-12-22T08:40:47.975064+0000","last_clean":"2023-12-22T08:40:47.975064+0000","last_became_active":"2023-12-22T08:40:45.890142+0000","last_became_peered":"2023-12-22T08:40:45.890142+0000","last_unstale":"2023-12-22T08:40:47.975064+0000","last_undegraded":"2023-12-22T08:40:47.975064+0000","last_fullsized":"2023-12-22T08:40:47.975064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869515+0000","last_change":"2023-12-22T08:40:45.877838+0000","last_active":"2023-12-22T08:40:46.869515+0000","last_peered":"2023-12-22T08:40:46.869515+0000","last_clean":"2023-12-22T08:40:46.869515+0000","last_became_active":"2023-12-22T08:40:45.877514+0000","last_became_peered":"2023-12-22T08:40:45.877514+0000","last_unstale":"2023-12-22T08:40:46.869515+0000","last_undegraded":"2023-12-22T08:40:46.869515+0000","last_fullsized":"2023-12-22T08:40:46.869515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:05.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868964+0000","last_change":"2023-12-22T08:40:45.891488+0000","last_active":"2023-12-22T08:40:46.868964+0000","last_peered":"2023-12-22T08:40:46.868964+0000","last_clean":"2023-12-22T08:40:46.868964+0000","last_became_active":"2023-12-22T08:40:45.891337+0000","last_became_peered":"2023-12-22T08:40:45.891337+0000","last_unstale":"2023-12-22T08:40:46.868964+0000","last_undegraded":"2023-12-22T08:40:46.868964+0000","last_fullsized":"2023-12-22T08:40:46.868964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868225+0000","last_change":"2023-12-22T08:40:45.878437+0000","last_active":"2023-12-22T08:40:46.868225+0000","last_peered":"2023-12-22T08:40:46.868225+0000","last_clean":"2023-12-22T08:40:46.868225+0000","last_became_active":"2023-12-22T08:40:45.878165+0000","last_became_peered":"2023-12-22T08:40:45.878165+0000","last_unstale":"2023-12-22T08:40:46.868225+0000","last_undegraded":"2023-12-22T08:40:46.868225+0000","last_fullsized":"2023-12-22T08:40:46.868225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398069+0000","last_change":"2023-12-22T08:40:45.878993+0000","last_active":"2023-12-22T08:40:48.398069+0000","last_peered":"2023-12-22T08:40:48.398069+0000","last_clean":"2023-12-22T08:40:48.398069+0000","last_became_active":"2023-12-22T08:40:45.878204+0000","last_became_peered":"2023-12-22T08:40:45.878204+0000","last_unstale":"2023-12-22T08:40:48.398069+0000","last_undegraded":"2023-12-22T08:40:48.398069+0000","last_fullsized":"2023-12-22T08:40:48.398069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.946898+0000","last_change":"2023-12-22T08:40:45.886532+0000","last_active":"2023-12-22T08:40:47.946898+0000","last_peered":"2023-12-22T08:40:47.946898+0000","last_clean":"2023-12-22T08:40:47.946898+0000","last_became_active":"2023-12-22T08:40:45.886207+0000","last_became_peered":"2023-12-22T08:40:45.886207+0000","last_unstale":"2023-12-22T08:40:47.946898+0000","last_undegraded":"2023-12-22T08:40:47.946898+0000","last_fullsized":"2023-12-22T08:40:47.946898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947576+0000","last_change":"2023-12-22T08:40:45.887660+0000","last_active":"2023-12-22T08:40:47.947576+0000","last_peered":"2023-12-22T08:40:47.947576+0000","last_clean":"2023-12-22T08:40:47.947576+0000","last_became_active":"2023-12-22T08:40:45.887406+0000","last_became_peered":"2023-12-22T08:40:45.887406+0000","last_unstale":"2023-12-22T08:40:47.947576+0000","last_undegraded":"2023-12-22T08:40:47.947576+0000","last_fullsized":"2023-12-22T08:40:47.947576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397941+0000","last_change":"2023-12-22T08:40:45.887556+0000","last_active":"2023-12-22T08:40:48.397941+0000","last_peered":"2023-12-22T08:40:48.397941+0000","last_clean":"2023-12-22T08:40:48.397941+0000","last_became_active":"2023-12-22T08:40:45.887294+0000","last_became_peered":"2023-12-22T08:40:45.887294+0000","last_unstale":"2023-12-22T08:40:48.397941+0000","last_undegraded":"2023-12-22T08:40:48.397941+0000","last_fullsized":"2023-12-22T08:40:48.397941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:45.489511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398722+0000","last_change":"2023-12-22T08:40:45.883598+0000","last_active":"2023-12-22T08:40:48.398722+0000","last_peered":"2023-12-22T08:40:48.398722+0000","last_clean":"2023-12-22T08:40:48.398722+0000","last_became_active":"2023-12-22T08:40:45.883319+0000","last_became_peered":"2023-12-22T08:40:45.883319+0000","last_unstale":"2023-12-22T08:40:48.398722+0000","last_undegraded":"2023-12-22T08:40:48.398722+0000","last_fullsized":"2023-12-22T08:40:48.398722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:31:33.421892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975025+0000","last_change":"2023-12-22T08:40:45.881672+0000","last_active":"2023-12-22T08:40:47.975025+0000","last_peered":"2023-12-22T08:40:47.975025+0000","last_clean":"2023-12-22T08:40:47.975025+0000","last_became_active":"2023-12-22T08:40:45.881403+0000","last_became_peered":"2023-12-22T08:40:45.881403+0000","last_unstale":"2023-12-22T08:40:47.975025+0000","last_undegraded":"2023-12-22T08:40:47.975025+0000","last_fullsized":"2023-12-22T08:40:47.975025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868566+0000","last_change":"2023-12-22T08:40:45.875815+0000","last_active":"2023-12-22T08:40:46.868566+0000","last_peered":"2023-12-22T08:40:46.868566+0000","last_clean":"2023-12-22T08:40:46.868566+0000","last_became_active":"2023-12-22T08:40:45.875552+0000","last_became_peered":"2023-12-22T08:40:45.875552+0000","last_unstale":"2023-12-22T08:40:46.868566+0000","last_undegraded":"2023-12-22T08:40:46.868566+0000","last_fullsized":"2023-12-22T08:40:46.868566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947204+0000","last_change":"2023-12-22T08:40:45.889509+0000","last_active":"2023-12-22T08:40:47.947204+0000","last_peered":"2023-12-22T08:40:47.947204+0000","last_clean":"2023-12-22T08:40:47.947204+0000","last_became_active":"2023-12-22T08:40:45.889147+0000","last_became_peered":"2023-12-22T08:40:45.889147+0000","last_unstale":"2023-12-22T08:40:47.947204+0000","last_undegraded":"2023-12-22T08:40:47.947204+0000","last_fullsized":"2023-12-22T08:40:47.947204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868668+0000","last_change":"2023-12-22T08:40:45.888792+0000","last_active":"2023-12-22T08:40:46.868668+0000","last_peered":"2023-12-22T08:40:46.868668+0000","last_clean":"2023-12-22T08:40:46.868668+0000","last_became_active":"2023-12-22T08:40:45.888190+0000","last_became_peered":"2023-12-22T08:40:45.888190+0000","last_unstale":"2023-12-22T08:40:46.868668+0000","last_undegraded":"2023-12-22T08:40:46.868668+0000","last_fullsized":"2023-12-22T08:40:46.868668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:14:22.484265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947028+0000","last_change":"2023-12-22T08:40:45.893300+0000","last_active":"2023-12-22T08:40:47.947028+0000","last_peered":"2023-12-22T08:40:47.947028+0000","last_clean":"2023-12-22T08:40:47.947028+0000","last_became_active":"2023-12-22T08:40:45.892789+0000","last_became_peered":"2023-12-22T08:40:45.892789+0000","last_unstale":"2023-12-22T08:40:47.947028+0000","last_undegraded":"2023-12-22T08:40:47.947028+0000","last_fullsized":"2023-12-22T08:40:47.947028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:05:30.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869172+0000","last_change":"2023-12-22T08:40:45.888716+0000","last_active":"2023-12-22T08:40:46.869172+0000","last_peered":"2023-12-22T08:40:46.869172+0000","last_clean":"2023-12-22T08:40:46.869172+0000","last_became_active":"2023-12-22T08:40:45.888164+0000","last_became_peered":"2023-12-22T08:40:45.888164+0000","last_unstale":"2023-12-22T08:40:46.869172+0000","last_undegraded":"2023-12-22T08:40:46.869172+0000","last_fullsized":"2023-12-22T08:40:46.869172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975264+0000","last_change":"2023-12-22T08:40:45.875528+0000","last_active":"2023-12-22T08:40:47.975264+0000","last_peered":"2023-12-22T08:40:47.975264+0000","last_clean":"2023-12-22T08:40:47.975264+0000","last_became_active":"2023-12-22T08:40:45.875275+0000","last_became_peered":"2023-12-22T08:40:45.875275+0000","last_unstale":"2023-12-22T08:40:47.975264+0000","last_undegraded":"2023-12-22T08:40:47.975264+0000","last_fullsized":"2023-12-22T08:40:47.975264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398211+0000","last_change":"2023-12-22T08:40:45.884223+0000","last_active":"2023-12-22T08:40:48.398211+0000","last_peered":"2023-12-22T08:40:48.398211+0000","last_clean":"2023-12-22T08:40:48.398211+0000","last_became_active":"2023-12-22T08:40:45.883970+0000","last_became_peered":"2023-12-22T08:40:45.883970+0000","last_unstale":"2023-12-22T08:40:48.398211+0000","last_undegraded":"2023-12-22T08:40:48.398211+0000","last_fullsized":"2023-12-22T08:40:48.398211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868912+0000","last_change":"2023-12-22T08:40:45.882599+0000","last_active":"2023-12-22T08:40:46.868912+0000","last_peered":"2023-12-22T08:40:46.868912+0000","last_clean":"2023-12-22T08:40:46.868912+0000","last_became_active":"2023-12-22T08:40:45.882327+0000","last_became_peered":"2023-12-22T08:40:45.882327+0000","last_unstale":"2023-12-22T08:40:46.868912+0000","last_undegraded":"2023-12-22T08:40:46.868912+0000","last_fullsized":"2023-12-22T08:40:46.868912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:29:48.193357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868649+0000","last_change":"2023-12-22T08:40:45.889519+0000","last_active":"2023-12-22T08:40:46.868649+0000","last_peered":"2023-12-22T08:40:46.868649+0000","last_clean":"2023-12-22T08:40:46.868649+0000","last_became_active":"2023-12-22T08:40:45.889215+0000","last_became_peered":"2023-12-22T08:40:45.889215+0000","last_unstale":"2023-12-22T08:40:46.868649+0000","last_undegraded":"2023-12-22T08:40:46.868649+0000","last_fullsized":"2023-12-22T08:40:46.868649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947237+0000","last_change":"2023-12-22T08:40:45.893059+0000","last_active":"2023-12-22T08:40:47.947237+0000","last_peered":"2023-12-22T08:40:47.947237+0000","last_clean":"2023-12-22T08:40:47.947237+0000","last_became_active":"2023-12-22T08:40:45.892669+0000","last_became_peered":"2023-12-22T08:40:45.892669+0000","last_unstale":"2023-12-22T08:40:47.947237+0000","last_undegraded":"2023-12-22T08:40:47.947237+0000","last_fullsized":"2023-12-22T08:40:47.947237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:55:13.809967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397775+0000","last_change":"2023-12-22T08:40:45.889241+0000","last_active":"2023-12-22T08:40:48.397775+0000","last_peered":"2023-12-22T08:40:48.397775+0000","last_clean":"2023-12-22T08:40:48.397775+0000","last_became_active":"2023-12-22T08:40:45.888986+0000","last_became_peered":"2023-12-22T08:40:45.888986+0000","last_unstale":"2023-12-22T08:40:48.397775+0000","last_undegraded":"2023-12-22T08:40:48.397775+0000","last_fullsized":"2023-12-22T08:40:48.397775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:05.467361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974913+0000","last_change":"2023-12-22T08:40:45.881924+0000","last_active":"2023-12-22T08:40:47.974913+0000","last_peered":"2023-12-22T08:40:47.974913+0000","last_clean":"2023-12-22T08:40:47.974913+0000","last_became_active":"2023-12-22T08:40:45.880927+0000","last_became_peered":"2023-12-22T08:40:45.880927+0000","last_unstale":"2023-12-22T08:40:47.974913+0000","last_undegraded":"2023-12-22T08:40:47.974913+0000","last_fullsized":"2023-12-22T08:40:47.974913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868974+0000","last_change":"2023-12-22T08:40:45.878836+0000","last_active":"2023-12-22T08:40:46.868974+0000","last_peered":"2023-12-22T08:40:46.868974+0000","last_clean":"2023-12-22T08:40:46.868974+0000","last_became_active":"2023-12-22T08:40:45.878561+0000","last_became_peered":"2023-12-22T08:40:45.878561+0000","last_unstale":"2023-12-22T08:40:46.868974+0000","last_undegraded":"2023-12-22T08:40:46.868974+0000","last_fullsized":"2023-12-22T08:40:46.868974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:26.297470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869042+0000","last_change":"2023-12-22T08:40:45.512780+0000","last_active":"2023-12-22T08:40:46.869042+0000","last_peered":"2023-12-22T08:40:46.869042+0000","last_clean":"2023-12-22T08:40:46.869042+0000","last_became_active":"2023-12-22T08:40:45.512502+0000","last_became_peered":"2023-12-22T08:40:45.512502+0000","last_unstale":"2023-12-22T08:40:46.869042+0000","last_undegraded":"2023-12-22T08:40:46.869042+0000","last_fullsized":"2023-12-22T08:40:46.869042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:27.751410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868831+0000","last_change":"2023-12-22T08:40:45.876753+0000","last_active":"2023-12-22T08:40:46.868831+0000","last_peered":"2023-12-22T08:40:46.868831+0000","last_clean":"2023-12-22T08:40:46.868831+0000","last_became_active":"2023-12-22T08:40:45.876192+0000","last_became_peered":"2023-12-22T08:40:45.876192+0000","last_unstale":"2023-12-22T08:40:46.868831+0000","last_undegraded":"2023-12-22T08:40:46.868831+0000","last_fullsized":"2023-12-22T08:40:46.868831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974998+0000","last_change":"2023-12-22T08:40:45.509309+0000","last_active":"2023-12-22T08:40:47.974998+0000","last_peered":"2023-12-22T08:40:47.974998+0000","last_clean":"2023-12-22T08:40:47.974998+0000","last_became_active":"2023-12-22T08:40:45.508805+0000","last_became_peered":"2023-12-22T08:40:45.508805+0000","last_unstale":"2023-12-22T08:40:47.974998+0000","last_undegraded":"2023-12-22T08:40:47.974998+0000","last_fullsized":"2023-12-22T08:40:47.974998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868799+0000","last_change":"2023-12-22T08:40:45.511261+0000","last_active":"2023-12-22T08:40:46.868799+0000","last_peered":"2023-12-22T08:40:46.868799+0000","last_clean":"2023-12-22T08:40:46.868799+0000","last_became_active":"2023-12-22T08:40:45.510991+0000","last_became_peered":"2023-12-22T08:40:45.510991+0000","last_unstale":"2023-12-22T08:40:46.868799+0000","last_undegraded":"2023-12-22T08:40:46.868799+0000","last_fullsized":"2023-12-22T08:40:46.868799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868743+0000","last_change":"2023-12-22T08:40:45.885554+0000","last_active":"2023-12-22T08:40:46.868743+0000","last_peered":"2023-12-22T08:40:46.868743+0000","last_clean":"2023-12-22T08:40:46.868743+0000","last_became_active":"2023-12-22T08:40:45.885316+0000","last_became_peered":"2023-12-22T08:40:45.885316+0000","last_unstale":"2023-12-22T08:40:46.868743+0000","last_undegraded":"2023-12-22T08:40:46.868743+0000","last_fullsized":"2023-12-22T08:40:46.868743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:44:32.925057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947033+0000","last_change":"2023-12-22T08:40:45.504497+0000","last_active":"2023-12-22T08:40:47.947033+0000","last_peered":"2023-12-22T08:40:47.947033+0000","last_clean":"2023-12-22T08:40:47.947033+0000","last_became_active":"2023-12-22T08:40:45.504227+0000","last_became_peered":"2023-12-22T08:40:45.504227+0000","last_unstale":"2023-12-22T08:40:47.947033+0000","last_undegraded":"2023-12-22T08:40:47.947033+0000","last_fullsized":"2023-12-22T08:40:47.947033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397985+0000","last_change":"2023-12-22T08:40:45.884410+0000","last_active":"2023-12-22T08:40:48.397985+0000","last_peered":"2023-12-22T08:40:48.397985+0000","last_clean":"2023-12-22T08:40:48.397985+0000","last_became_active":"2023-12-22T08:40:45.884074+0000","last_became_peered":"2023-12-22T08:40:45.884074+0000","last_unstale":"2023-12-22T08:40:48.397985+0000","last_undegraded":"2023-12-22T08:40:48.397985+0000","last_fullsized":"2023-12-22T08:40:48.397985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975082+0000","last_change":"2023-12-22T08:40:45.511242+0000","last_active":"2023-12-22T08:40:47.975082+0000","last_peered":"2023-12-22T08:40:47.975082+0000","last_clean":"2023-12-22T08:40:47.975082+0000","last_became_active":"2023-12-22T08:40:45.510960+0000","last_became_peered":"2023-12-22T08:40:45.510960+0000","last_unstale":"2023-12-22T08:40:47.975082+0000","last_undegraded":"2023-12-22T08:40:47.975082+0000","last_fullsized":"2023-12-22T08:40:47.975082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947286+0000","last_change":"2023-12-22T08:40:45.888628+0000","last_active":"2023-12-22T08:40:47.947286+0000","last_peered":"2023-12-22T08:40:47.947286+0000","last_clean":"2023-12-22T08:40:47.947286+0000","last_became_active":"2023-12-22T08:40:45.888351+0000","last_became_peered":"2023-12-22T08:40:45.888351+0000","last_unstale":"2023-12-22T08:40:47.947286+0000","last_undegraded":"2023-12-22T08:40:47.947286+0000","last_fullsized":"2023-12-22T08:40:47.947286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:16.186426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947394+0000","last_change":"2023-12-22T08:40:45.507232+0000","last_active":"2023-12-22T08:40:47.947394+0000","last_peered":"2023-12-22T08:40:47.947394+0000","last_clean":"2023-12-22T08:40:47.947394+0000","last_became_active":"2023-12-22T08:40:45.506953+0000","last_became_peered":"2023-12-22T08:40:45.506953+0000","last_unstale":"2023-12-22T08:40:47.947394+0000","last_undegraded":"2023-12-22T08:40:47.947394+0000","last_fullsized":"2023-12-22T08:40:47.947394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868557+0000","last_change":"2023-12-22T08:40:45.890659+0000","last_active":"2023-12-22T08:40:46.868557+0000","last_peered":"2023-12-22T08:40:46.868557+0000","last_clean":"2023-12-22T08:40:46.868557+0000","last_became_active":"2023-12-22T08:40:45.889673+0000","last_became_peered":"2023-12-22T08:40:45.889673+0000","last_unstale":"2023-12-22T08:40:46.868557+0000","last_undegraded":"2023-12-22T08:40:46.868557+0000","last_fullsized":"2023-12-22T08:40:46.868557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398207+0000","last_change":"2023-12-22T08:40:45.507641+0000","last_active":"2023-12-22T08:40:48.398207+0000","last_peered":"2023-12-22T08:40:48.398207+0000","last_clean":"2023-12-22T08:40:48.398207+0000","last_became_active":"2023-12-22T08:40:45.507322+0000","last_became_peered":"2023-12-22T08:40:45.507322+0000","last_unstale":"2023-12-22T08:40:48.398207+0000","last_undegraded":"2023-12-22T08:40:48.398207+0000","last_fullsized":"2023-12-22T08:40:48.398207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:25.292485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869520+0000","last_change":"2023-12-22T08:40:45.877133+0000","last_active":"2023-12-22T08:40:46.869520+0000","last_peered":"2023-12-22T08:40:46.869520+0000","last_clean":"2023-12-22T08:40:46.869520+0000","last_became_active":"2023-12-22T08:40:45.876811+0000","last_became_peered":"2023-12-22T08:40:45.876811+0000","last_unstale":"2023-12-22T08:40:46.869520+0000","last_undegraded":"2023-12-22T08:40:46.869520+0000","last_fullsized":"2023-12-22T08:40:46.869520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:45.181460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975130+0000","last_change":"2023-12-22T08:40:45.515520+0000","last_active":"2023-12-22T08:40:47.975130+0000","last_peered":"2023-12-22T08:40:47.975130+0000","last_clean":"2023-12-22T08:40:47.975130+0000","last_became_active":"2023-12-22T08:40:45.515191+0000","last_became_peered":"2023-12-22T08:40:45.515191+0000","last_unstale":"2023-12-22T08:40:47.975130+0000","last_undegraded":"2023-12-22T08:40:47.975130+0000","last_fullsized":"2023-12-22T08:40:47.975130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398510+0000","last_change":"2023-12-22T08:40:45.884908+0000","last_active":"2023-12-22T08:40:48.398510+0000","last_peered":"2023-12-22T08:40:48.398510+0000","last_clean":"2023-12-22T08:40:48.398510+0000","last_became_active":"2023-12-22T08:40:45.884670+0000","last_became_peered":"2023-12-22T08:40:45.884670+0000","last_unstale":"2023-12-22T08:40:48.398510+0000","last_undegraded":"2023-12-22T08:40:48.398510+0000","last_fullsized":"2023-12-22T08:40:48.398510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:31:17.567380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868744+0000","last_change":"2023-12-22T08:40:45.509332+0000","last_active":"2023-12-22T08:40:46.868744+0000","last_peered":"2023-12-22T08:40:46.868744+0000","last_clean":"2023-12-22T08:40:46.868744+0000","last_became_active":"2023-12-22T08:40:45.509052+0000","last_became_peered":"2023-12-22T08:40:45.509052+0000","last_unstale":"2023-12-22T08:40:46.868744+0000","last_undegraded":"2023-12-22T08:40:46.868744+0000","last_fullsized":"2023-12-22T08:40:46.868744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:53:27.751410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868335+0000","last_change":"2023-12-22T08:40:45.875255+0000","last_active":"2023-12-22T08:40:46.868335+0000","last_peered":"2023-12-22T08:40:46.868335+0000","last_clean":"2023-12-22T08:40:46.868335+0000","last_became_active":"2023-12-22T08:40:45.875014+0000","last_became_peered":"2023-12-22T08:40:45.875014+0000","last_unstale":"2023-12-22T08:40:46.868335+0000","last_undegraded":"2023-12-22T08:40:46.868335+0000","last_fullsized":"2023-12-22T08:40:46.868335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947312+0000","last_change":"2023-12-22T08:40:45.513554+0000","last_active":"2023-12-22T08:40:47.947312+0000","last_peered":"2023-12-22T08:40:47.947312+0000","last_clean":"2023-12-22T08:40:47.947312+0000","last_became_active":"2023-12-22T08:40:45.513255+0000","last_became_peered":"2023-12-22T08:40:45.513255+0000","last_unstale":"2023-12-22T08:40:47.947312+0000","last_undegraded":"2023-12-22T08:40:47.947312+0000","last_fullsized":"2023-12-22T08:40:47.947312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398497+0000","last_change":"2023-12-22T08:40:45.886788+0000","last_active":"2023-12-22T08:40:48.398497+0000","last_peered":"2023-12-22T08:40:48.398497+0000","last_clean":"2023-12-22T08:40:48.398497+0000","last_became_active":"2023-12-22T08:40:45.886544+0000","last_became_peered":"2023-12-22T08:40:45.886544+0000","last_unstale":"2023-12-22T08:40:48.398497+0000","last_undegraded":"2023-12-22T08:40:48.398497+0000","last_fullsized":"2023-12-22T08:40:48.398497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974941+0000","last_change":"2023-12-22T08:40:45.508706+0000","last_active":"2023-12-22T08:40:47.974941+0000","last_peered":"2023-12-22T08:40:47.974941+0000","last_clean":"2023-12-22T08:40:47.974941+0000","last_became_active":"2023-12-22T08:40:45.508419+0000","last_became_peered":"2023-12-22T08:40:45.508419+0000","last_unstale":"2023-12-22T08:40:47.974941+0000","last_undegraded":"2023-12-22T08:40:47.974941+0000","last_fullsized":"2023-12-22T08:40:47.974941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974937+0000","last_change":"2023-12-22T08:40:45.881751+0000","last_active":"2023-12-22T08:40:47.974937+0000","last_peered":"2023-12-22T08:40:47.974937+0000","last_clean":"2023-12-22T08:40:47.974937+0000","last_became_active":"2023-12-22T08:40:45.881474+0000","last_became_peered":"2023-12-22T08:40:45.881474+0000","last_unstale":"2023-12-22T08:40:47.974937+0000","last_undegraded":"2023-12-22T08:40:47.974937+0000","last_fullsized":"2023-12-22T08:40:47.974937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397769+0000","last_change":"2023-12-22T08:40:45.505971+0000","last_active":"2023-12-22T08:40:48.397769+0000","last_peered":"2023-12-22T08:40:48.397769+0000","last_clean":"2023-12-22T08:40:48.397769+0000","last_became_active":"2023-12-22T08:40:45.505672+0000","last_became_peered":"2023-12-22T08:40:45.505672+0000","last_unstale":"2023-12-22T08:40:48.397769+0000","last_undegraded":"2023-12-22T08:40:48.397769+0000","last_fullsized":"2023-12-22T08:40:48.397769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398260+0000","last_change":"2023-12-22T08:40:45.879566+0000","last_active":"2023-12-22T08:40:48.398260+0000","last_peered":"2023-12-22T08:40:48.398260+0000","last_clean":"2023-12-22T08:40:48.398260+0000","last_became_active":"2023-12-22T08:40:45.879319+0000","last_became_peered":"2023-12-22T08:40:45.879319+0000","last_unstale":"2023-12-22T08:40:48.398260+0000","last_undegraded":"2023-12-22T08:40:48.398260+0000","last_fullsized":"2023-12-22T08:40:48.398260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:41:59.148169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869645+0000","last_change":"2023-12-22T08:40:45.511686+0000","last_active":"2023-12-22T08:40:46.869645+0000","last_peered":"2023-12-22T08:40:46.869645+0000","last_clean":"2023-12-22T08:40:46.869645+0000","last_became_active":"2023-12-22T08:40:45.511341+0000","last_became_peered":"2023-12-22T08:40:45.511341+0000","last_unstale":"2023-12-22T08:40:46.869645+0000","last_undegraded":"2023-12-22T08:40:46.869645+0000","last_fullsized":"2023-12-22T08:40:46.869645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:34:01.717358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398720+0000","last_change":"2023-12-22T08:40:45.882380+0000","last_active":"2023-12-22T08:40:48.398720+0000","last_peered":"2023-12-22T08:40:48.398720+0000","last_clean":"2023-12-22T08:40:48.398720+0000","last_became_active":"2023-12-22T08:40:45.882119+0000","last_became_peered":"2023-12-22T08:40:45.882119+0000","last_unstale":"2023-12-22T08:40:48.398720+0000","last_undegraded":"2023-12-22T08:40:48.398720+0000","last_fullsized":"2023-12-22T08:40:48.398720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:58.527847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398030+0000","last_change":"2023-12-22T08:40:45.513658+0000","last_active":"2023-12-22T08:40:48.398030+0000","last_peered":"2023-12-22T08:40:48.398030+0000","last_clean":"2023-12-22T08:40:48.398030+0000","last_became_active":"2023-12-22T08:40:45.513339+0000","last_became_peered":"2023-12-22T08:40:45.513339+0000","last_unstale":"2023-12-22T08:40:48.398030+0000","last_undegraded":"2023-12-22T08:40:48.398030+0000","last_fullsized":"2023-12-22T08:40:48.398030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398866+0000","last_change":"2023-12-22T08:40:45.885859+0000","last_active":"2023-12-22T08:40:48.398866+0000","last_peered":"2023-12-22T08:40:48.398866+0000","last_clean":"2023-12-22T08:40:48.398866+0000","last_became_active":"2023-12-22T08:40:45.885570+0000","last_became_peered":"2023-12-22T08:40:45.885570+0000","last_unstale":"2023-12-22T08:40:48.398866+0000","last_undegraded":"2023-12-22T08:40:48.398866+0000","last_fullsized":"2023-12-22T08:40:48.398866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398284+0000","last_change":"2023-12-22T08:40:45.505894+0000","last_active":"2023-12-22T08:40:48.398284+0000","last_peered":"2023-12-22T08:40:48.398284+0000","last_clean":"2023-12-22T08:40:48.398284+0000","last_became_active":"2023-12-22T08:40:45.505632+0000","last_became_peered":"2023-12-22T08:40:45.505632+0000","last_unstale":"2023-12-22T08:40:48.398284+0000","last_undegraded":"2023-12-22T08:40:48.398284+0000","last_fullsized":"2023-12-22T08:40:48.398284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947422+0000","last_change":"2023-12-22T08:40:45.892678+0000","last_active":"2023-12-22T08:40:47.947422+0000","last_peered":"2023-12-22T08:40:47.947422+0000","last_clean":"2023-12-22T08:40:47.947422+0000","last_became_active":"2023-12-22T08:40:45.892124+0000","last_became_peered":"2023-12-22T08:40:45.892124+0000","last_unstale":"2023-12-22T08:40:47.947422+0000","last_undegraded":"2023-12-22T08:40:47.947422+0000","last_fullsized":"2023-12-22T08:40:47.947422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:30.540430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398091+0000","last_change":"2023-12-22T08:40:45.508702+0000","last_active":"2023-12-22T08:40:48.398091+0000","last_peered":"2023-12-22T08:40:48.398091+0000","last_clean":"2023-12-22T08:40:48.398091+0000","last_became_active":"2023-12-22T08:40:45.508363+0000","last_became_peered":"2023-12-22T08:40:45.508363+0000","last_unstale":"2023-12-22T08:40:48.398091+0000","last_undegraded":"2023-12-22T08:40:48.398091+0000","last_fullsized":"2023-12-22T08:40:48.398091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398572+0000","last_change":"2023-12-22T08:40:45.891244+0000","last_active":"2023-12-22T08:40:48.398572+0000","last_peered":"2023-12-22T08:40:48.398572+0000","last_clean":"2023-12-22T08:40:48.398572+0000","last_became_active":"2023-12-22T08:40:45.890987+0000","last_became_peered":"2023-12-22T08:40:45.890987+0000","last_unstale":"2023-12-22T08:40:48.398572+0000","last_undegraded":"2023-12-22T08:40:48.398572+0000","last_fullsized":"2023-12-22T08:40:48.398572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:32:57.963627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-22T08:40:45.872970+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:40:45.872970+0000","last_peered":"2023-12-22T08:40:45.872970+0000","last_clean":"2023-12-22T08:40:45.872970+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:40:45.872970+0000","last_undegraded":"2023-12-22T08:40:45.872970+0000","last_fullsized":"2023-12-22T08:40:45.872970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947033+0000","last_change":"2023-12-22T08:40:45.502151+0000","last_active":"2023-12-22T08:40:47.947033+0000","last_peered":"2023-12-22T08:40:47.947033+0000","last_clean":"2023-12-22T08:40:47.947033+0000","last_became_active":"2023-12-22T08:40:45.501868+0000","last_became_peered":"2023-12-22T08:40:45.501868+0000","last_unstale":"2023-12-22T08:40:47.947033+0000","last_undegraded":"2023-12-22T08:40:47.947033+0000","last_fullsized":"2023-12-22T08:40:47.947033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868537+0000","last_change":"2023-12-22T08:40:45.892243+0000","last_active":"2023-12-22T08:40:46.868537+0000","last_peered":"2023-12-22T08:40:46.868537+0000","last_clean":"2023-12-22T08:40:46.868537+0000","last_became_active":"2023-12-22T08:40:45.892042+0000","last_became_peered":"2023-12-22T08:40:45.892042+0000","last_unstale":"2023-12-22T08:40:46.868537+0000","last_undegraded":"2023-12-22T08:40:46.868537+0000","last_fullsized":"2023-12-22T08:40:46.868537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:13:15.056903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398193+0000","last_change":"2023-12-22T08:40:45.508515+0000","last_active":"2023-12-22T08:40:48.398193+0000","last_peered":"2023-12-22T08:40:48.398193+0000","last_clean":"2023-12-22T08:40:48.398193+0000","last_became_active":"2023-12-22T08:40:45.508155+0000","last_became_peered":"2023-12-22T08:40:45.508155+0000","last_unstale":"2023-12-22T08:40:48.398193+0000","last_undegraded":"2023-12-22T08:40:48.398193+0000","last_fullsized":"2023-12-22T08:40:48.398193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868150+0000","last_change":"2023-12-22T08:40:45.875984+0000","last_active":"2023-12-22T08:40:46.868150+0000","last_peered":"2023-12-22T08:40:46.868150+0000","last_clean":"2023-12-22T08:40:46.868150+0000","last_became_active":"2023-12-22T08:40:45.875646+0000","last_became_peered":"2023-12-22T08:40:45.875646+0000","last_unstale":"2023-12-22T08:40:46.868150+0000","last_undegraded":"2023-12-22T08:40:46.868150+0000","last_fullsized":"2023-12-22T08:40:46.868150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.397864+0000","last_change":"2023-12-22T08:40:45.513879+0000","last_active":"2023-12-22T08:40:48.397864+0000","last_peered":"2023-12-22T08:40:48.397864+0000","last_clean":"2023-12-22T08:40:48.397864+0000","last_became_active":"2023-12-22T08:40:45.513329+0000","last_became_peered":"2023-12-22T08:40:45.513329+0000","last_unstale":"2023-12-22T08:40:48.397864+0000","last_undegraded":"2023-12-22T08:40:48.397864+0000","last_fullsized":"2023-12-22T08:40:48.397864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398049+0000","last_change":"2023-12-22T08:40:45.883287+0000","last_active":"2023-12-22T08:40:48.398049+0000","last_peered":"2023-12-22T08:40:48.398049+0000","last_clean":"2023-12-22T08:40:48.398049+0000","last_became_active":"2023-12-22T08:40:45.883029+0000","last_became_peered":"2023-12-22T08:40:45.883029+0000","last_unstale":"2023-12-22T08:40:48.398049+0000","last_undegraded":"2023-12-22T08:40:48.398049+0000","last_fullsized":"2023-12-22T08:40:48.398049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:51:18.636850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947366+0000","last_change":"2023-12-22T08:40:45.506897+0000","last_active":"2023-12-22T08:40:47.947366+0000","last_peered":"2023-12-22T08:40:47.947366+0000","last_clean":"2023-12-22T08:40:47.947366+0000","last_became_active":"2023-12-22T08:40:45.506629+0000","last_became_peered":"2023-12-22T08:40:45.506629+0000","last_unstale":"2023-12-22T08:40:47.947366+0000","last_undegraded":"2023-12-22T08:40:47.947366+0000","last_fullsized":"2023-12-22T08:40:47.947366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869291+0000","last_change":"2023-12-22T08:40:45.881933+0000","last_active":"2023-12-22T08:40:46.869291+0000","last_peered":"2023-12-22T08:40:46.869291+0000","last_clean":"2023-12-22T08:40:46.869291+0000","last_became_active":"2023-12-22T08:40:45.881668+0000","last_became_peered":"2023-12-22T08:40:45.881668+0000","last_unstale":"2023-12-22T08:40:46.869291+0000","last_undegraded":"2023-12-22T08:40:46.869291+0000","last_fullsized":"2023-12-22T08:40:46.869291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:45.489511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398192+0000","last_change":"2023-12-22T08:40:45.510517+0000","last_active":"2023-12-22T08:40:48.398192+0000","last_peered":"2023-12-22T08:40:48.398192+0000","last_clean":"2023-12-22T08:40:48.398192+0000","last_became_active":"2023-12-22T08:40:45.510251+0000","last_became_peered":"2023-12-22T08:40:45.510251+0000","last_unstale":"2023-12-22T08:40:48.398192+0000","last_undegraded":"2023-12-22T08:40:48.398192+0000","last_fullsized":"2023-12-22T08:40:48.398192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:04.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947392+0000","last_change":"2023-12-22T08:40:45.893451+0000","last_active":"2023-12-22T08:40:47.947392+0000","last_peered":"2023-12-22T08:40:47.947392+0000","last_clean":"2023-12-22T08:40:47.947392+0000","last_became_active":"2023-12-22T08:40:45.893164+0000","last_became_peered":"2023-12-22T08:40:45.893164+0000","last_unstale":"2023-12-22T08:40:47.947392+0000","last_undegraded":"2023-12-22T08:40:47.947392+0000","last_fullsized":"2023-12-22T08:40:47.947392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:41:59.148169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398723+0000","last_change":"2023-12-22T08:40:45.512956+0000","last_active":"2023-12-22T08:40:48.398723+0000","last_peered":"2023-12-22T08:40:48.398723+0000","last_clean":"2023-12-22T08:40:48.398723+0000","last_became_active":"2023-12-22T08:40:45.512647+0000","last_became_peered":"2023-12-22T08:40:45.512647+0000","last_unstale":"2023-12-22T08:40:48.398723+0000","last_undegraded":"2023-12-22T08:40:48.398723+0000","last_fullsized":"2023-12-22T08:40:48.398723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:12:03.015743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398318+0000","last_change":"2023-12-22T08:40:45.879030+0000","last_active":"2023-12-22T08:40:48.398318+0000","last_peered":"2023-12-22T08:40:48.398318+0000","last_clean":"2023-12-22T08:40:48.398318+0000","last_became_active":"2023-12-22T08:40:45.878738+0000","last_became_peered":"2023-12-22T08:40:45.878738+0000","last_unstale":"2023-12-22T08:40:48.398318+0000","last_undegraded":"2023-12-22T08:40:48.398318+0000","last_fullsized":"2023-12-22T08:40:48.398318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:16:37.651925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.799237+0000","last_change":"2023-12-22T08:40:45.504141+0000","last_active":"2023-12-22T08:40:48.799237+0000","last_peered":"2023-12-22T08:40:48.799237+0000","last_clean":"2023-12-22T08:40:48.799237+0000","last_became_active":"2023-12-22T08:40:45.503853+0000","last_became_peered":"2023-12-22T08:40:45.503853+0000","last_unstale":"2023-12-22T08:40:48.799237+0000","last_undegraded":"2023-12-22T08:40:48.799237+0000","last_fullsized":"2023-12-22T08:40:48.799237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:34.514323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869172+0000","last_change":"2023-12-22T08:40:45.886077+0000","last_active":"2023-12-22T08:40:46.869172+0000","last_peered":"2023-12-22T08:40:46.869172+0000","last_clean":"2023-12-22T08:40:46.869172+0000","last_became_active":"2023-12-22T08:40:45.885810+0000","last_became_peered":"2023-12-22T08:40:45.885810+0000","last_unstale":"2023-12-22T08:40:46.869172+0000","last_undegraded":"2023-12-22T08:40:46.869172+0000","last_fullsized":"2023-12-22T08:40:46.869172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:06:12.985228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.975100+0000","last_change":"2023-12-22T08:40:45.508614+0000","last_active":"2023-12-22T08:40:47.975100+0000","last_peered":"2023-12-22T08:40:47.975100+0000","last_clean":"2023-12-22T08:40:47.975100+0000","last_became_active":"2023-12-22T08:40:45.508360+0000","last_became_peered":"2023-12-22T08:40:45.508360+0000","last_unstale":"2023-12-22T08:40:47.975100+0000","last_undegraded":"2023-12-22T08:40:47.975100+0000","last_fullsized":"2023-12-22T08:40:47.975100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868357+0000","last_change":"2023-12-22T08:40:45.873932+0000","last_active":"2023-12-22T08:40:46.868357+0000","last_peered":"2023-12-22T08:40:46.868357+0000","last_clean":"2023-12-22T08:40:46.868357+0000","last_became_active":"2023-12-22T08:40:45.873690+0000","last_became_peered":"2023-12-22T08:40:45.873690+0000","last_unstale":"2023-12-22T08:40:46.868357+0000","last_undegraded":"2023-12-22T08:40:46.868357+0000","last_fullsized":"2023-12-22T08:40:46.868357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:51:49.322300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398164+0000","last_change":"2023-12-22T08:40:45.513413+0000","last_active":"2023-12-22T08:40:48.398164+0000","last_peered":"2023-12-22T08:40:48.398164+0000","last_clean":"2023-12-22T08:40:48.398164+0000","last_became_active":"2023-12-22T08:40:45.512578+0000","last_became_peered":"2023-12-22T08:40:45.512578+0000","last_unstale":"2023-12-22T08:40:48.398164+0000","last_undegraded":"2023-12-22T08:40:48.398164+0000","last_fullsized":"2023-12-22T08:40:48.398164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:25:04.462376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869079+0000","last_change":"2023-12-22T08:40:45.884963+0000","last_active":"2023-12-22T08:40:46.869079+0000","last_peered":"2023-12-22T08:40:46.869079+0000","last_clean":"2023-12-22T08:40:46.869079+0000","last_became_active":"2023-12-22T08:40:45.884695+0000","last_became_peered":"2023-12-22T08:40:45.884695+0000","last_unstale":"2023-12-22T08:40:46.869079+0000","last_undegraded":"2023-12-22T08:40:46.869079+0000","last_fullsized":"2023-12-22T08:40:46.869079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:20:35.519308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398062+0000","last_change":"2023-12-22T08:40:45.507307+0000","last_active":"2023-12-22T08:40:48.398062+0000","last_peered":"2023-12-22T08:40:48.398062+0000","last_clean":"2023-12-22T08:40:48.398062+0000","last_became_active":"2023-12-22T08:40:45.506990+0000","last_became_peered":"2023-12-22T08:40:45.506990+0000","last_unstale":"2023-12-22T08:40:48.398062+0000","last_undegraded":"2023-12-22T08:40:48.398062+0000","last_fullsized":"2023-12-22T08:40:48.398062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:01:12.713656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868827+0000","last_change":"2023-12-22T08:40:45.884456+0000","last_active":"2023-12-22T08:40:46.868827+0000","last_peered":"2023-12-22T08:40:46.868827+0000","last_clean":"2023-12-22T08:40:46.868827+0000","last_became_active":"2023-12-22T08:40:45.884201+0000","last_became_peered":"2023-12-22T08:40:45.884201+0000","last_unstale":"2023-12-22T08:40:46.868827+0000","last_undegraded":"2023-12-22T08:40:46.868827+0000","last_fullsized":"2023-12-22T08:40:46.868827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398187+0000","last_change":"2023-12-22T08:40:45.515513+0000","last_active":"2023-12-22T08:40:48.398187+0000","last_peered":"2023-12-22T08:40:48.398187+0000","last_clean":"2023-12-22T08:40:48.398187+0000","last_became_active":"2023-12-22T08:40:45.515195+0000","last_became_peered":"2023-12-22T08:40:45.515195+0000","last_unstale":"2023-12-22T08:40:48.398187+0000","last_undegraded":"2023-12-22T08:40:48.398187+0000","last_fullsized":"2023-12-22T08:40:48.398187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:56:45.834574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869019+0000","last_change":"2023-12-22T08:40:45.887878+0000","last_active":"2023-12-22T08:40:46.869019+0000","last_peered":"2023-12-22T08:40:46.869019+0000","last_clean":"2023-12-22T08:40:46.869019+0000","last_became_active":"2023-12-22T08:40:45.887636+0000","last_became_peered":"2023-12-22T08:40:45.887636+0000","last_unstale":"2023-12-22T08:40:46.869019+0000","last_undegraded":"2023-12-22T08:40:46.869019+0000","last_fullsized":"2023-12-22T08:40:46.869019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:24:25.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398552+0000","last_change":"2023-12-22T08:40:45.508892+0000","last_active":"2023-12-22T08:40:48.398552+0000","last_peered":"2023-12-22T08:40:48.398552+0000","last_clean":"2023-12-22T08:40:48.398552+0000","last_became_active":"2023-12-22T08:40:45.508596+0000","last_became_peered":"2023-12-22T08:40:45.508596+0000","last_unstale":"2023-12-22T08:40:48.398552+0000","last_undegraded":"2023-12-22T08:40:48.398552+0000","last_fullsized":"2023-12-22T08:40:48.398552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:07:25.292485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.974883+0000","last_change":"2023-12-22T08:40:45.882288+0000","last_active":"2023-12-22T08:40:47.974883+0000","last_peered":"2023-12-22T08:40:47.974883+0000","last_clean":"2023-12-22T08:40:47.974883+0000","last_became_active":"2023-12-22T08:40:45.882025+0000","last_became_peered":"2023-12-22T08:40:45.882025+0000","last_unstale":"2023-12-22T08:40:47.974883+0000","last_undegraded":"2023-12-22T08:40:47.974883+0000","last_fullsized":"2023-12-22T08:40:47.974883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947348+0000","last_change":"2023-12-22T08:40:45.889079+0000","last_active":"2023-12-22T08:40:47.947348+0000","last_peered":"2023-12-22T08:40:47.947348+0000","last_clean":"2023-12-22T08:40:47.947348+0000","last_became_active":"2023-12-22T08:40:45.888545+0000","last_became_peered":"2023-12-22T08:40:45.888545+0000","last_unstale":"2023-12-22T08:40:47.947348+0000","last_undegraded":"2023-12-22T08:40:47.947348+0000","last_fullsized":"2023-12-22T08:40:47.947348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:57:56.595856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398487+0000","last_change":"2023-12-22T08:40:45.510991+0000","last_active":"2023-12-22T08:40:48.398487+0000","last_peered":"2023-12-22T08:40:48.398487+0000","last_clean":"2023-12-22T08:40:48.398487+0000","last_became_active":"2023-12-22T08:40:45.510738+0000","last_became_peered":"2023-12-22T08:40:45.510738+0000","last_unstale":"2023-12-22T08:40:48.398487+0000","last_undegraded":"2023-12-22T08:40:48.398487+0000","last_fullsized":"2023-12-22T08:40:48.398487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:47:44.484526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:47.947402+0000","last_change":"2023-12-22T08:40:45.890868+0000","last_active":"2023-12-22T08:40:47.947402+0000","last_peered":"2023-12-22T08:40:47.947402+0000","last_clean":"2023-12-22T08:40:47.947402+0000","last_became_active":"2023-12-22T08:40:45.890569+0000","last_became_peered":"2023-12-22T08:40:45.890569+0000","last_unstale":"2023-12-22T08:40:47.947402+0000","last_undegraded":"2023-12-22T08:40:47.947402+0000","last_fullsized":"2023-12-22T08:40:47.947402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:34:04.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:48.398584+0000","last_change":"2023-12-22T08:40:45.511043+0000","last_active":"2023-12-22T08:40:48.398584+0000","last_peered":"2023-12-22T08:40:48.398584+0000","last_clean":"2023-12-22T08:40:48.398584+0000","last_became_active":"2023-12-22T08:40:45.510756+0000","last_became_peered":"2023-12-22T08:40:45.510756+0000","last_unstale":"2023-12-22T08:40:48.398584+0000","last_undegraded":"2023-12-22T08:40:48.398584+0000","last_fullsized":"2023-12-22T08:40:48.398584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:08:44.176476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868465+0000","last_change":"2023-12-22T08:40:45.890415+0000","last_active":"2023-12-22T08:40:46.868465+0000","last_peered":"2023-12-22T08:40:46.868465+0000","last_clean":"2023-12-22T08:40:46.868465+0000","last_became_active":"2023-12-22T08:40:45.889396+0000","last_became_peered":"2023-12-22T08:40:45.889396+0000","last_unstale":"2023-12-22T08:40:46.868465+0000","last_undegraded":"2023-12-22T08:40:46.868465+0000","last_fullsized":"2023-12-22T08:40:46.868465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:32:47.894458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.869104+0000","last_change":"2023-12-22T08:40:45.515548+0000","last_active":"2023-12-22T08:40:46.869104+0000","last_peered":"2023-12-22T08:40:46.869104+0000","last_clean":"2023-12-22T08:40:46.869104+0000","last_became_active":"2023-12-22T08:40:45.515186+0000","last_became_peered":"2023-12-22T08:40:45.515186+0000","last_unstale":"2023-12-22T08:40:46.869104+0000","last_undegraded":"2023-12-22T08:40:46.869104+0000","last_fullsized":"2023-12-22T08:40:46.869104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:06:31.616826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868946+0000","last_change":"2023-12-22T08:40:45.891682+0000","last_active":"2023-12-22T08:40:46.868946+0000","last_peered":"2023-12-22T08:40:46.868946+0000","last_clean":"2023-12-22T08:40:46.868946+0000","last_became_active":"2023-12-22T08:40:45.891415+0000","last_became_peered":"2023-12-22T08:40:45.891415+0000","last_unstale":"2023-12-22T08:40:46.868946+0000","last_undegraded":"2023-12-22T08:40:46.868946+0000","last_fullsized":"2023-12-22T08:40:46.868946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:45.486877+0000","last_clean_scrub_stamp":"2023-12-22T08:40:45.486877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:27:00.778388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T08:40:46.868641+0000","last_change":"2023-12-22T08:40:45.510426+0000","last_active":"2023-12-22T08:40:46.868641+0000","last_peered":"2023-12-22T08:40:46.868641+0000","last_clean":"2023-12-22T08:40:46.868641+0000","last_became_active":"2023-12-22T08:40:45.510100+0000","last_became_peered":"2023-12-22T08:40:45.510100+0000","last_unstale":"2023-12-22T08:40:46.868641+0000","last_undegraded":"2023-12-22T08:40:46.868641+0000","last_fullsized":"2023-12-22T08:40:46.868641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:44.481892+0000","last_clean_scrub_stamp":"2023-12-22T08:40:44.481892+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:42:09.023627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:40:54.616 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-22T08:40:54.616 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-22T08:40:54.616 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-22T08:40:54.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-22T08:40:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.753+0000 7fd1c3fe0640 1 Processor -- start 2023-12-22T08:40:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.753+0000 7fd1c3fe0640 1 -- start start 2023-12-22T08:40:54.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.754+0000 7fd1c3fe0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1bc145110 0x7fd1bc070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.754+0000 7fd1c3fe0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1bc06a170 0x7fd1bc1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.754+0000 7fd1c3fe0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc14bbe0 con 0x7fd1bc069d00 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.754+0000 7fd1c3fe0640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0b7230 con 0x7fd1bc145110 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.754+0000 7fd1c3fe0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc14b750 con 0x7fd1bc06a170 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.754+0000 7fd1c157b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd1bc069d00 0x7fd1bc0b7a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47208/0 (socket says 172.21.15.31:47208) 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.754+0000 7fd1c157b640 1 -- 172.21.15.31:0/4175421111 learned_addr learned my addr 172.21.15.31:0/4175421111 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c1d7c640 1 --2- 172.21.15.31:0/4175421111 >> v2:172.21.15.69:3300/0 conn(0x7fd1bc145110 0x7fd1bc070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c257d640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1bc06a170 0x7fd1bc1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216360462 0 0) 0x7fd1bc14bbe0 con 0x7fd1bc069d00 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a8003520 con 0x7fd1bc069d00 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 525791344 0 0) 0x7fd1a8003520 con 0x7fd1bc069d00 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1bc06a170 msgr2=0x7fd1bc1554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1bc06a170 0x7fd1bc1554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 >> v2:172.21.15.69:3300/0 conn(0x7fd1bc145110 msgr2=0x7fd1bc070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 --2- 172.21.15.31:0/4175421111 >> v2:172.21.15.69:3300/0 conn(0x7fd1bc145110 0x7fd1bc070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc14ae20 con 0x7fd1bc069d00 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7fd1ac001670 con 0x7fd1bc069d00 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 >> v1:172.21.15.31:6789/0 conn(0x7fd1bc069d00 legacy=0x7fd1bc0b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a8003970 0x7fd1a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a80047c0 0x7fd1a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1bc06a170 0x7fd1a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0b7230 con 0x7fd1a8003970 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc14b750 con 0x7fd1a80047c0 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a800b980 con 0x7fd1bc06a170 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c1d7c640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a8003970 0x7fd1a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c157b640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a80047c0 0x7fd1a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c257d640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1bc06a170 0x7fd1a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c1d7c640 1 -- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1bc06a170 msgr2=0x7fd1a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c1d7c640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1bc06a170 0x7fd1a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c1d7c640 1 -- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a80047c0 msgr2=0x7fd1a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c1d7c640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a80047c0 0x7fd1a8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.755+0000 7fd1c1d7c640 1 -- 172.21.15.31:0/4175421111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8003520 con 0x7fd1a8003970 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.756+0000 7fd1c1d7c640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a8003970 0x7fd1a8003d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009af0 tx=0x7fd1a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620f4b862c131390 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.756+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b802c710 con 0x7fd1a8003970 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.756+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b802c870 con 0x7fd1a8003970 2023-12-22T08:40:54.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.756+0000 7fd1c0d7a640 1 -- 172.21.15.31:0/4175421111 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b802cc00 con 0x7fd1a8003970 2023-12-22T08:40:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.757+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/4175421111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a8003970 msgr2=0x7fd1a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.757+0000 7fd1c3fe0640 1 --2- 172.21.15.31:0/4175421111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a8003970 0x7fd1a8003d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009af0 tx=0x7fd1a80057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.757+0000 7fd1c257d640 1 -- 172.21.15.31:0/4175421111 reap_dead start 2023-12-22T08:40:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.757+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/4175421111 shutdown_connections 2023-12-22T08:40:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.757+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/4175421111 >> 172.21.15.31:0/4175421111 conn(0x7fd1bc0bd060 msgr2=0x7fd1bc0bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.757+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/4175421111 shutdown_connections 2023-12-22T08:40:54.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.757+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/4175421111 wait complete. 2023-12-22T08:40:54.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.758+0000 7fd1c3fe0640 1 Processor -- start 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.758+0000 7fd1c3fe0640 1 -- start start 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.758+0000 7fd1c3fe0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1a8003970 0x7fd1bc1e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c3fe0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1bc1d1f50 0x7fd1bc1422e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c3fe0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc1d23b0 0x7fd1bc13fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c3fe0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1e3350 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c3fe0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1e35c0 con 0x7fd1bc1d23b0 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c3fe0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1d13b0 con 0x7fd1a8003970 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1bc1d1f50 0x7fd1bc1422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1bc1d1f50 0x7fd1bc1422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39500/0 (socket says 172.21.15.31:39500) 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 -- 172.21.15.31:0/2933222048 learned_addr learned my addr 172.21.15.31:0/2933222048 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c1d7c640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1a8003970 0x7fd1bc1e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 -- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1a8003970 msgr2=0x7fd1bc1e3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1a8003970 0x7fd1bc1e3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 -- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc1d23b0 msgr2=0x7fd1bc13fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc1d23b0 0x7fd1bc13fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 -- 172.21.15.31:0/2933222048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc148460 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c157b640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1bc1d1f50 0x7fd1bc1422e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac007340 tx=0x7fd1ac007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1b27fc640 1 -- 172.21.15.31:0/2933222048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00f840 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1b27fc640 1 -- 172.21.15.31:0/2933222048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00f9c0 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1b27fc640 1 -- 172.21.15.31:0/2933222048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00fd70 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc147f90 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.759+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc146fc0 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.760+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc073a40 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.761+0000 7fd1b27fc640 1 -- 172.21.15.31:0/2933222048 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1ac01d460 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.761+0000 7fd1b27fc640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1a006a430 0x7fd1a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:54.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.761+0000 7fd1b27fc640 1 -- 172.21.15.31:0/2933222048 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1ac088ac0 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.761+0000 7fd1c1d7c640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1a006a430 0x7fd1a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:54.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.762+0000 7fd1c1d7c640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1a006a430 0x7fd1a006c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8036000 tx=0x7fd1b8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:54.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.765+0000 7fd1b27fc640 1 -- 172.21.15.31:0/2933222048 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd1ac054140 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.978+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd1bc0bdca0 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.979+0000 7fd1b27fc640 1 -- 172.21.15.31:0/2933222048 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd1ac088e60 con 0x7fd1bc1d1f50 2023-12-22T08:40:54.982 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:54.982 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1a006a430 msgr2=0x7fd1a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1a006a430 0x7fd1a006c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8036000 tx=0x7fd1b8030000 comp rx=0 tx=0).stop 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1bc1d1f50 msgr2=0x7fd1bc1422e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1bc1d1f50 0x7fd1bc1422e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac007340 tx=0x7fd1ac007800 comp rx=0 tx=0).stop 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 shutdown_connections 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd1a006a430 0x7fd1a006c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1bc1d23b0 0x7fd1bc13fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1bc1d1f50 0x7fd1bc1422e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 --2- 172.21.15.31:0/2933222048 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1a8003970 0x7fd1bc1e3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 >> 172.21.15.31:0/2933222048 conn(0x7fd1bc0bd060 msgr2=0x7fd1bc070350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:54.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 shutdown_connections 2023-12-22T08:40:54.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:54.981+0000 7fd1c3fe0640 1 -- 172.21.15.31:0/2933222048 wait complete. 2023-12-22T08:40:54.994 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-22T08:40:54.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:55.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6ac165f640 1 Processor -- start 2023-12-22T08:40:55.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6ac165f640 1 -- start start 2023-12-22T08:40:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6ac165f640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6abc06a6d0 0x7f6abc14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6ac165f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6ac165f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc0bb310 con 0x7f6abc14b1f0 2023-12-22T08:40:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6ac165f640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0bf960 con 0x7f6abc06a6d0 2023-12-22T08:40:55.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6ac165f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0bb5b0 con 0x7f6abc0ba550 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6aba7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6abc14b1f0 0x7f6abc0b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47220/0 (socket says 172.21.15.31:47220) 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.097+0000 7f6aba7fc640 1 -- 172.21.15.31:0/3483068213 learned_addr learned my addr 172.21.15.31:0/3483068213 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6abaffd640 1 --2- 172.21.15.31:0/3483068213 >> v2:172.21.15.69:3300/0 conn(0x7f6abc06a6d0 0x7f6abc14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6abb7fe640 1 --2- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6ab9ffb640 1 -- 172.21.15.31:0/3483068213 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277000259 0 0) 0x7f6abc0bb310 con 0x7f6abc14b1f0 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6ab9ffb640 1 -- 172.21.15.31:0/3483068213 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa4003520 con 0x7f6abc14b1f0 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6abaffd640 1 -- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 msgr2=0x7f6abc1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6abaffd640 1 --2- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6abaffd640 1 -- 172.21.15.31:0/3483068213 >> v1:172.21.15.31:6789/0 conn(0x7f6abc14b1f0 legacy=0x7f6abc0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6ab9ffb640 1 -- 172.21.15.31:0/3483068213 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3176059312 0 0) 0x7f6aa4003520 con 0x7f6abc14b1f0 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6abaffd640 1 -- 172.21.15.31:0/3483068213 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0c0120 con 0x7f6abc06a6d0 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.098+0000 7f6abb7fe640 1 --2- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.099+0000 7f6abaffd640 1 --2- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 0x7f6abc14acb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009d90 tx=0x7f6aac02bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75cbe70f645a8f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.099+0000 7f6ab9ffb640 1 -- 172.21.15.31:0/3483068213 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0001670 con 0x7f6abc06a6d0 2023-12-22T08:40:55.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.099+0000 7f6ab9ffb640 1 -- 172.21.15.31:0/3483068213 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac02c8a0 con 0x7f6abc06a6d0 2023-12-22T08:40:55.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.099+0000 7f6ab9ffb640 1 -- 172.21.15.31:0/3483068213 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac02cc10 con 0x7f6abc06a6d0 2023-12-22T08:40:55.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.099+0000 7f6ac165f640 1 -- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 msgr2=0x7f6abc14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.099+0000 7f6ac165f640 1 --2- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 0x7f6abc14acb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009d90 tx=0x7f6aac02bd70 comp rx=0 tx=0).stop 2023-12-22T08:40:55.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.100+0000 7f6ac165f640 1 -- 172.21.15.31:0/3483068213 shutdown_connections 2023-12-22T08:40:55.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.100+0000 7f6ac165f640 1 --2- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.100+0000 7f6ac165f640 1 --2- 172.21.15.31:0/3483068213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 0x7f6abc14acb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.100+0000 7f6ac165f640 1 -- 172.21.15.31:0/3483068213 >> 172.21.15.31:0/3483068213 conn(0x7f6abc0c0350 msgr2=0x7f6abc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.100+0000 7f6ac165f640 1 -- 172.21.15.31:0/3483068213 shutdown_connections 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.100+0000 7f6ac165f640 1 -- 172.21.15.31:0/3483068213 wait complete. 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6ac165f640 1 Processor -- start 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6ac165f640 1 -- start start 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6ac165f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 0x7f6abc1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6ac165f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6ac165f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6abc14b1f0 0x7f6abc1e3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6ac165f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b3b40 con 0x7f6abc14b1f0 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6ac165f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc149e30 con 0x7f6abc06a6d0 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6ac165f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0a5c10 con 0x7f6abc0ba550 2023-12-22T08:40:55.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6abb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6abc14b1f0 0x7f6abc1e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6abb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6abc14b1f0 0x7f6abc1e3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39502/0 (socket says 172.21.15.31:39502) 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.101+0000 7f6abb7fe640 1 -- 172.21.15.31:0/2061260633 learned_addr learned my addr 172.21.15.31:0/2061260633 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6aba7fc640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6abaffd640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 0x7f6abc1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6abb7fe640 1 -- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 msgr2=0x7f6abc14ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6abb7fe640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc14ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6abb7fe640 1 -- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 msgr2=0x7f6abc1498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6abb7fe640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 0x7f6abc1498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6abb7fe640 1 -- 172.21.15.31:0/2061260633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab4009400 con 0x7f6abc14b1f0 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6abb7fe640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6abc14b1f0 0x7f6abc1e3490 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400e930 tx=0x7f6ab400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6aa37fe640 1 -- 172.21.15.31:0/2061260633 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4009700 con 0x7f6abc14b1f0 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6aa37fe640 1 -- 172.21.15.31:0/2061260633 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab400ca00 con 0x7f6abc14b1f0 2023-12-22T08:40:55.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac009a70 con 0x7f6abc14b1f0 2023-12-22T08:40:55.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6aa37fe640 1 -- 172.21.15.31:0/2061260633 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab400cdb0 con 0x7f6abc14b1f0 2023-12-22T08:40:55.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.102+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc0a55c0 con 0x7f6abc14b1f0 2023-12-22T08:40:55.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.103+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc0a5dc0 con 0x7f6abc14b1f0 2023-12-22T08:40:55.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.104+0000 7f6aa37fe640 1 -- 172.21.15.31:0/2061260633 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ab4013470 con 0x7f6abc14b1f0 2023-12-22T08:40:55.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.104+0000 7f6aa37fe640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6aa806a460 0x7f6aa806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.104+0000 7f6aa37fe640 1 -- 172.21.15.31:0/2061260633 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ab4088aa0 con 0x7f6abc14b1f0 2023-12-22T08:40:55.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.104+0000 7f6abaffd640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6aa806a460 0x7f6aa806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.105+0000 7f6abaffd640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6aa806a460 0x7f6aa806c920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6aac036000 tx=0x7f6aac030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.108+0000 7f6aa37fe640 1 -- 172.21.15.31:0/2061260633 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6abc0a5dc0 con 0x7f6abc14b1f0 2023-12-22T08:40:55.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.284+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6abc0a5dc0 con 0x7f6abc14b1f0 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.285+0000 7f6aa37fe640 1 -- 172.21.15.31:0/2061260633 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f6abc0a5dc0 con 0x7f6abc14b1f0 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:55.287 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6aa806a460 msgr2=0x7f6aa806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6aa806a460 0x7f6aa806c920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6aac036000 tx=0x7f6aac030000 comp rx=0 tx=0).stop 2023-12-22T08:40:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6abc14b1f0 msgr2=0x7f6abc1e3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6abc14b1f0 0x7f6abc1e3490 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400e930 tx=0x7f6ab400edf0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 shutdown_connections 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6aa806a460 0x7f6aa806c920 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6abc14b1f0 0x7f6abc1e3490 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6abc0ba550 0x7f6abc14ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 --2- 172.21.15.31:0/2061260633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6abc06a6d0 0x7f6abc1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 >> 172.21.15.31:0/2061260633 conn(0x7f6abc0c0350 msgr2=0x7f6abc09fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 shutdown_connections 2023-12-22T08:40:55.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.287+0000 7f6ac165f640 1 -- 172.21.15.31:0/2061260633 wait complete. 2023-12-22T08:40:55.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:55.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:55.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.406+0000 7fe987df0640 1 Processor -- start 2023-12-22T08:40:55.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.407+0000 7fe987df0640 1 -- start start 2023-12-22T08:40:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.407+0000 7fe987df0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe9800b8690 0x7fe9800b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.407+0000 7fe987df0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe980144d80 0x7fe98014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.407+0000 7fe987df0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98014ab10 con 0x7fe9800b77d0 2023-12-22T08:40:55.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.407+0000 7fe987df0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98006c2f0 con 0x7fe980144d80 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.407+0000 7fe987df0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9800ba620 con 0x7fe9800b8690 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.407+0000 7fe98638d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe980144d80 0x7fe98014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.407+0000 7fe98638d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe980144d80 0x7fe98014afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39512/0 (socket says 172.21.15.31:39512) 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.408+0000 7fe98638d640 1 -- 172.21.15.31:0/3539198508 learned_addr learned my addr 172.21.15.31:0/3539198508 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.408+0000 7fe985b8c640 1 --2- 172.21.15.31:0/3539198508 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe9800b8690 0x7fe9800b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.408+0000 7fe98638d640 1 -- 172.21.15.31:0/3539198508 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe9800b8690 msgr2=0x7fe9800b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.408+0000 7fe98638d640 1 --2- 172.21.15.31:0/3539198508 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe9800b8690 0x7fe9800b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.408+0000 7fe98638d640 1 -- 172.21.15.31:0/3539198508 >> v1:172.21.15.69:6789/0 conn(0x7fe9800b77d0 legacy=0x7fe980144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.408+0000 7fe98638d640 1 -- 172.21.15.31:0/3539198508 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800b9e60 con 0x7fe980144d80 2023-12-22T08:40:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe98638d640 1 --2- 172.21.15.31:0/3539198508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980144d80 0x7fe98014afa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe970009e50 tx=0x7fe97002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac122fdd0bddd95 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe984b8a640 1 -- 172.21.15.31:0/3539198508 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97002ca70 con 0x7fe980144d80 2023-12-22T08:40:55.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe984b8a640 1 -- 172.21.15.31:0/3539198508 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97002cbd0 con 0x7fe980144d80 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe984b8a640 1 -- 172.21.15.31:0/3539198508 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9700343f0 con 0x7fe980144d80 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe987df0640 1 -- 172.21.15.31:0/3539198508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980144d80 msgr2=0x7fe98014afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe987df0640 1 --2- 172.21.15.31:0/3539198508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980144d80 0x7fe98014afa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe970009e50 tx=0x7fe97002bed0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe987df0640 1 -- 172.21.15.31:0/3539198508 shutdown_connections 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe987df0640 1 --2- 172.21.15.31:0/3539198508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe980144d80 0x7fe98014afa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe987df0640 1 --2- 172.21.15.31:0/3539198508 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe9800b8690 0x7fe9800b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe987df0640 1 -- 172.21.15.31:0/3539198508 >> 172.21.15.31:0/3539198508 conn(0x7fe98006b6a0 msgr2=0x7fe98006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe987df0640 1 -- 172.21.15.31:0/3539198508 shutdown_connections 2023-12-22T08:40:55.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.409+0000 7fe987df0640 1 -- 172.21.15.31:0/3539198508 wait complete. 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.410+0000 7fe987df0640 1 Processor -- start 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.410+0000 7fe987df0640 1 -- start start 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe987df0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9800b77d0 0x7fe980147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe987df0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9800b8690 0x7fe9801456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe987df0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe980144d80 0x7fe980137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe987df0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9801468e0 con 0x7fe9800b8690 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe987df0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe980148ad0 con 0x7fe9800b77d0 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe987df0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9801415a0 con 0x7fe980144d80 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98538b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9800b8690 0x7fe9801456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98538b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9800b8690 0x7fe9801456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39514/0 (socket says 172.21.15.31:39514) 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98538b640 1 -- 172.21.15.31:0/788608059 learned_addr learned my addr 172.21.15.31:0/788608059 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98638d640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe980144d80 0x7fe980137e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe985b8c640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9800b77d0 0x7fe980147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98538b640 1 -- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe980144d80 msgr2=0x7fe980137e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98538b640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe980144d80 0x7fe980137e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98538b640 1 -- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9800b77d0 msgr2=0x7fe980147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98538b640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9800b77d0 0x7fe980147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98538b640 1 -- 172.21.15.31:0/788608059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970009b30 con 0x7fe9800b8690 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe985b8c640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9800b77d0 0x7fe980147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.411+0000 7fe98638d640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe980144d80 0x7fe980137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.412+0000 7fe98538b640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9800b8690 0x7fe9801456f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe97400c450 tx=0x7fe97400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.412+0000 7fe97e7fc640 1 -- 172.21.15.31:0/788608059 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9740052d0 con 0x7fe9800b8690 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.412+0000 7fe97e7fc640 1 -- 172.21.15.31:0/788608059 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe974005430 con 0x7fe9800b8690 2023-12-22T08:40:55.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.412+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9801492d0 con 0x7fe9800b8690 2023-12-22T08:40:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.412+0000 7fe97e7fc640 1 -- 172.21.15.31:0/788608059 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974012870 con 0x7fe9800b8690 2023-12-22T08:40:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.412+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe980148ef0 con 0x7fe9800b8690 2023-12-22T08:40:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.413+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe980149510 con 0x7fe9800b8690 2023-12-22T08:40:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.413+0000 7fe97e7fc640 1 -- 172.21.15.31:0/788608059 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe9740129d0 con 0x7fe9800b8690 2023-12-22T08:40:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.413+0000 7fe97e7fc640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.414+0000 7fe97e7fc640 1 -- 172.21.15.31:0/788608059 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe974088480 con 0x7fe9800b8690 2023-12-22T08:40:55.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.414+0000 7fe985b8c640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.414+0000 7fe985b8c640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe978009ac0 tx=0x7fe978008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.418+0000 7fe97e7fc640 1 -- 172.21.15.31:0/788608059 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe980149510 con 0x7fe9800b8690 2023-12-22T08:40:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.592+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe980149510 con 0x7fe9800b8690 2023-12-22T08:40:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.593+0000 7fe97e7fc640 1 -- 172.21.15.31:0/788608059 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe980149510 con 0x7fe9800b8690 2023-12-22T08:40:55.595 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:40:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 msgr2=0x7fe96c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe978009ac0 tx=0x7fe978008040 comp rx=0 tx=0).stop 2023-12-22T08:40:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9800b8690 msgr2=0x7fe9801456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9800b8690 0x7fe9801456f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe97400c450 tx=0x7fe97400c910 comp rx=0 tx=0).stop 2023-12-22T08:40:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 shutdown_connections 2023-12-22T08:40:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe980144d80 0x7fe980137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9800b8690 0x7fe9801456f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 --2- 172.21.15.31:0/788608059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9800b77d0 0x7fe980147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 >> 172.21.15.31:0/788608059 conn(0x7fe98006b6a0 msgr2=0x7fe9800b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 shutdown_connections 2023-12-22T08:40:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.594+0000 7fe987df0640 1 -- 172.21.15.31:0/788608059 wait complete. 2023-12-22T08:40:55.608 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.716+0000 7f3aed6f7640 1 Processor -- start 2023-12-22T08:40:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.716+0000 7f3aed6f7640 1 -- start start 2023-12-22T08:40:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.716+0000 7f3aed6f7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae814e540 0x7f3ae814e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.716+0000 7f3aed6f7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae814eeb0 con 0x7f3ae80b8cf0 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.716+0000 7f3aed6f7640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae806e0a0 con 0x7f3ae806dac0 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.716+0000 7f3aed6f7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae806e940 con 0x7f3ae814e540 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.716+0000 7f3ae6ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3ae80b8cf0 0x7f3ae80703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47230/0 (socket says 172.21.15.31:47230) 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.716+0000 7f3ae6ffd640 1 -- 172.21.15.31:0/1340959793 learned_addr learned my addr 172.21.15.31:0/1340959793 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.717+0000 7f3ae77fe640 1 --2- 172.21.15.31:0/1340959793 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae814e540 0x7f3ae814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.717+0000 7f3ae5ffb640 1 -- 172.21.15.31:0/1340959793 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787925376 0 0) 0x7f3ae814eeb0 con 0x7f3ae80b8cf0 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.717+0000 7f3ae5ffb640 1 -- 172.21.15.31:0/1340959793 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad0003520 con 0x7f3ae80b8cf0 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.717+0000 7f3ae77fe640 1 -- 172.21.15.31:0/1340959793 >> v1:172.21.15.69:6789/0 conn(0x7f3ae806dac0 legacy=0x7f3ae8144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.717+0000 7f3ae5ffb640 1 -- 172.21.15.31:0/1340959793 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 711939589 0 0) 0x7f3ad0003520 con 0x7f3ae80b8cf0 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.717+0000 7f3ae77fe640 1 -- 172.21.15.31:0/1340959793 >> v1:172.21.15.31:6789/0 conn(0x7f3ae80b8cf0 legacy=0x7f3ae80703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.717+0000 7f3ae77fe640 1 -- 172.21.15.31:0/1340959793 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae806e380 con 0x7f3ae814e540 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3ae77fe640 1 --2- 172.21.15.31:0/1340959793 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae814e540 0x7f3ae814e970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009dc0 tx=0x7f3ad802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b1638aa973e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3ae5ffb640 1 -- 172.21.15.31:0/1340959793 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0001670 con 0x7f3ae814e540 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3ae5ffb640 1 -- 172.21.15.31:0/1340959793 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad802c9a0 con 0x7f3ae814e540 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3ae5ffb640 1 -- 172.21.15.31:0/1340959793 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad802cd10 con 0x7f3ae814e540 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1340959793 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae814e540 msgr2=0x7f3ae814e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3aed6f7640 1 --2- 172.21.15.31:0/1340959793 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae814e540 0x7f3ae814e970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009dc0 tx=0x7f3ad802be70 comp rx=0 tx=0).stop 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1340959793 shutdown_connections 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3aed6f7640 1 --2- 172.21.15.31:0/1340959793 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae814e540 0x7f3ae814e970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1340959793 >> 172.21.15.31:0/1340959793 conn(0x7f3ae806ae10 msgr2=0x7f3ae806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1340959793 shutdown_connections 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.718+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1340959793 wait complete. 2023-12-22T08:40:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3aed6f7640 1 Processor -- start 2023-12-22T08:40:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3aed6f7640 1 -- start start 2023-12-22T08:40:55.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3aed6f7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae806dac0 0x7f3ae81436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3aed6f7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ae80b8cf0 0x7f3ae81e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3aed6f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae814e540 0x7f3ae809ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3aed6f7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae8143c30 con 0x7f3ae814e540 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3aed6f7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae81e39a0 con 0x7f3ae80b8cf0 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3aed6f7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae81e3c40 con 0x7f3ae806dac0 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3ae77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae814e540 0x7f3ae809ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3ae77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae814e540 0x7f3ae809ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39526/0 (socket says 172.21.15.31:39526) 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3ae77fe640 1 -- 172.21.15.31:0/1947162364 learned_addr learned my addr 172.21.15.31:0/1947162364 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3ae6ffd640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae806dac0 0x7f3ae81436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.720+0000 7f3ae67fc640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ae80b8cf0 0x7f3ae81e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3ae77fe640 1 -- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae806dac0 msgr2=0x7f3ae81436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3ae77fe640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae806dac0 0x7f3ae81436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3ae77fe640 1 -- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ae80b8cf0 msgr2=0x7f3ae81e03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3ae77fe640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ae80b8cf0 0x7f3ae81e03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3ae77fe640 1 -- 172.21.15.31:0/1947162364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad8009a70 con 0x7f3ae814e540 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3ae67fc640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ae80b8cf0 0x7f3ae81e03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3ae77fe640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae814e540 0x7f3ae809ebb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3ad802c480 tx=0x7f3ad8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3acf7fe640 1 -- 172.21.15.31:0/1947162364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8004250 con 0x7f3ae814e540 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae81e3f20 con 0x7f3ae814e540 2023-12-22T08:40:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3acf7fe640 1 -- 172.21.15.31:0/1947162364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad80043b0 con 0x7f3ae814e540 2023-12-22T08:40:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3acf7fe640 1 -- 172.21.15.31:0/1947162364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8004720 con 0x7f3ae814e540 2023-12-22T08:40:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.721+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae809d370 con 0x7f3ae814e540 2023-12-22T08:40:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.722+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae81e4440 con 0x7f3ae814e540 2023-12-22T08:40:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.723+0000 7f3acf7fe640 1 -- 172.21.15.31:0/1947162364 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ad8034440 con 0x7f3ae814e540 2023-12-22T08:40:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.723+0000 7f3acf7fe640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ad406a430 0x7f3ad406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:55.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.723+0000 7f3acf7fe640 1 -- 172.21.15.31:0/1947162364 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ad80ab280 con 0x7f3ae814e540 2023-12-22T08:40:55.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.723+0000 7f3ae6ffd640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ad406a430 0x7f3ad406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:55.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.724+0000 7f3ae6ffd640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ad406a430 0x7f3ad406c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0005880 tx=0x7f3ae0001da0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:55.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.727+0000 7f3acf7fe640 1 -- 172.21.15.31:0/1947162364 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ae81e4440 con 0x7f3ae814e540 2023-12-22T08:40:55.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.907+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ae81e4440 con 0x7f3ae814e540 2023-12-22T08:40:55.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.907+0000 7f3acf7fe640 1 -- 172.21.15.31:0/1947162364 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ae81e4440 con 0x7f3ae814e540 2023-12-22T08:40:55.910 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:40:55.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ad406a430 msgr2=0x7f3ad406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ad406a430 0x7f3ad406c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0005880 tx=0x7f3ae0001da0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae814e540 msgr2=0x7f3ae809ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:55.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae814e540 0x7f3ae809ebb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3ad802c480 tx=0x7f3ad8004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:55.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 shutdown_connections 2023-12-22T08:40:55.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ad406a430 0x7f3ad406c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae814e540 0x7f3ae809ebb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ae80b8cf0 0x7f3ae81e03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 --2- 172.21.15.31:0/1947162364 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ae806dac0 0x7f3ae81436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:55.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 >> 172.21.15.31:0/1947162364 conn(0x7f3ae806ae10 msgr2=0x7f3ae81449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:55.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 shutdown_connections 2023-12-22T08:40:55.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:55.909+0000 7f3aed6f7640 1 -- 172.21.15.31:0/1947162364 wait complete. 2023-12-22T08:40:55.922 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:56.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.029+0000 7fc692d6e640 1 Processor -- start 2023-12-22T08:40:56.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.029+0000 7fc692d6e640 1 -- start start 2023-12-22T08:40:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc692d6e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc68c0b77d0 0x7fc68c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc692d6e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c14ab10 con 0x7fc68c0b8690 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc692d6e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c06c2f0 con 0x7fc68c144d80 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc692d6e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c0ba620 con 0x7fc68c0b77d0 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc690b0a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc68c0b8690 0x7fc68c144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47246/0 (socket says 172.21.15.31:47246) 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc69130b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc68c0b77d0 0x7fc68c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc690b0a640 1 -- 172.21.15.31:0/76255899 learned_addr learned my addr 172.21.15.31:0/76255899 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc69130b640 1 -- 172.21.15.31:0/76255899 >> v1:172.21.15.69:6789/0 conn(0x7fc68c144d80 legacy=0x7fc68c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc69130b640 1 -- 172.21.15.31:0/76255899 >> v1:172.21.15.31:6789/0 conn(0x7fc68c0b8690 legacy=0x7fc68c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc68b7fe640 1 -- 172.21.15.31:0/76255899 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22784687 0 0) 0x7fc68c14ab10 con 0x7fc68c0b8690 2023-12-22T08:40:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.030+0000 7fc69130b640 1 -- 172.21.15.31:0/76255899 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0b9e60 con 0x7fc68c0b77d0 2023-12-22T08:40:56.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc69130b640 1 --2- 172.21.15.31:0/76255899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c0b8a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc684009d90 tx=0x7fc68402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b4740b318edb93 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc68b7fe640 1 -- 172.21.15.31:0/76255899 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68402cc60 con 0x7fc68c0b77d0 2023-12-22T08:40:56.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc68b7fe640 1 -- 172.21.15.31:0/76255899 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68402cdc0 con 0x7fc68c0b77d0 2023-12-22T08:40:56.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc68b7fe640 1 -- 172.21.15.31:0/76255899 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684034660 con 0x7fc68c0b77d0 2023-12-22T08:40:56.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc692d6e640 1 -- 172.21.15.31:0/76255899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 msgr2=0x7fc68c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc692d6e640 1 --2- 172.21.15.31:0/76255899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c0b8a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc684009d90 tx=0x7fc68402beb0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc692d6e640 1 -- 172.21.15.31:0/76255899 shutdown_connections 2023-12-22T08:40:56.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc692d6e640 1 --2- 172.21.15.31:0/76255899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c0b8a70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.031+0000 7fc692d6e640 1 -- 172.21.15.31:0/76255899 >> 172.21.15.31:0/76255899 conn(0x7fc68c06b6a0 msgr2=0x7fc68c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.032+0000 7fc692d6e640 1 -- 172.21.15.31:0/76255899 shutdown_connections 2023-12-22T08:40:56.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.032+0000 7fc692d6e640 1 -- 172.21.15.31:0/76255899 wait complete. 2023-12-22T08:40:56.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc692d6e640 1 Processor -- start 2023-12-22T08:40:56.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc692d6e640 1 -- start start 2023-12-22T08:40:56.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc692d6e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc692d6e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc68c0b8690 0x7fc68c145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc692d6e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc68c144d80 0x7fc68c1485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc692d6e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c147a40 con 0x7fc68c0b77d0 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc692d6e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c147ed0 con 0x7fc68c144d80 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc692d6e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c14a140 con 0x7fc68c0b8690 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc690b0a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc690b0a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c1497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39548/0 (socket says 172.21.15.31:39548) 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.033+0000 7fc690b0a640 1 -- 172.21.15.31:0/2958291002 learned_addr learned my addr 172.21.15.31:0/2958291002 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc69130b640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc68c144d80 0x7fc68c1485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc68bfff640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc68c0b8690 0x7fc68c145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc690b0a640 1 -- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc68c0b8690 msgr2=0x7fc68c145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc690b0a640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc68c0b8690 0x7fc68c145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc690b0a640 1 -- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc68c144d80 msgr2=0x7fc68c1485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc690b0a640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc68c144d80 0x7fc68c1485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc690b0a640 1 -- 172.21.15.31:0/2958291002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684009a70 con 0x7fc68c0b77d0 2023-12-22T08:40:56.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc690b0a640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c1497e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00c4a0 tx=0x7fc67c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc6897fa640 1 -- 172.21.15.31:0/2958291002 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0074e0 con 0x7fc68c0b77d0 2023-12-22T08:40:56.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc6897fa640 1 -- 172.21.15.31:0/2958291002 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c007640 con 0x7fc68c0b77d0 2023-12-22T08:40:56.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c149050 con 0x7fc68c0b77d0 2023-12-22T08:40:56.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc6897fa640 1 -- 172.21.15.31:0/2958291002 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c004a00 con 0x7fc68c0b77d0 2023-12-22T08:40:56.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.034+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c1476d0 con 0x7fc68c0b77d0 2023-12-22T08:40:56.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.035+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c073a40 con 0x7fc68c0b77d0 2023-12-22T08:40:56.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.036+0000 7fc6897fa640 1 -- 172.21.15.31:0/2958291002 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc67c004b60 con 0x7fc68c0b77d0 2023-12-22T08:40:56.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.036+0000 7fc6897fa640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc67806a430 0x7fc67806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.036+0000 7fc6897fa640 1 -- 172.21.15.31:0/2958291002 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc67c087e00 con 0x7fc68c0b77d0 2023-12-22T08:40:56.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.036+0000 7fc68bfff640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc67806a430 0x7fc67806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.037+0000 7fc68bfff640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc67806a430 0x7fc67806c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc68c147080 tx=0x7fc680009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.040+0000 7fc6897fa640 1 -- 172.21.15.31:0/2958291002 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc67c053480 con 0x7fc68c0b77d0 2023-12-22T08:40:56.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.214+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc68c0bca00 con 0x7fc68c0b77d0 2023-12-22T08:40:56.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.214+0000 7fc6897fa640 1 -- 172.21.15.31:0/2958291002 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc67c0180a0 con 0x7fc68c0b77d0 2023-12-22T08:40:56.217 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc67806a430 msgr2=0x7fc67806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc67806a430 0x7fc67806c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc68c147080 tx=0x7fc680009040 comp rx=0 tx=0).stop 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 msgr2=0x7fc68c1497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c1497e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00c4a0 tx=0x7fc67c00c960 comp rx=0 tx=0).stop 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 shutdown_connections 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc67806a430 0x7fc67806c8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc68c144d80 0x7fc68c1485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc68c0b8690 0x7fc68c145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 --2- 172.21.15.31:0/2958291002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc68c0b77d0 0x7fc68c1497e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 >> 172.21.15.31:0/2958291002 conn(0x7fc68c06b6a0 msgr2=0x7fc68c143620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 shutdown_connections 2023-12-22T08:40:56.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.216+0000 7fc692d6e640 1 -- 172.21.15.31:0/2958291002 wait complete. 2023-12-22T08:40:56.229 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:56.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.332+0000 7f3b1bee2640 1 Processor -- start 2023-12-22T08:40:56.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.332+0000 7f3b1bee2640 1 -- start start 2023-12-22T08:40:56.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b1bee2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b1406a6d0 0x7f3b1414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b1bee2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140bb310 con 0x7f3b1414b1f0 2023-12-22T08:40:56.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b1bee2640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140bf960 con 0x7f3b140ba550 2023-12-22T08:40:56.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b1bee2640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140bb5b0 con 0x7f3b1406a6d0 2023-12-22T08:40:56.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b1947d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3b1414b1f0 0x7f3b140b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47248/0 (socket says 172.21.15.31:47248) 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b1947d640 1 -- 172.21.15.31:0/2759623914 learned_addr learned my addr 172.21.15.31:0/2759623914 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033913644 0 0) 0x7f3b140bb310 con 0x7f3b1414b1f0 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b19c7e640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b1406a6d0 0x7f3b1414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.333+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b00003520 con 0x7f3b1414b1f0 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2627984705 0 0) 0x7f3b00003520 con 0x7f3b1414b1f0 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b1406a6d0 msgr2=0x7f3b1414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b1406a6d0 0x7f3b1414acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 >> v1:172.21.15.69:6789/0 conn(0x7f3b140ba550 legacy=0x7f3b141554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140c0120 con 0x7f3b1414b1f0 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f3b04001670 con 0x7f3b1414b1f0 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 >> v1:172.21.15.31:6789/0 conn(0x7f3b1414b1f0 legacy=0x7f3b140b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b000039a0 0x7f3b00003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b1406a6d0 0x7f3b000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00004d00 0x7f3b00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140bb5b0 con 0x7f3b00004d00 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0000ba30 con 0x7f3b000039a0 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0000bbf0 con 0x7f3b1406a6d0 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b1a47f640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00004d00 0x7f3b00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b1947d640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b1406a6d0 0x7f3b000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b19c7e640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b000039a0 0x7f3b00003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b1a47f640 1 -- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b1406a6d0 msgr2=0x7f3b000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b1a47f640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b1406a6d0 0x7f3b000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b1a47f640 1 -- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b000039a0 msgr2=0x7f3b00003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b1a47f640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b000039a0 0x7f3b00003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.334+0000 7f3b1a47f640 1 -- 172.21.15.31:0/2759623914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b00003520 con 0x7f3b00004d00 2023-12-22T08:40:56.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.335+0000 7f3b1a47f640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00004d00 0x7f3b00005180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3b140bf580 tx=0x7f3b000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e61edf345208c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.335+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10003b70 con 0x7f3b00004d00 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.335+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b10003cd0 con 0x7f3b00004d00 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.335+0000 7f3b18c7c640 1 -- 172.21.15.31:0/2759623914 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10005310 con 0x7f3b00004d00 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.336+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2759623914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00004d00 msgr2=0x7f3b00005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.336+0000 7f3b1bee2640 1 --2- 172.21.15.31:0/2759623914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00004d00 0x7f3b00005180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3b140bf580 tx=0x7f3b000057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.336+0000 7f3b1a47f640 1 -- 172.21.15.31:0/2759623914 reap_dead start 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.336+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2759623914 shutdown_connections 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.336+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2759623914 >> 172.21.15.31:0/2759623914 conn(0x7f3b140c0350 msgr2=0x7f3b140c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.336+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2759623914 shutdown_connections 2023-12-22T08:40:56.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.336+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2759623914 wait complete. 2023-12-22T08:40:56.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1bee2640 1 Processor -- start 2023-12-22T08:40:56.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1bee2640 1 -- start start 2023-12-22T08:40:56.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1bee2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b00004d00 0x7f3b141d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1bee2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b141e3be0 0x7f3b141d6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1bee2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b141d6580 0x7f3b141494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1bee2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141d6a30 con 0x7f3b141e3be0 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1bee2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141d5280 con 0x7f3b00004d00 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1bee2640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141e44b0 con 0x7f3b141d6580 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1947d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b141e3be0 0x7f3b141d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1947d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b141e3be0 0x7f3b141d6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39564/0 (socket says 172.21.15.31:39564) 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.337+0000 7f3b1947d640 1 -- 172.21.15.31:0/2927943906 learned_addr learned my addr 172.21.15.31:0/2927943906 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b19c7e640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b00004d00 0x7f3b141d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1a47f640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b141d6580 0x7f3b141494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1947d640 1 -- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b141d6580 msgr2=0x7f3b141494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1947d640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b141d6580 0x7f3b141494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1947d640 1 -- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b00004d00 msgr2=0x7f3b141d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1947d640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b00004d00 0x7f3b141d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1947d640 1 -- 172.21.15.31:0/2927943906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b141e4790 con 0x7f3b141e3be0 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b19c7e640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b00004d00 0x7f3b141d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:56.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1a47f640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b141d6580 0x7f3b141494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1947d640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b141e3be0 0x7f3b141d6040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3b040072c0 tx=0x7f3b04007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b0a7fc640 1 -- 172.21.15.31:0/2927943906 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b040014c0 con 0x7f3b141e3be0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b0a7fc640 1 -- 172.21.15.31:0/2927943906 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400f8e0 con 0x7f3b141e3be0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b141d5840 con 0x7f3b141e3be0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b0a7fc640 1 -- 172.21.15.31:0/2927943906 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400fc90 con 0x7f3b141e3be0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.338+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b141d1180 con 0x7f3b141e3be0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.339+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b141d56a0 con 0x7f3b141e3be0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.340+0000 7f3b0a7fc640 1 -- 172.21.15.31:0/2927943906 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b0401d460 con 0x7f3b141e3be0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.340+0000 7f3b0a7fc640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3af806a430 0x7f3af806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.340+0000 7f3b0a7fc640 1 -- 172.21.15.31:0/2927943906 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b04088ad0 con 0x7f3b141e3be0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.340+0000 7f3b19c7e640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3af806a430 0x7f3af806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.341+0000 7f3b19c7e640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3af806a430 0x7f3af806c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009ab0 tx=0x7f3b0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.344+0000 7f3b0a7fc640 1 -- 172.21.15.31:0/2927943906 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3b141d56a0 con 0x7f3b141e3be0 2023-12-22T08:40:56.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.557+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b141d5d60 con 0x7f3b141e3be0 2023-12-22T08:40:56.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.558+0000 7f3b0a7fc640 1 -- 172.21.15.31:0/2927943906 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f3b141d5d60 con 0x7f3b141e3be0 2023-12-22T08:40:56.560 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:56.560 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:40:45.862817+0000","modified":"2023-12-22T08:40:48.867080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:56.561 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2023-12-22T08:40:56.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3af806a430 msgr2=0x7f3af806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3af806a430 0x7f3af806c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009ab0 tx=0x7f3b0c008040 comp rx=0 tx=0).stop 2023-12-22T08:40:56.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b141e3be0 msgr2=0x7f3b141d6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b141e3be0 0x7f3b141d6040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3b040072c0 tx=0x7f3b04007780 comp rx=0 tx=0).stop 2023-12-22T08:40:56.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 shutdown_connections 2023-12-22T08:40:56.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3af806a430 0x7f3af806c8f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b141d6580 0x7f3b141494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b141e3be0 0x7f3b141d6040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 --2- 172.21.15.31:0/2927943906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b00004d00 0x7f3b141d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 >> 172.21.15.31:0/2927943906 conn(0x7f3b140c0350 msgr2=0x7f3b140a11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.559+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 shutdown_connections 2023-12-22T08:40:56.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.560+0000 7f3b1bee2640 1 -- 172.21.15.31:0/2927943906 wait complete. 2023-12-22T08:40:56.573 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:56.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.676+0000 7f9ec94db640 1 Processor -- start 2023-12-22T08:40:56.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.676+0000 7f9ec94db640 1 -- start start 2023-12-22T08:40:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec94db640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ec406a6d0 0x7f9ec414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec94db640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec40ba550 0x7f9ec41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec94db640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec40bb310 con 0x7f9ec414b1f0 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec94db640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec40bf960 con 0x7f9ec406a6d0 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec94db640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40bb5b0 con 0x7f9ec40ba550 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec2ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ec406a6d0 0x7f9ec414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec2ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9ec406a6d0 0x7f9ec414acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39580/0 (socket says 172.21.15.31:39580) 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ebbfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9ec414b1f0 0x7f9ec40b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47260/0 (socket says 172.21.15.31:47260) 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec2ffd640 1 -- 172.21.15.31:0/2307163141 learned_addr learned my addr 172.21.15.31:0/2307163141 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec2ffd640 1 -- 172.21.15.31:0/2307163141 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec40ba550 msgr2=0x7f9ec41554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec37fe640 1 --2- 172.21.15.31:0/2307163141 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec40ba550 0x7f9ec41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec2ffd640 1 --2- 172.21.15.31:0/2307163141 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec40ba550 0x7f9ec41554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec2ffd640 1 -- 172.21.15.31:0/2307163141 >> v1:172.21.15.31:6789/0 conn(0x7f9ec414b1f0 legacy=0x7f9ec40b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec27fc640 1 -- 172.21.15.31:0/2307163141 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585642710 0 0) 0x7f9ec40bb310 con 0x7f9ec414b1f0 2023-12-22T08:40:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec2ffd640 1 -- 172.21.15.31:0/2307163141 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec40c0120 con 0x7f9ec406a6d0 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.677+0000 7f9ec37fe640 1 --2- 172.21.15.31:0/2307163141 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec40ba550 0x7f9ec41554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.678+0000 7f9ec2ffd640 1 --2- 172.21.15.31:0/2307163141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec406a6d0 0x7f9ec414acb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009870 tx=0x7f9eb402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a72f15a56bc66a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.678+0000 7f9ec27fc640 1 -- 172.21.15.31:0/2307163141 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4030840 con 0x7f9ec406a6d0 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.678+0000 7f9ec27fc640 1 -- 172.21.15.31:0/2307163141 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb40309a0 con 0x7f9ec406a6d0 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.678+0000 7f9ec27fc640 1 -- 172.21.15.31:0/2307163141 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4030d30 con 0x7f9ec406a6d0 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.678+0000 7f9ec94db640 1 -- 172.21.15.31:0/2307163141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec406a6d0 msgr2=0x7f9ec414acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.678+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2307163141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec406a6d0 0x7f9ec414acb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009870 tx=0x7f9eb402b980 comp rx=0 tx=0).stop 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.679+0000 7f9ec94db640 1 -- 172.21.15.31:0/2307163141 shutdown_connections 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.679+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2307163141 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec40ba550 0x7f9ec41554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.679+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2307163141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec406a6d0 0x7f9ec414acb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.679+0000 7f9ec94db640 1 -- 172.21.15.31:0/2307163141 >> 172.21.15.31:0/2307163141 conn(0x7f9ec40c0350 msgr2=0x7f9ec40c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.679+0000 7f9ec94db640 1 -- 172.21.15.31:0/2307163141 shutdown_connections 2023-12-22T08:40:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.679+0000 7f9ec94db640 1 -- 172.21.15.31:0/2307163141 wait complete. 2023-12-22T08:40:56.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ec94db640 1 Processor -- start 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ec94db640 1 -- start start 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ec94db640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ec406a6d0 0x7f9ec4143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ec94db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec40ba550 0x7f9ec414bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ec94db640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec414b1f0 0x7f9ec414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ec94db640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41e0430 con 0x7f9ec40ba550 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ec94db640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec414d230 con 0x7f9ec406a6d0 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ec94db640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41df7b0 con 0x7f9ec414b1f0 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ebbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec40ba550 0x7f9ec414bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ebbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec40ba550 0x7f9ec414bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39596/0 (socket says 172.21.15.31:39596) 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.680+0000 7f9ebbfff640 1 -- 172.21.15.31:0/2673604061 learned_addr learned my addr 172.21.15.31:0/2673604061 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebbfff640 1 -- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec414b1f0 msgr2=0x7f9ec414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebbfff640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec414b1f0 0x7f9ec414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebbfff640 1 -- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ec406a6d0 msgr2=0x7f9ec4143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebbfff640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ec406a6d0 0x7f9ec4143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebbfff640 1 -- 172.21.15.31:0/2673604061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb40094d0 con 0x7f9ec40ba550 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebbfff640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec40ba550 0x7f9ec414bda0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00c410 tx=0x7f9eac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebb7fe640 1 -- 172.21.15.31:0/2673604061 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac0074e0 con 0x7f9ec40ba550 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebb7fe640 1 -- 172.21.15.31:0/2673604061 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac007660 con 0x7f9ec40ba550 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ebb7fe640 1 -- 172.21.15.31:0/2673604061 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac004a20 con 0x7f9ec40ba550 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec41dfa90 con 0x7f9ec40ba550 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.681+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec41e0050 con 0x7f9ec40ba550 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.682+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec4073a40 con 0x7f9ec40ba550 2023-12-22T08:40:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.682+0000 7f9ebb7fe640 1 -- 172.21.15.31:0/2673604061 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9eac004b80 con 0x7f9ec40ba550 2023-12-22T08:40:56.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.683+0000 7f9ebb7fe640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ea406a430 0x7f9ea406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.683+0000 7f9ebb7fe640 1 -- 172.21.15.31:0/2673604061 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eac0886f0 con 0x7f9ec40ba550 2023-12-22T08:40:56.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.683+0000 7f9ec2ffd640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ea406a430 0x7f9ea406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.683+0000 7f9ec2ffd640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ea406a430 0x7f9ea406c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4036000 tx=0x7f9eb403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.687+0000 7f9ebb7fe640 1 -- 172.21.15.31:0/2673604061 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9eac057770 con 0x7f9ec40ba550 2023-12-22T08:40:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.863+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec406b0d0 con 0x7f9ec40ba550 2023-12-22T08:40:56.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.864+0000 7f9ebb7fe640 1 -- 172.21.15.31:0/2673604061 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f9eac057300 con 0x7f9ec40ba550 2023-12-22T08:40:56.867 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:56.867 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ea406a430 msgr2=0x7f9ea406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ea406a430 0x7f9ea406c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4036000 tx=0x7f9eb403b040 comp rx=0 tx=0).stop 2023-12-22T08:40:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec40ba550 msgr2=0x7f9ec414bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec40ba550 0x7f9ec414bda0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00c410 tx=0x7f9eac00c8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 shutdown_connections 2023-12-22T08:40:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9ea406a430 0x7f9ea406c8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9ec414b1f0 0x7f9ec414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ec40ba550 0x7f9ec414bda0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 --2- 172.21.15.31:0/2673604061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ec406a6d0 0x7f9ec4143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.866+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 >> 172.21.15.31:0/2673604061 conn(0x7f9ec40c0350 msgr2=0x7f9ec409fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.867+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 shutdown_connections 2023-12-22T08:40:56.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.867+0000 7f9ec94db640 1 -- 172.21.15.31:0/2673604061 wait complete. 2023-12-22T08:40:56.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:40:56.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:40:56.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.987+0000 7fa810669640 1 Processor -- start 2023-12-22T08:40:56.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.987+0000 7fa810669640 1 -- start start 2023-12-22T08:40:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa810669640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa8080b8690 0x7fa8080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa810669640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8080b77d0 0x7fa808144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa810669640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80814ab10 con 0x7fa808144bb0 2023-12-22T08:40:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa810669640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80806c2f0 con 0x7fa8080b8690 2023-12-22T08:40:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa810669640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080ba620 con 0x7fa8080b77d0 2023-12-22T08:40:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa80e405640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa8080b8690 0x7fa8080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa80e405640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa8080b8690 0x7fa8080b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39608/0 (socket says 172.21.15.31:39608) 2023-12-22T08:40:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa80e405640 1 -- 172.21.15.31:0/3099735058 learned_addr learned my addr 172.21.15.31:0/3099735058 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa80dc04640 1 --2- 172.21.15.31:0/3099735058 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8080b77d0 0x7fa808144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa80e405640 1 -- 172.21.15.31:0/3099735058 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8080b77d0 msgr2=0x7fa808144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa80e405640 1 --2- 172.21.15.31:0/3099735058 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8080b77d0 0x7fa808144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa80e405640 1 -- 172.21.15.31:0/3099735058 >> v1:172.21.15.69:6789/0 conn(0x7fa808144bb0 legacy=0x7fa80814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.988+0000 7fa80e405640 1 -- 172.21.15.31:0/3099735058 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080b9e60 con 0x7fa8080b8690 2023-12-22T08:40:56.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.989+0000 7fa80e405640 1 --2- 172.21.15.31:0/3099735058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8080b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa800009870 tx=0x7fa80002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe63b11f0c7828af server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.989+0000 7fa80d403640 1 -- 172.21.15.31:0/3099735058 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800031640 con 0x7fa8080b8690 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.989+0000 7fa80d403640 1 -- 172.21.15.31:0/3099735058 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8000317a0 con 0x7fa8080b8690 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.989+0000 7fa80d403640 1 -- 172.21.15.31:0/3099735058 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800031b30 con 0x7fa8080b8690 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.990+0000 7fa810669640 1 -- 172.21.15.31:0/3099735058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 msgr2=0x7fa8080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.990+0000 7fa810669640 1 --2- 172.21.15.31:0/3099735058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8080b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa800009870 tx=0x7fa80002b8f0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.990+0000 7fa810669640 1 -- 172.21.15.31:0/3099735058 shutdown_connections 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.990+0000 7fa810669640 1 --2- 172.21.15.31:0/3099735058 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8080b77d0 0x7fa808144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.990+0000 7fa810669640 1 --2- 172.21.15.31:0/3099735058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8080b8a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.990+0000 7fa810669640 1 -- 172.21.15.31:0/3099735058 >> 172.21.15.31:0/3099735058 conn(0x7fa80806b6a0 msgr2=0x7fa80806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.990+0000 7fa810669640 1 -- 172.21.15.31:0/3099735058 shutdown_connections 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.990+0000 7fa810669640 1 -- 172.21.15.31:0/3099735058 wait complete. 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.991+0000 7fa810669640 1 Processor -- start 2023-12-22T08:40:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.991+0000 7fa810669640 1 -- start start 2023-12-22T08:40:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa810669640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8080b77d0 0x7fa8081d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa810669640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8081d7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa810669640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa808144bb0 0x7fa8081e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa810669640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80813caf0 con 0x7fa8080b8690 2023-12-22T08:40:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa810669640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80814a2f0 con 0x7fa8080b77d0 2023-12-22T08:40:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa810669640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8081d2080 con 0x7fa808144bb0 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8081d7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8081d7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39612/0 (socket says 172.21.15.31:39612) 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 -- 172.21.15.31:0/374708905 learned_addr learned my addr 172.21.15.31:0/374708905 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80e405640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8080b77d0 0x7fa8081d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80ec06640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa808144bb0 0x7fa8081e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 -- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa808144bb0 msgr2=0x7fa8081e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa808144bb0 0x7fa8081e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 -- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8080b77d0 msgr2=0x7fa8081d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8080b77d0 0x7fa8081d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 -- 172.21.15.31:0/374708905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000094d0 con 0x7fa8080b8690 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80e405640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8080b77d0 0x7fa8081d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80ec06640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa808144bb0 0x7fa8081e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa80dc04640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8081d7420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00d800 tx=0x7fa7fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa806ffd640 1 -- 172.21.15.31:0/374708905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc00b6c0 con 0x7fa8080b8690 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa806ffd640 1 -- 172.21.15.31:0/374708905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc00b820 con 0x7fa8080b8690 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa808149c90 con 0x7fa8080b8690 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa806ffd640 1 -- 172.21.15.31:0/374708905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc00bbb0 con 0x7fa8080b8690 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.992+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8081d0e60 con 0x7fa8080b8690 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.993+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa808073a40 con 0x7fa8080b8690 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.994+0000 7fa806ffd640 1 -- 172.21.15.31:0/374708905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7fc00bd10 con 0x7fa8080b8690 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.994+0000 7fa806ffd640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7f406a430 0x7fa7f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.994+0000 7fa806ffd640 1 -- 172.21.15.31:0/374708905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7fc088e60 con 0x7fa8080b8690 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.995+0000 7fa80e405640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7f406a430 0x7fa7f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.995+0000 7fa80e405640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7f406a430 0x7fa7f406c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa800036000 tx=0x7fa80003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:56.998+0000 7fa806ffd640 1 -- 172.21.15.31:0/374708905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa7fc054440 con 0x7fa8080b8690 2023-12-22T08:40:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.171+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa808143fe0 con 0x7fa8080b8690 2023-12-22T08:40:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.171+0000 7fa806ffd640 1 -- 172.21.15.31:0/374708905 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7fc057a60 con 0x7fa8080b8690 2023-12-22T08:40:57.174 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:40:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7f406a430 msgr2=0x7fa7f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7f406a430 0x7fa7f406c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa800036000 tx=0x7fa80003c040 comp rx=0 tx=0).stop 2023-12-22T08:40:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 msgr2=0x7fa8081d7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8081d7420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00d800 tx=0x7fa7fc00dcc0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 shutdown_connections 2023-12-22T08:40:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7f406a430 0x7fa7f406c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa808144bb0 0x7fa8081e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b8690 0x7fa8081d7420 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 --2- 172.21.15.31:0/374708905 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8080b77d0 0x7fa8081d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 >> 172.21.15.31:0/374708905 conn(0x7fa80806b6a0 msgr2=0x7fa8080ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 shutdown_connections 2023-12-22T08:40:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.173+0000 7fa810669640 1 -- 172.21.15.31:0/374708905 wait complete. 2023-12-22T08:40:57.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.292+0000 7f7700577640 1 Processor -- start 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.292+0000 7f7700577640 1 -- start start 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f7700577640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76f80b8690 0x7f76f80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f7700577640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 0x7f76f814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f7700577640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f814ab10 con 0x7f76f80b77d0 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f7700577640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f806c2f0 con 0x7f76f80b8690 2023-12-22T08:40:57.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f7700577640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80ba620 con 0x7f76f8144d80 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fe313640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76f80b8690 0x7f76f80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fdb12640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f76f80b77d0 0x7f76f8144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47276/0 (socket says 172.21.15.31:47276) 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fe313640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76f80b8690 0x7f76f80b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39624/0 (socket says 172.21.15.31:39624) 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fdb12640 1 -- 172.21.15.31:0/2179918780 learned_addr learned my addr 172.21.15.31:0/2179918780 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76feb14640 1 --2- 172.21.15.31:0/2179918780 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 0x7f76f814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fe313640 1 -- 172.21.15.31:0/2179918780 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 msgr2=0x7f76f814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fe313640 1 --2- 172.21.15.31:0/2179918780 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 0x7f76f814afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fe313640 1 -- 172.21.15.31:0/2179918780 >> v1:172.21.15.31:6789/0 conn(0x7f76f80b77d0 legacy=0x7f76f8144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fd311640 1 -- 172.21.15.31:0/2179918780 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220368477 0 0) 0x7f76f814ab10 con 0x7f76f80b77d0 2023-12-22T08:40:57.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.293+0000 7f76fe313640 1 -- 172.21.15.31:0/2179918780 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80b9e60 con 0x7f76f80b8690 2023-12-22T08:40:57.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.294+0000 7f76fe313640 1 --2- 172.21.15.31:0/2179918780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b8690 0x7f76f80b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009d90 tx=0x7f76e802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9400c3fb2cbca3f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.294+0000 7f76fd311640 1 -- 172.21.15.31:0/2179918780 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e802cbc0 con 0x7f76f80b8690 2023-12-22T08:40:57.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.294+0000 7f76fd311640 1 -- 172.21.15.31:0/2179918780 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e802cd20 con 0x7f76f80b8690 2023-12-22T08:40:57.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.294+0000 7f76fd311640 1 -- 172.21.15.31:0/2179918780 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8034660 con 0x7f76f80b8690 2023-12-22T08:40:57.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.295+0000 7f7700577640 1 -- 172.21.15.31:0/2179918780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b8690 msgr2=0x7f76f80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.295+0000 7f7700577640 1 --2- 172.21.15.31:0/2179918780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b8690 0x7f76f80b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009d90 tx=0x7f76e802be10 comp rx=0 tx=0).stop 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.295+0000 7f7700577640 1 -- 172.21.15.31:0/2179918780 shutdown_connections 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.295+0000 7f7700577640 1 --2- 172.21.15.31:0/2179918780 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 0x7f76f814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.295+0000 7f7700577640 1 --2- 172.21.15.31:0/2179918780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b8690 0x7f76f80b8a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.295+0000 7f7700577640 1 -- 172.21.15.31:0/2179918780 >> 172.21.15.31:0/2179918780 conn(0x7f76f806b6a0 msgr2=0x7f76f806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.295+0000 7f7700577640 1 -- 172.21.15.31:0/2179918780 shutdown_connections 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.295+0000 7f7700577640 1 -- 172.21.15.31:0/2179918780 wait complete. 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.296+0000 7f7700577640 1 Processor -- start 2023-12-22T08:40:57.302 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.296+0000 7f7700577640 1 -- start start 2023-12-22T08:40:57.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f7700577640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b77d0 0x7f76f8149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f7700577640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76f80b8690 0x7f76f81d7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f7700577640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 0x7f76f81df850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f7700577640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8148ff0 con 0x7f76f80b77d0 2023-12-22T08:40:57.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f7700577640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f81d1310 con 0x7f76f80b8690 2023-12-22T08:40:57.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f7700577640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f81491a0 con 0x7f76f8144d80 2023-12-22T08:40:57.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b77d0 0x7f76f8149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b77d0 0x7f76f8149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39636/0 (socket says 172.21.15.31:39636) 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 -- 172.21.15.31:0/2602745301 learned_addr learned my addr 172.21.15.31:0/2602745301 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76feb14640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 0x7f76f81df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fdb12640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76f80b8690 0x7f76f81d7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 -- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 msgr2=0x7f76f81df850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 0x7f76f81df850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 -- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76f80b8690 msgr2=0x7f76f81d7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76f80b8690 0x7f76f81d7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 -- 172.21.15.31:0/2602745301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8009a70 con 0x7f76f80b77d0 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fdb12640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76f80b8690 0x7f76f81d7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76fe313640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b77d0 0x7f76f8149630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009d90 tx=0x7f76e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76f6ffd640 1 -- 172.21.15.31:0/2602745301 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e803e610 con 0x7f76f80b77d0 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f76f6ffd640 1 -- 172.21.15.31:0/2602745301 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e802ce90 con 0x7f76f80b77d0 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.297+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f81d1fe0 con 0x7f76f80b77d0 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.298+0000 7f76f6ffd640 1 -- 172.21.15.31:0/2602745301 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e803e990 con 0x7f76f80b77d0 2023-12-22T08:40:57.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.298+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f81d0d20 con 0x7f76f80b77d0 2023-12-22T08:40:57.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.298+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f8149ed0 con 0x7f76f80b77d0 2023-12-22T08:40:57.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.299+0000 7f76f6ffd640 1 -- 172.21.15.31:0/2602745301 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76e803b050 con 0x7f76f80b77d0 2023-12-22T08:40:57.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.299+0000 7f76f6ffd640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f76e406a460 0x7f76e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.300+0000 7f76f6ffd640 1 -- 172.21.15.31:0/2602745301 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76e80aa8b0 con 0x7f76f80b77d0 2023-12-22T08:40:57.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.300+0000 7f76fdb12640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f76e406a460 0x7f76e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.300+0000 7f76fdb12640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f76e406a460 0x7f76e406c920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f76f8141e90 tx=0x7f76ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.304+0000 7f76f6ffd640 1 -- 172.21.15.31:0/2602745301 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f76e8075d80 con 0x7f76f80b77d0 2023-12-22T08:40:57.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.481+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76f8073a40 con 0x7f76f80b77d0 2023-12-22T08:40:57.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.481+0000 7f76f6ffd640 1 -- 172.21.15.31:0/2602745301 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f76e80793a0 con 0x7f76f80b77d0 2023-12-22T08:40:57.484 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:40:57.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f76e406a460 msgr2=0x7f76e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f76e406a460 0x7f76e406c920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f76f8141e90 tx=0x7f76ec009040 comp rx=0 tx=0).stop 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b77d0 msgr2=0x7f76f8149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b77d0 0x7f76f8149630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009d90 tx=0x7f76e8004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 shutdown_connections 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f76e406a460 0x7f76e406c920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76f8144d80 0x7f76f81df850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76f80b8690 0x7f76f81d7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 --2- 172.21.15.31:0/2602745301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76f80b77d0 0x7f76f8149630 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 >> 172.21.15.31:0/2602745301 conn(0x7f76f806b6a0 msgr2=0x7f76f814afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 shutdown_connections 2023-12-22T08:40:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.483+0000 7f7700577640 1 -- 172.21.15.31:0/2602745301 wait complete. 2023-12-22T08:40:57.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:40:57.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.602+0000 7ff170c84640 1 Processor -- start 2023-12-22T08:40:57.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.602+0000 7ff170c84640 1 -- start start 2023-12-22T08:40:57.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.602+0000 7ff170c84640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c0b8690 0x7ff16c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff170c84640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c14ab10 con 0x7ff16c144d80 2023-12-22T08:40:57.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff170c84640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c06c2f0 con 0x7ff16c0b77d0 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff170c84640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0ba620 con 0x7ff16c0b8690 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff16ad9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff16c144d80 0x7ff16c14afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47290/0 (socket says 172.21.15.31:47290) 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff16ad9d640 1 -- 172.21.15.31:0/3703835398 learned_addr learned my addr 172.21.15.31:0/3703835398 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff16a59c640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c0b8690 0x7ff16c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542587732 0 0) 0x7ff16c14ab10 con 0x7ff16c144d80 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff158003520 con 0x7ff16c144d80 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105993831 0 0) 0x7ff16c06c2f0 con 0x7ff16c0b77d0 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff16c14ab10 con 0x7ff16c0b77d0 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135974731 0 0) 0x7ff158003520 con 0x7ff16c144d80 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c0b8690 msgr2=0x7ff16c0b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c0b8690 0x7ff16c0b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 >> v1:172.21.15.69:6789/0 conn(0x7ff16c0b77d0 legacy=0x7ff16c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c0b9e60 con 0x7ff16c144d80 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7ff1640019f0 con 0x7ff16c144d80 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 >> v1:172.21.15.31:6789/0 conn(0x7ff16c144d80 legacy=0x7ff16c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c0b8690 0x7ff158003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff158004090 0x7ff1580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff158004d00 0x7ff158005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0ba620 con 0x7ff158004d00 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15800bb10 con 0x7ff158004090 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15800bca0 con 0x7ff16c0b8690 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff16ad9d640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff158004d00 0x7ff158005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff16a59c640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c0b8690 0x7ff158003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.603+0000 7ff161d9b640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff158004090 0x7ff1580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.604+0000 7ff16ad9d640 1 -- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c0b8690 msgr2=0x7ff158003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.604+0000 7ff16ad9d640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c0b8690 0x7ff158003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.604+0000 7ff16ad9d640 1 -- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff158004090 msgr2=0x7ff1580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.604+0000 7ff16ad9d640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff158004090 0x7ff1580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.604+0000 7ff16ad9d640 1 -- 172.21.15.31:0/3703835398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158003520 con 0x7ff158004d00 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.604+0000 7ff16ad9d640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff158004d00 0x7ff158005180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0bde90 tx=0x7ff1580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe4bca9dcac5510 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164034630 con 0x7ff158004d00 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16402f070 con 0x7ff158004d00 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff169d9b640 1 -- 172.21.15.31:0/3703835398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1640349d0 con 0x7ff158004d00 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff170c84640 1 -- 172.21.15.31:0/3703835398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff158004d00 msgr2=0x7ff158005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff170c84640 1 --2- 172.21.15.31:0/3703835398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff158004d00 0x7ff158005180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0bde90 tx=0x7ff1580057f0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff16ad9d640 1 -- 172.21.15.31:0/3703835398 reap_dead start 2023-12-22T08:40:57.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff170c84640 1 -- 172.21.15.31:0/3703835398 shutdown_connections 2023-12-22T08:40:57.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff170c84640 1 -- 172.21.15.31:0/3703835398 >> 172.21.15.31:0/3703835398 conn(0x7ff16c06b6a0 msgr2=0x7ff16c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff170c84640 1 -- 172.21.15.31:0/3703835398 shutdown_connections 2023-12-22T08:40:57.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.605+0000 7ff170c84640 1 -- 172.21.15.31:0/3703835398 wait complete. 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.606+0000 7ff170c84640 1 Processor -- start 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff170c84640 1 -- start start 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff170c84640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0bf690 0x7ff16c134e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff170c84640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c137770 0x7ff16c133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff170c84640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff16c14a5a0 0x7ff16c1341a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff170c84640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c14db50 con 0x7ff16c0bf690 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff170c84640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c1353c0 con 0x7ff16c14a5a0 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff170c84640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c1346e0 con 0x7ff16c137770 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff16a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0bf690 0x7ff16c134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff16a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0bf690 0x7ff16c134e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39658/0 (socket says 172.21.15.31:39658) 2023-12-22T08:40:57.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff16a59c640 1 -- 172.21.15.31:0/2043331951 learned_addr learned my addr 172.21.15.31:0/2043331951 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff16ad9d640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff16c14a5a0 0x7ff16c1341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff161d9b640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c137770 0x7ff16c133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.607+0000 7ff16a59c640 1 -- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c137770 msgr2=0x7ff16c133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff16a59c640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c137770 0x7ff16c133c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff16a59c640 1 -- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff16c14a5a0 msgr2=0x7ff16c1341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff16a59c640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff16c14a5a0 0x7ff16c1341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff16a59c640 1 -- 172.21.15.31:0/2043331951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c14dda0 con 0x7ff16c0bf690 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff16a59c640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0bf690 0x7ff16c134e80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff15c011a00 tx=0x7ff15c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff1637fe640 1 -- 172.21.15.31:0/2043331951 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c00fb50 con 0x7ff16c0bf690 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff1637fe640 1 -- 172.21.15.31:0/2043331951 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c00fcb0 con 0x7ff16c0bf690 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16c14e080 con 0x7ff16c0bf690 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff1637fe640 1 -- 172.21.15.31:0/2043331951 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c014440 con 0x7ff16c0bf690 2023-12-22T08:40:57.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.608+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16c136770 con 0x7ff16c0bf690 2023-12-22T08:40:57.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.609+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16c073a40 con 0x7ff16c0bf690 2023-12-22T08:40:57.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.609+0000 7ff1637fe640 1 -- 172.21.15.31:0/2043331951 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff15c0145a0 con 0x7ff16c0bf690 2023-12-22T08:40:57.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.610+0000 7ff1637fe640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff14c06a430 0x7ff14c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.610+0000 7ff1637fe640 1 -- 172.21.15.31:0/2043331951 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff15c089160 con 0x7ff16c0bf690 2023-12-22T08:40:57.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.610+0000 7ff161d9b640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff14c06a430 0x7ff14c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.610+0000 7ff161d9b640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff14c06a430 0x7ff14c06c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff16c14eae0 tx=0x7ff154009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.614+0000 7ff1637fe640 1 -- 172.21.15.31:0/2043331951 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff15c0547e0 con 0x7ff16c0bf690 2023-12-22T08:40:57.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.788+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff16c142a10 con 0x7ff16c0bf690 2023-12-22T08:40:57.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.788+0000 7ff1637fe640 1 -- 172.21.15.31:0/2043331951 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff15c057e00 con 0x7ff16c0bf690 2023-12-22T08:40:57.791 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:40:57.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff14c06a430 msgr2=0x7ff14c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff14c06a430 0x7ff14c06c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff16c14eae0 tx=0x7ff154009040 comp rx=0 tx=0).stop 2023-12-22T08:40:57.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0bf690 msgr2=0x7ff16c134e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0bf690 0x7ff16c134e80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff15c011a00 tx=0x7ff15c011ec0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 shutdown_connections 2023-12-22T08:40:57.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff14c06a430 0x7ff14c06c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff16c14a5a0 0x7ff16c1341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff16c137770 0x7ff16c133c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 --2- 172.21.15.31:0/2043331951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff16c0bf690 0x7ff16c134e80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 >> 172.21.15.31:0/2043331951 conn(0x7ff16c06b6a0 msgr2=0x7ff16c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 shutdown_connections 2023-12-22T08:40:57.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.790+0000 7ff170c84640 1 -- 172.21.15.31:0/2043331951 wait complete. 2023-12-22T08:40:57.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.907+0000 7fe11e44b640 1 Processor -- start 2023-12-22T08:40:57.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.907+0000 7fe11e44b640 1 -- start start 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe11e44b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe1180b8280 0x7fe118142910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe11e44b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe118142e50 0x7fe1180b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe11e44b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1180b4230 con 0x7fe1180b7ea0 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe11e44b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1180711c0 con 0x7fe1180b8280 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe11e44b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180714a0 con 0x7fe118142e50 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe1177fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe1180b8280 0x7fe118142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe11c9e8640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe118142e50 0x7fe1180b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe117fff640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe1180b7ea0 0x7fe1180b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:33790/0 (socket says 172.21.15.31:33790) 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe117fff640 1 -- 172.21.15.31:0/4018669369 learned_addr learned my addr 172.21.15.31:0/4018669369 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:57.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.908+0000 7fe1177fe640 1 --2- 172.21.15.31:0/4018669369 >> v2:172.21.15.69:3300/0 conn(0x7fe1180b8280 0x7fe118142910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:44470/0 (socket says 172.21.15.31:44470) 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.909+0000 7fe116ffd640 1 -- 172.21.15.31:0/4018669369 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662014524 0 0) 0x7fe1180b4230 con 0x7fe1180b7ea0 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.909+0000 7fe116ffd640 1 -- 172.21.15.31:0/4018669369 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe100003520 con 0x7fe1180b7ea0 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.909+0000 7fe11c9e8640 1 -- 172.21.15.31:0/4018669369 >> v2:172.21.15.69:3300/0 conn(0x7fe1180b8280 msgr2=0x7fe118142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.909+0000 7fe11c9e8640 1 --2- 172.21.15.31:0/4018669369 >> v2:172.21.15.69:3300/0 conn(0x7fe1180b8280 0x7fe118142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.909+0000 7fe11c9e8640 1 -- 172.21.15.31:0/4018669369 >> v1:172.21.15.69:6789/0 conn(0x7fe1180b7ea0 legacy=0x7fe1180b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.909+0000 7fe11c9e8640 1 -- 172.21.15.31:0/4018669369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe118071780 con 0x7fe118142e50 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.909+0000 7fe1177fe640 1 --2- 172.21.15.31:0/4018669369 >> v2:172.21.15.69:3300/0 conn(0x7fe1180b8280 0x7fe118142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11c9e8640 1 --2- 172.21.15.31:0/4018669369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe118142e50 0x7fe1180b89f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe110009d90 tx=0x7fe11002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9642f363b21028d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe116ffd640 1 -- 172.21.15.31:0/4018669369 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11002cce0 con 0x7fe118142e50 2023-12-22T08:40:57.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe116ffd640 1 -- 172.21.15.31:0/4018669369 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11002ce40 con 0x7fe118142e50 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe116ffd640 1 -- 172.21.15.31:0/4018669369 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110034660 con 0x7fe118142e50 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11e44b640 1 -- 172.21.15.31:0/4018669369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe118142e50 msgr2=0x7fe1180b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11e44b640 1 --2- 172.21.15.31:0/4018669369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe118142e50 0x7fe1180b89f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe110009d90 tx=0x7fe11002bf30 comp rx=0 tx=0).stop 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11e44b640 1 -- 172.21.15.31:0/4018669369 shutdown_connections 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11e44b640 1 --2- 172.21.15.31:0/4018669369 >> v2:172.21.15.69:3300/0 conn(0x7fe1180b8280 0x7fe118142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11e44b640 1 --2- 172.21.15.31:0/4018669369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe118142e50 0x7fe1180b89f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11e44b640 1 -- 172.21.15.31:0/4018669369 >> 172.21.15.31:0/4018669369 conn(0x7fe1180bd060 msgr2=0x7fe1180bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11e44b640 1 -- 172.21.15.31:0/4018669369 shutdown_connections 2023-12-22T08:40:57.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.910+0000 7fe11e44b640 1 -- 172.21.15.31:0/4018669369 wait complete. 2023-12-22T08:40:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.911+0000 7fe11e44b640 1 Processor -- start 2023-12-22T08:40:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11e44b640 1 -- start start 2023-12-22T08:40:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11e44b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1180b7ea0 0x7fe118149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11e44b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1180b8280 0x7fe1181de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11e44b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe118142e50 0x7fe1181de620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11e44b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe118149840 con 0x7fe118142e50 2023-12-22T08:40:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11e44b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe118145480 con 0x7fe1180b7ea0 2023-12-22T08:40:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11e44b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe118144be0 con 0x7fe1180b8280 2023-12-22T08:40:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11c9e8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe118142e50 0x7fe1181de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11c9e8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe118142e50 0x7fe1181de620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39664/0 (socket says 172.21.15.31:39664) 2023-12-22T08:40:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe11c9e8640 1 -- 172.21.15.31:0/1677526615 learned_addr learned my addr 172.21.15.31:0/1677526615 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe117fff640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1180b7ea0 0x7fe118149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.912+0000 7fe1177fe640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1180b8280 0x7fe1181de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe11c9e8640 1 -- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1180b8280 msgr2=0x7fe1181de0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe11c9e8640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1180b8280 0x7fe1181de0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe11c9e8640 1 -- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1180b7ea0 msgr2=0x7fe118149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe11c9e8640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1180b7ea0 0x7fe118149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe11c9e8640 1 -- 172.21.15.31:0/1677526615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c009400 con 0x7fe118142e50 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe11c9e8640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe118142e50 0x7fe1181de620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe110009eb0 tx=0x7fe110004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe114ff9640 1 -- 172.21.15.31:0/1677526615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11003d600 con 0x7fe118142e50 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe114ff9640 1 -- 172.21.15.31:0/1677526615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11003d780 con 0x7fe118142e50 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe110009a70 con 0x7fe118142e50 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe114ff9640 1 -- 172.21.15.31:0/1677526615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11003db30 con 0x7fe118142e50 2023-12-22T08:40:57.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.913+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11813dbf0 con 0x7fe118142e50 2023-12-22T08:40:57.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.914+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe118073a40 con 0x7fe118142e50 2023-12-22T08:40:57.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.915+0000 7fe114ff9640 1 -- 172.21.15.31:0/1677526615 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe11003b040 con 0x7fe118142e50 2023-12-22T08:40:57.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.915+0000 7fe114ff9640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe10406a430 0x7fe10406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:57.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.915+0000 7fe114ff9640 1 -- 172.21.15.31:0/1677526615 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1100aace0 con 0x7fe118142e50 2023-12-22T08:40:57.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.915+0000 7fe117fff640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe10406a430 0x7fe10406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:57.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.916+0000 7fe117fff640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe10406a430 0x7fe10406c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe1080011e0 tx=0x7fe108007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:57.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:57.919+0000 7fe114ff9640 1 -- 172.21.15.31:0/1677526615 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe110076410 con 0x7fe118142e50 2023-12-22T08:40:58.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.130+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe118071a60 con 0x7fe118142e50 2023-12-22T08:40:58.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.130+0000 7fe114ff9640 1 -- 172.21.15.31:0/1677526615 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7fe110039090 con 0x7fe118142e50 2023-12-22T08:40:58.133 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:58.133 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:40:45.862817+0000","modified":"2023-12-22T08:40:48.867080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:58.133 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2023-12-22T08:40:58.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe10406a430 msgr2=0x7fe10406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe10406a430 0x7fe10406c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe1080011e0 tx=0x7fe108007d30 comp rx=0 tx=0).stop 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe118142e50 msgr2=0x7fe1181de620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe118142e50 0x7fe1181de620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe110009eb0 tx=0x7fe110004a40 comp rx=0 tx=0).stop 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 shutdown_connections 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe10406a430 0x7fe10406c8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe118142e50 0x7fe1181de620 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1180b8280 0x7fe1181de0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 --2- 172.21.15.31:0/1677526615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1180b7ea0 0x7fe118149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 >> 172.21.15.31:0/1677526615 conn(0x7fe1180bd060 msgr2=0x7fe1180b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 shutdown_connections 2023-12-22T08:40:58.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.132+0000 7fe11e44b640 1 -- 172.21.15.31:0/1677526615 wait complete. 2023-12-22T08:40:58.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:40:58.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.248+0000 7f4970700640 1 Processor -- start 2023-12-22T08:40:58.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.248+0000 7f4970700640 1 -- start start 2023-12-22T08:40:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f4970700640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f496806a6d0 0x7f496814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f4970700640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496814b1f0 0x7f49680b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f4970700640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49680bb310 con 0x7f49680ba550 2023-12-22T08:40:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f4970700640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680bf960 con 0x7f496806a6d0 2023-12-22T08:40:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f4970700640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680bb5b0 con 0x7f496814b1f0 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f496e49c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f496806a6d0 0x7f496814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f496dc9b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496814b1f0 0x7f49680b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f496e49c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f496806a6d0 0x7f496814acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:44478/0 (socket says 172.21.15.31:44478) 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f496ec9d640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f49680ba550 0x7f496814e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:33800/0 (socket says 172.21.15.31:33800) 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.249+0000 7f496e49c640 1 -- 172.21.15.31:0/874421790 learned_addr learned my addr 172.21.15.31:0/874421790 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.250+0000 7f496dc9b640 1 -- 172.21.15.31:0/874421790 >> v2:172.21.15.69:3300/0 conn(0x7f496806a6d0 msgr2=0x7f496814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.250+0000 7f496dc9b640 1 --2- 172.21.15.31:0/874421790 >> v2:172.21.15.69:3300/0 conn(0x7f496806a6d0 0x7f496814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.250+0000 7f496dc9b640 1 -- 172.21.15.31:0/874421790 >> v1:172.21.15.69:6789/0 conn(0x7f49680ba550 legacy=0x7f496814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.250+0000 7f496dc9b640 1 -- 172.21.15.31:0/874421790 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680c0120 con 0x7f496814b1f0 2023-12-22T08:40:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.250+0000 7f496e49c640 1 --2- 172.21.15.31:0/874421790 >> v2:172.21.15.69:3300/0 conn(0x7f496806a6d0 0x7f496814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:40:58.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.250+0000 7f496dc9b640 1 --2- 172.21.15.31:0/874421790 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496814b1f0 0x7f49680b9ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49580097a0 tx=0x7f495802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1de3b25a2851392 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f496d49a640 1 -- 172.21.15.31:0/874421790 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958031830 con 0x7f496814b1f0 2023-12-22T08:40:58.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f496d49a640 1 -- 172.21.15.31:0/874421790 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4958031990 con 0x7f496814b1f0 2023-12-22T08:40:58.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f496d49a640 1 -- 172.21.15.31:0/874421790 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958031d20 con 0x7f496814b1f0 2023-12-22T08:40:58.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f4970700640 1 -- 172.21.15.31:0/874421790 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496814b1f0 msgr2=0x7f49680b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f4970700640 1 --2- 172.21.15.31:0/874421790 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496814b1f0 0x7f49680b9ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49580097a0 tx=0x7f495802b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f4970700640 1 -- 172.21.15.31:0/874421790 shutdown_connections 2023-12-22T08:40:58.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f4970700640 1 --2- 172.21.15.31:0/874421790 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496814b1f0 0x7f49680b9ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f4970700640 1 --2- 172.21.15.31:0/874421790 >> v2:172.21.15.69:3300/0 conn(0x7f496806a6d0 0x7f496814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f4970700640 1 -- 172.21.15.31:0/874421790 >> 172.21.15.31:0/874421790 conn(0x7f49680c0350 msgr2=0x7f49680c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f4970700640 1 -- 172.21.15.31:0/874421790 shutdown_connections 2023-12-22T08:40:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.251+0000 7f4970700640 1 -- 172.21.15.31:0/874421790 wait complete. 2023-12-22T08:40:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.252+0000 7f4970700640 1 Processor -- start 2023-12-22T08:40:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.252+0000 7f4970700640 1 -- start start 2023-12-22T08:40:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f4970700640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496806a6d0 0x7f49681d3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f4970700640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49680ba550 0x7f496814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f4970700640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f496814b1f0 0x7f49681e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f4970700640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496814e930 con 0x7f49680ba550 2023-12-22T08:40:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f4970700640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680b5d40 con 0x7f496814b1f0 2023-12-22T08:40:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f4970700640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49681d5410 con 0x7f496806a6d0 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496dc9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49680ba550 0x7f496814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496dc9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49680ba550 0x7f496814e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39668/0 (socket says 172.21.15.31:39668) 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496dc9b640 1 -- 172.21.15.31:0/1265471469 learned_addr learned my addr 172.21.15.31:0/1265471469 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496e49c640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496806a6d0 0x7f49681d3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496ec9d640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f496814b1f0 0x7f49681e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496dc9b640 1 -- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496806a6d0 msgr2=0x7f49681d3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496dc9b640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496806a6d0 0x7f49681d3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496dc9b640 1 -- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f496814b1f0 msgr2=0x7f49681e2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496dc9b640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f496814b1f0 0x7f49681e2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.253+0000 7f496dc9b640 1 -- 172.21.15.31:0/1265471469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49640094d0 con 0x7f49680ba550 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.254+0000 7f496dc9b640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49680ba550 0x7f496814e3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49580098c0 tx=0x7f49580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.254+0000 7f495effd640 1 -- 172.21.15.31:0/1265471469 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495803a8f0 con 0x7f49680ba550 2023-12-22T08:40:58.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.254+0000 7f495effd640 1 -- 172.21.15.31:0/1265471469 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495803aa70 con 0x7f49680ba550 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.254+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4958009400 con 0x7f49680ba550 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.254+0000 7f495effd640 1 -- 172.21.15.31:0/1265471469 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495803ae20 con 0x7f49680ba550 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.254+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49680b59d0 con 0x7f49680ba550 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.255+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49680b5ef0 con 0x7f49680ba550 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.255+0000 7f495effd640 1 -- 172.21.15.31:0/1265471469 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f495804d440 con 0x7f49680ba550 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.256+0000 7f495effd640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f494c06a460 0x7f494c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.256+0000 7f495effd640 1 -- 172.21.15.31:0/1265471469 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49580aa9f0 con 0x7f49680ba550 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.256+0000 7f496e49c640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f494c06a460 0x7f494c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.256+0000 7f496e49c640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f494c06a460 0x7f494c06c920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4964009cf0 tx=0x7f4964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.260+0000 7f495effd640 1 -- 172.21.15.31:0/1265471469 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f49680b5ef0 con 0x7f49680ba550 2023-12-22T08:40:58.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.440+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49680b5ef0 con 0x7f49680ba550 2023-12-22T08:40:58.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.441+0000 7f495effd640 1 -- 172.21.15.31:0/1265471469 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f49680b5ef0 con 0x7f49680ba550 2023-12-22T08:40:58.443 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:58.444 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f494c06a460 msgr2=0x7f494c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f494c06a460 0x7f494c06c920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4964009cf0 tx=0x7f4964008040 comp rx=0 tx=0).stop 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49680ba550 msgr2=0x7f496814e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49680ba550 0x7f496814e3f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49580098c0 tx=0x7f49580046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 shutdown_connections 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f494c06a460 0x7f494c06c920 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f496814b1f0 0x7f49681e2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49680ba550 0x7f496814e3f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 --2- 172.21.15.31:0/1265471469 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f496806a6d0 0x7f49681d3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 >> 172.21.15.31:0/1265471469 conn(0x7f49680c0350 msgr2=0x7f49680c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 shutdown_connections 2023-12-22T08:40:58.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.443+0000 7f4970700640 1 -- 172.21.15.31:0/1265471469 wait complete. 2023-12-22T08:40:58.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:40:58.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.559+0000 7fc8d55fd640 1 Processor -- start 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.559+0000 7fc8d55fd640 1 -- start start 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8d55fd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc8d00b89f0 0x7fc8d00b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8d55fd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d00b4230 con 0x7fc8d00b7ea0 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8d55fd640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d00711c0 con 0x7fc8d00b8280 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8d55fd640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d00714a0 con 0x7fc8d00b89f0 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8ceffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc8d00b7ea0 0x7fc8d00b6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47298/0 (socket says 172.21.15.31:47298) 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8ceffd640 1 -- 172.21.15.31:0/1140980579 learned_addr learned my addr 172.21.15.31:0/1140980579 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8cf7fe640 1 --2- 172.21.15.31:0/1140980579 >> v2:172.21.15.69:3300/0 conn(0x7fc8d00b89f0 0x7fc8d00b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8cdffb640 1 -- 172.21.15.31:0/1140980579 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548055408 0 0) 0x7fc8d00b4230 con 0x7fc8d00b7ea0 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.560+0000 7fc8cdffb640 1 -- 172.21.15.31:0/1140980579 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8bc003520 con 0x7fc8d00b7ea0 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.561+0000 7fc8cdffb640 1 -- 172.21.15.31:0/1140980579 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124879142 0 0) 0x7fc8d00711c0 con 0x7fc8d00b8280 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.561+0000 7fc8cdffb640 1 -- 172.21.15.31:0/1140980579 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d00b4230 con 0x7fc8d00b8280 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.561+0000 7fc8cdffb640 1 -- 172.21.15.31:0/1140980579 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1414549551 0 0) 0x7fc8bc003520 con 0x7fc8d00b7ea0 2023-12-22T08:40:58.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.561+0000 7fc8cf7fe640 1 -- 172.21.15.31:0/1140980579 >> v1:172.21.15.69:6789/0 conn(0x7fc8d00b8280 legacy=0x7fc8d0142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.561+0000 7fc8cf7fe640 1 -- 172.21.15.31:0/1140980579 >> v1:172.21.15.31:6789/0 conn(0x7fc8d00b7ea0 legacy=0x7fc8d00b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.561+0000 7fc8cf7fe640 1 -- 172.21.15.31:0/1140980579 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0071780 con 0x7fc8d00b89f0 2023-12-22T08:40:58.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8cf7fe640 1 --2- 172.21.15.31:0/1140980579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b89f0 0x7fc8d00b8e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009d90 tx=0x7fc8c002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=757744adfca0637 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8cdffb640 1 -- 172.21.15.31:0/1140980579 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8001670 con 0x7fc8d00b89f0 2023-12-22T08:40:58.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8cdffb640 1 -- 172.21.15.31:0/1140980579 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c002c9d0 con 0x7fc8d00b89f0 2023-12-22T08:40:58.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8cdffb640 1 -- 172.21.15.31:0/1140980579 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c002cd40 con 0x7fc8d00b89f0 2023-12-22T08:40:58.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1140980579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b89f0 msgr2=0x7fc8d00b8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8d55fd640 1 --2- 172.21.15.31:0/1140980579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b89f0 0x7fc8d00b8e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009d90 tx=0x7fc8c002bea0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1140980579 shutdown_connections 2023-12-22T08:40:58.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8d55fd640 1 --2- 172.21.15.31:0/1140980579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b89f0 0x7fc8d00b8e00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1140980579 >> 172.21.15.31:0/1140980579 conn(0x7fc8d00bd060 msgr2=0x7fc8d00bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1140980579 shutdown_connections 2023-12-22T08:40:58.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.562+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1140980579 wait complete. 2023-12-22T08:40:58.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.563+0000 7fc8d55fd640 1 Processor -- start 2023-12-22T08:40:58.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8d55fd640 1 -- start start 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8d55fd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b7ea0 0x7fc8d0149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8d55fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8d00b8280 0x7fc8d0148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8d55fd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8d00b89f0 0x7fc8d01472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8d55fd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d01de560 con 0x7fc8d00b8280 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8d55fd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d01dd9d0 con 0x7fc8d00b7ea0 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8d55fd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d00a8170 con 0x7fc8d00b89f0 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8ce7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8d00b8280 0x7fc8d0148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8ce7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8d00b8280 0x7fc8d0148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39674/0 (socket says 172.21.15.31:39674) 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.564+0000 7fc8ce7fc640 1 -- 172.21.15.31:0/1507344596 learned_addr learned my addr 172.21.15.31:0/1507344596 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8ceffd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b7ea0 0x7fc8d0149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8ce7fc640 1 -- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8d00b89f0 msgr2=0x7fc8d01472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8cf7fe640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8d00b89f0 0x7fc8d01472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8ce7fc640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8d00b89f0 0x7fc8d01472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8ce7fc640 1 -- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b7ea0 msgr2=0x7fc8d0149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8ce7fc640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b7ea0 0x7fc8d0149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8ce7fc640 1 -- 172.21.15.31:0/1507344596 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009a70 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8ce7fc640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8d00b8280 0x7fc8d0148790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c490 tx=0x7fc8b800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8c77fe640 1 -- 172.21.15.31:0/1507344596 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80052d0 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8c77fe640 1 -- 172.21.15.31:0/1507344596 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8005430 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d00b37b0 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8c77fe640 1 -- 172.21.15.31:0/1507344596 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8012870 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.565+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d01ddea0 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.566+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d01de6a0 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.566+0000 7fc8c77fe640 1 -- 172.21.15.31:0/1507344596 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc8b80129d0 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.567+0000 7fc8c77fe640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc8b006a430 0x7fc8b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.567+0000 7fc8c77fe640 1 -- 172.21.15.31:0/1507344596 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8b80884a0 con 0x7fc8d00b8280 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.567+0000 7fc8ceffd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc8b006a430 0x7fc8b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:58.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.567+0000 7fc8ceffd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc8b006a430 0x7fc8b006c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8005880 tx=0x7fc8c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:58.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.571+0000 7fc8c77fe640 1 -- 172.21.15.31:0/1507344596 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc8d01de6a0 con 0x7fc8d00b8280 2023-12-22T08:40:58.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.785+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8d01de6a0 con 0x7fc8d00b8280 2023-12-22T08:40:58.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.785+0000 7fc8c77fe640 1 -- 172.21.15.31:0/1507344596 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7fc8d01de6a0 con 0x7fc8d00b8280 2023-12-22T08:40:58.788 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:40:58.788 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:40:45.862817+0000","modified":"2023-12-22T08:40:48.867080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:40:58.788 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc8b006a430 msgr2=0x7fc8b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc8b006a430 0x7fc8b006c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8005880 tx=0x7fc8c8009040 comp rx=0 tx=0).stop 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8d00b8280 msgr2=0x7fc8d0148790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8d00b8280 0x7fc8d0148790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c490 tx=0x7fc8b800c950 comp rx=0 tx=0).stop 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 shutdown_connections 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc8b006a430 0x7fc8b006c8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8d00b89f0 0x7fc8d01472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8d00b8280 0x7fc8d0148790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 --2- 172.21.15.31:0/1507344596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d00b7ea0 0x7fc8d0149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 >> 172.21.15.31:0/1507344596 conn(0x7fc8d00bd060 msgr2=0x7fc8d00bbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 shutdown_connections 2023-12-22T08:40:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:58.787+0000 7fc8d55fd640 1 -- 172.21.15.31:0/1507344596 wait complete. 2023-12-22T08:40:59.103 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:40:45.862817+0000', 'modified': '2023-12-22T08:40:48.867080+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/1404772098', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 1404772098}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 1404772098}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:40:59.103 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:40:59.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-22T08:40:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.212+0000 7fa7d1d00640 1 Processor -- start 2023-12-22T08:40:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.212+0000 7fa7d1d00640 1 -- start start 2023-12-22T08:40:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.212+0000 7fa7d1d00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7cc0b8b40 0x7fa7cc14a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7d1d00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0b83d0 con 0x7fa7cc141520 2023-12-22T08:40:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7d1d00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0b86b0 con 0x7fa7cc0b7740 2023-12-22T08:40:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7d1d00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc141900 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7caffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7cc0b8b40 0x7fa7cc14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7cb7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa7cc141520 0x7fa7cc0bc520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47310/0 (socket says 172.21.15.31:47310) 2023-12-22T08:40:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7caffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7cc0b8b40 0x7fa7cc14a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39688/0 (socket says 172.21.15.31:39688) 2023-12-22T08:40:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7cb7fe640 1 -- 172.21.15.31:0/1978290811 learned_addr learned my addr 172.21.15.31:0/1978290811 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:40:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7caffd640 1 -- 172.21.15.31:0/1978290811 >> v1:172.21.15.69:6789/0 conn(0x7fa7cc0b7740 legacy=0x7fa7cc1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7ca7fc640 1 -- 172.21.15.31:0/1978290811 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087945593 0 0) 0x7fa7cc0b83d0 con 0x7fa7cc141520 2023-12-22T08:40:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7caffd640 1 -- 172.21.15.31:0/1978290811 >> v1:172.21.15.31:6789/0 conn(0x7fa7cc141520 legacy=0x7fa7cc0bc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.213+0000 7fa7caffd640 1 -- 172.21.15.31:0/1978290811 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc0bc0c0 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7caffd640 1 --2- 172.21.15.31:0/1978290811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc14a980 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0097a0 tx=0x7fa7bc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ba129ebf53868f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7ca7fc640 1 -- 172.21.15.31:0/1978290811 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc031830 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7ca7fc640 1 -- 172.21.15.31:0/1978290811 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc031990 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7ca7fc640 1 -- 172.21.15.31:0/1978290811 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc031d20 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1978290811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 msgr2=0x7fa7cc14a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7d1d00640 1 --2- 172.21.15.31:0/1978290811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc14a980 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0097a0 tx=0x7fa7bc02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1978290811 shutdown_connections 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7d1d00640 1 --2- 172.21.15.31:0/1978290811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc14a980 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1978290811 >> 172.21.15.31:0/1978290811 conn(0x7fa7cc0c0300 msgr2=0x7fa7cc0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.214+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1978290811 shutdown_connections 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.215+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1978290811 wait complete. 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.215+0000 7fa7d1d00640 1 Processor -- start 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7d1d00640 1 -- start start 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7d1d00640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc0b7740 0x7fa7cc141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7d1d00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc1380c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7d1d00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc141520 0x7fa7cc1499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7d1d00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc143c50 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7d1d00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc149f20 con 0x7fa7cc141520 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7d1d00640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc1444b0 con 0x7fa7cc0b7740 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7caffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc1380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7caffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc1380c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39702/0 (socket says 172.21.15.31:39702) 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.216+0000 7fa7caffd640 1 -- 172.21.15.31:0/1060198393 learned_addr learned my addr 172.21.15.31:0/1060198393 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc141520 0x7fa7cc1499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc0b7740 0x7fa7cc141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7caffd640 1 -- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc0b7740 msgr2=0x7fa7cc141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7caffd640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc0b7740 0x7fa7cc141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7caffd640 1 -- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc141520 msgr2=0x7fa7cc1499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7caffd640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc141520 0x7fa7cc1499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7caffd640 1 -- 172.21.15.31:0/1060198393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc009400 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc0b7740 0x7fa7cc141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7caffd640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc1380c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc02bee0 tx=0x7fa7bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7b3fff640 1 -- 172.21.15.31:0/1060198393 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc03ba70 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7b3fff640 1 -- 172.21.15.31:0/1060198393 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc03bbf0 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1060198393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc144790 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7b3fff640 1 -- 172.21.15.31:0/1060198393 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0453f0 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.217+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1060198393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc1433f0 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.218+0000 7fa7b3fff640 1 -- 172.21.15.31:0/1060198393 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7bc04e450 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.219+0000 7fa7b3fff640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7b806a460 0x7fa7b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.219+0000 7fa7b3fff640 1 -- 172.21.15.31:0/1060198393 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7bc0aac60 con 0x7fa7cc0b8b40 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.219+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7b806a460 0x7fa7b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7b806a460 0x7fa7b806c920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0000f60 tx=0x7fa7c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7d4875740 1 Processor -- start 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7d4875740 1 -- start start 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0e9420 0x5555bc0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0adaf0 0x5555bc0de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0df180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7d4875740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bc01d030 con 0x5555bc0ded00 2023-12-22T08:40:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7d4875740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bc01a7c0 con 0x5555bc0e9420 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.220+0000 7fa7d4875740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555bc0160b0 con 0x5555bc0adaf0 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0df180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39718/0 (socket says 172.21.15.31:39718) 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 -- 172.21.15.31:0/530867541 learned_addr learned my addr 172.21.15.31:0/530867541 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0e9420 0x5555bc0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7caffd640 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0adaf0 0x5555bc0de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 -- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0adaf0 msgr2=0x5555bc0de7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0adaf0 0x5555bc0de7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 -- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0e9420 msgr2=0x5555bc0ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0e9420 0x5555bc0ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 -- 172.21.15.31:0/530867541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555bbfd0bc0 con 0x5555bc0ded00 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7caffd640 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0adaf0 0x5555bc0de7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:40:59.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0df180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4001c40 tx=0x7fa7c4002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c57700b8f9dfd33 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7b17fa640 1 -- 172.21.15.31:0/530867541 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4003b80 con 0x5555bc0ded00 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7b17fa640 1 -- 172.21.15.31:0/530867541 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4003ce0 con 0x5555bc0ded00 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.221+0000 7fa7b17fa640 1 -- 172.21.15.31:0/530867541 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400ea30 con 0x5555bc0ded00 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 -- 172.21.15.31:0/530867541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 msgr2=0x5555bc0df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0df180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4001c40 tx=0x7fa7c4002100 comp rx=0 tx=0).stop 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 -- 172.21.15.31:0/530867541 shutdown_connections 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0df180 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0adaf0 0x5555bc0de7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 --2- 172.21.15.31:0/530867541 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0e9420 0x5555bc0ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 -- 172.21.15.31:0/530867541 >> 172.21.15.31:0/530867541 conn(0x5555bc0aef80 msgr2=0x5555bc0e8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 -- 172.21.15.31:0/530867541 shutdown_connections 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.222+0000 7fa7d4875740 1 -- 172.21.15.31:0/530867541 wait complete. 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 1 -- start start 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 1 Processor -- start 2023-12-22T08:40:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0dcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0e9420 0x5555bc0db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 0x5555bc0d5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bbfd47c0 con 0x5555bc0ded00 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bbfd4460 con 0x5555bc0ddb10 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555bbf9a1b0 con 0x5555bc0e9420 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7cb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0dcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7d4875740 10 client.0 _ll_register_callbacks cb 0x5555bbf9d6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7cb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0dcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39730/0 (socket says 172.21.15.31:39730) 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7cb7fe640 1 -- 172.21.15.31:0/3301371343 learned_addr learned my addr 172.21.15.31:0/3301371343 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7caffd640 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0e9420 0x5555bc0db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.223+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 0x5555bc0d5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7cb7fe640 1 -- 172.21.15.31:0/3301371343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0e9420 msgr2=0x5555bc0db760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0e9420 0x5555bc0db760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7cb7fe640 1 -- 172.21.15.31:0/3301371343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 msgr2=0x5555bc0d5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 0x5555bc0d5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7cb7fe640 1 -- 172.21.15.31:0/3301371343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c400f040 con 0x5555bc0ded00 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0dcec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0005ad0 tx=0x7fa7c0007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af685c5f1b75a8b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3301371343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0001d60 con 0x5555bc0ded00 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3301371343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c0021a90 con 0x5555bc0ded00 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 1 -- 172.21.15.31:0/3301371343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555bc0079e0 con 0x5555bc0ded00 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3301371343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7c0021c90 con 0x5555bc0ded00 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 10 client.4674 fetch_fsmap learned FSMap version 7 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 1 -- 172.21.15.31:0/3301371343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5555bc014730 con 0x5555bc0ded00 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3301371343 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555bc0079e0 con 0x5555bc0ded00 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3301371343 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7fa7c002b3b0 con 0x5555bc0ded00 2023-12-22T08:40:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 10 client.4674 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 20 client.4674 populate_metadata read hostname 'smithi031' 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] conn(0x5555bc0f89a0 0x5555bc0f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 4 client.4674 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.224+0000 7fa7d4875740 1 -- 172.21.15.31:0/3301371343 --> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555bc00f130 con 0x5555bc0f89a0 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7caffd640 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] conn(0x5555bc0f89a0 0x5555bc0f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7caffd640 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] conn(0x5555bc0f89a0 0x5555bc0f8d80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274a148743ebaf9f server_cookie=74c112f18c82ce50 in_seq=0 out_seq=0 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7aa7fc640 10 client.4674 ms_handle_connect on v2:172.21.15.31:6833/1404772098 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3301371343 <== mds.0 v2:172.21.15.31:6833/1404772098 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5555bc00f130 con 0x5555bc0f89a0 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7aa7fc640 10 client.4674 handle_command_reply: tid=0 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 client.4674 shutdown 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 -- 172.21.15.31:0/3301371343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 msgr2=0x5555bc0dcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0dcec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0005ad0 tx=0x7fa7c0007940 comp rx=0 tx=0).stop 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 -- 172.21.15.31:0/3301371343 shutdown_connections 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] conn(0x5555bc0f89a0 0x5555bc0f8d80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 0x5555bc0d5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7aa7fc640 0 client.4674 ms_handle_reset on v2:172.21.15.31:6833/1404772098 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0e9420 0x5555bc0db760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3301371343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0ded00 0x5555bc0dcec0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.225+0000 7fa7d4875740 1 -- 172.21.15.31:0/3301371343 >> 172.21.15.31:0/3301371343 conn(0x5555bc0adaf0 msgr2=0x5555bc0d9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.226+0000 7fa7d4875740 1 -- 172.21.15.31:0/3301371343 shutdown_connections 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.226+0000 7fa7d4875740 1 -- 172.21.15.31:0/3301371343 wait complete. 2023-12-22T08:40:59.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.226+0000 7fa7d4875740 20 client.4674 trim_cache size 0 max 16384 2023-12-22T08:40:59.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7d4875740 1 Processor -- start 2023-12-22T08:40:59.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7d4875740 1 -- start start 2023-12-22T08:40:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ddb10 0x5555bc0da680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ded00 0x5555bc0d5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc0e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7d4875740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bc0dd850 con 0x5555bc0e9420 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7d4875740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bc0b2ca0 con 0x5555bc0ded00 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7d4875740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555bc0aed30 con 0x5555bc0ddb10 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc0e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc0e43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39738/0 (socket says 172.21.15.31:39738) 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.241+0000 7fa7cbfff640 1 -- 172.21.15.31:0/2102138944 learned_addr learned my addr 172.21.15.31:0/2102138944 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7cbfff640 1 -- 172.21.15.31:0/2102138944 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ddb10 msgr2=0x5555bc0da680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ddb10 0x5555bc0da680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ddb10 0x5555bc0da680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7cbfff640 1 -- 172.21.15.31:0/2102138944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ded00 msgr2=0x5555bc0d5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7caffd640 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ded00 0x5555bc0d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ded00 0x5555bc0d5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7cbfff640 1 -- 172.21.15.31:0/2102138944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555bbfb6b60 con 0x5555bc0e9420 2023-12-22T08:40:59.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc0e43d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4013000 tx=0x7fa7c400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3577af33b342852 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7b1ffb640 1 -- 172.21.15.31:0/2102138944 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4006b50 con 0x5555bc0e9420 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7b1ffb640 1 -- 172.21.15.31:0/2102138944 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4006cb0 con 0x5555bc0e9420 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.242+0000 7fa7b1ffb640 1 -- 172.21.15.31:0/2102138944 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400ea70 con 0x5555bc0e9420 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 -- 172.21.15.31:0/2102138944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 msgr2=0x5555bc0e43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc0e43d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4013000 tx=0x7fa7c400a000 comp rx=0 tx=0).stop 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 -- 172.21.15.31:0/2102138944 shutdown_connections 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc0e43d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ded00 0x5555bc0d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 --2- 172.21.15.31:0/2102138944 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ddb10 0x5555bc0da680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 -- 172.21.15.31:0/2102138944 >> 172.21.15.31:0/2102138944 conn(0x5555bc0adaf0 msgr2=0x5555bc0a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 -- 172.21.15.31:0/2102138944 shutdown_connections 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 -- 172.21.15.31:0/2102138944 wait complete. 2023-12-22T08:40:59.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 -- start start 2023-12-22T08:40:59.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.243+0000 7fa7d4875740 1 Processor -- start 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 0x5555bc0da810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ded00 0x5555bc145220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7d4875740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc145760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7d4875740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bc0e4d50 con 0x5555bc0e9420 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7d4875740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bc0dad50 con 0x5555bc0ddb10 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7d4875740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555bc104100 con 0x5555bc0ded00 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7d4875740 10 client.0 _ll_register_callbacks cb 0x7fa7c40016e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc145760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39740/0 (socket says 172.21.15.31:39740) 2023-12-22T08:40:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 -- 172.21.15.31:0/3749006265 learned_addr learned my addr 172.21.15.31:0/3749006265 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7caffd640 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ded00 0x5555bc145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 0x5555bc0da810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 -- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ded00 msgr2=0x5555bc145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ded00 0x5555bc145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 -- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 msgr2=0x5555bc0da810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 0x5555bc0da810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 -- 172.21.15.31:0/3749006265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555bbfd0bc0 con 0x5555bc0e9420 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7caffd640 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ded00 0x5555bc145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7cbfff640 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc145760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4002140 tx=0x7fa7c4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38b3e8c27447dd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3749006265 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400eeb0 con 0x5555bc0e9420 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3749006265 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c40050d0 con 0x5555bc0e9420 2023-12-22T08:40:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.244+0000 7fa7d4875740 1 -- 172.21.15.31:0/3749006265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555bc0dc150 con 0x5555bc0e9420 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3749006265 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7c4005290 con 0x5555bc0e9420 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 10 client.4680 fetch_fsmap learned FSMap version 7 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 1 -- 172.21.15.31:0/3749006265 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5555bbfdc270 con 0x5555bc0e9420 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3749006265 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555bc0dc150 con 0x5555bc0e9420 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3749006265 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7fa7c40053f0 con 0x5555bc0e9420 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 10 client.4680 fetch_fsmap finished waiting for FSMap version 7 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 10 client.4680 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 20 client.4680 populate_metadata read hostname 'smithi031' 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] conn(0x5555bc14fa70 0x5555bc145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 4 client.4680 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 1 -- 172.21.15.31:0/3749006265 --> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fa7c4003ce0 con 0x5555bc14fa70 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] conn(0x5555bc14fa70 0x5555bc145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7cb7fe640 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] conn(0x5555bc14fa70 0x5555bc145ca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=172b1679bef546af server_cookie=550958bb5d1cf686 in_seq=0 out_seq=0 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7aa7fc640 10 client.4680 ms_handle_connect on v2:172.21.15.31:6833/1404772098 2023-12-22T08:40:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7aa7fc640 1 -- 172.21.15.31:0/3749006265 <== mds.0 v2:172.21.15.31:6833/1404772098 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7fa7c4003ce0 con 0x5555bc14fa70 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7aa7fc640 10 client.4680 handle_command_reply: tid=0 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.245+0000 7fa7d4875740 1 client.4680 shutdown 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 -- 172.21.15.31:0/3749006265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 msgr2=0x5555bc145760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc145760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4002140 tx=0x7fa7c4001250 comp rx=0 tx=0).stop 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 -- 172.21.15.31:0/3749006265 shutdown_connections 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.31:6833/1404772098,v1:172.21.15.31:6835/1404772098] conn(0x5555bc14fa70 0x5555bc145ca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5555bc0e9420 0x5555bc145760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7aa7fc640 0 client.4680 ms_handle_reset on v2:172.21.15.31:6833/1404772098 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5555bc0ded00 0x5555bc145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 --2- 172.21.15.31:0/3749006265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5555bc0ddb10 0x5555bc0da810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 -- 172.21.15.31:0/3749006265 >> 172.21.15.31:0/3749006265 conn(0x5555bc0adaf0 msgr2=0x5555bc0d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 -- 172.21.15.31:0/3749006265 shutdown_connections 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 1 -- 172.21.15.31:0/3749006265 wait complete. 2023-12-22T08:40:59.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d4875740 20 client.4680 trim_cache size 0 max 16384 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e4a54bac-4042-4984-af5f-75635705de5c", 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4293, 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 13.382238623999999, 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 7, 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 20, 2023-12-22T08:40:59.256 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 20, 2023-12-22T08:40:59.257 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 19.728470323 2023-12-22T08:40:59.257 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:40:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7b806a460 msgr2=0x7fa7b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7b806a460 0x7fa7b806c920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0000f60 tx=0x7fa7c0009040 comp rx=0 tx=0).stop 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1060198393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 msgr2=0x7fa7cc1380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc1380c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc02bee0 tx=0x7fa7bc0046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1060198393 shutdown_connections 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7b806a460 0x7fa7b806c920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc141520 0x7fa7cc1499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7cc0b8b40 0x7fa7cc1380c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 --2- 172.21.15.31:0/1060198393 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc0b7740 0x7fa7cc141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1060198393 >> 172.21.15.31:0/1060198393 conn(0x7fa7cc0c0300 msgr2=0x7fa7cc14b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1060198393 shutdown_connections 2023-12-22T08:40:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.246+0000 7fa7d1d00640 1 -- 172.21.15.31:0/1060198393 wait complete. 2023-12-22T08:40:59.260 INFO:teuthology.run_tasks:Running task kclient... 2023-12-22T08:40:59.284 INFO:tasks.kclient:Mounting kernel clients... 2023-12-22T08:40:59.284 INFO:tasks.kclient:config is {'client.0': {}} 2023-12-22T08:40:59.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:59.285 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-12-22T08:40:59.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:59.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-12-22T08:40:59.448 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-12-22T08:40:59.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:40:59.451 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-22T08:40:59.452 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-22T08:40:59.452 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:40:59.452 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:40:59.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.556+0000 7ff21d87d640 1 Processor -- start 2023-12-22T08:40:59.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.556+0000 7ff21d87d640 1 -- start start 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff21d87d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff218145110 0x7ff218070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff21d87d640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff218069d00 0x7ff2180b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff21d87d640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21814bbe0 con 0x7ff21806a170 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff21d87d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180b7230 con 0x7ff218145110 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff21d87d640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21814b750 con 0x7ff218069d00 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff216ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff218145110 0x7ff218070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff216ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff218145110 0x7ff218070350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39748/0 (socket says 172.21.15.31:39748) 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff216ffd640 1 -- 172.21.15.31:0/4266187125 learned_addr learned my addr 172.21.15.31:0/4266187125 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff216ffd640 1 -- 172.21.15.31:0/4266187125 >> v2:172.21.15.69:3300/0 conn(0x7ff218069d00 msgr2=0x7ff2180b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff216ffd640 1 --2- 172.21.15.31:0/4266187125 >> v2:172.21.15.69:3300/0 conn(0x7ff218069d00 0x7ff2180b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff216ffd640 1 -- 172.21.15.31:0/4266187125 >> v1:172.21.15.69:6789/0 conn(0x7ff21806a170 legacy=0x7ff21814e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:40:59.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.557+0000 7ff216ffd640 1 -- 172.21.15.31:0/4266187125 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21814ae20 con 0x7ff218145110 2023-12-22T08:40:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.558+0000 7ff216ffd640 1 --2- 172.21.15.31:0/4266187125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218145110 0x7ff218070350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff21806fae0 tx=0x7ff21002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f507ff4fec02010 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.558+0000 7ff215ffb640 1 -- 172.21.15.31:0/4266187125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100317e0 con 0x7ff218145110 2023-12-22T08:40:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.558+0000 7ff215ffb640 1 -- 172.21.15.31:0/4266187125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210031940 con 0x7ff218145110 2023-12-22T08:40:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.558+0000 7ff215ffb640 1 -- 172.21.15.31:0/4266187125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210031cd0 con 0x7ff218145110 2023-12-22T08:40:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.559+0000 7ff21d87d640 1 -- 172.21.15.31:0/4266187125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218145110 msgr2=0x7ff218070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.559+0000 7ff21d87d640 1 --2- 172.21.15.31:0/4266187125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218145110 0x7ff218070350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff21806fae0 tx=0x7ff21002b880 comp rx=0 tx=0).stop 2023-12-22T08:40:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.559+0000 7ff21d87d640 1 -- 172.21.15.31:0/4266187125 shutdown_connections 2023-12-22T08:40:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.559+0000 7ff21d87d640 1 --2- 172.21.15.31:0/4266187125 >> v2:172.21.15.69:3300/0 conn(0x7ff218069d00 0x7ff2180b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.559+0000 7ff21d87d640 1 --2- 172.21.15.31:0/4266187125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218145110 0x7ff218070350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.559+0000 7ff21d87d640 1 -- 172.21.15.31:0/4266187125 >> 172.21.15.31:0/4266187125 conn(0x7ff2180bd060 msgr2=0x7ff2180bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.559+0000 7ff21d87d640 1 -- 172.21.15.31:0/4266187125 shutdown_connections 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.559+0000 7ff21d87d640 1 -- 172.21.15.31:0/4266187125 wait complete. 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.560+0000 7ff21d87d640 1 Processor -- start 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.560+0000 7ff21d87d640 1 -- start start 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff21d87d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218069d00 0x7ff218143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff21d87d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21806a170 0x7ff2181e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff21d87d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff218145110 0x7ff2181412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff21d87d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff218144080 con 0x7ff218069d00 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff21d87d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2181e0780 con 0x7ff21806a170 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff21d87d640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180bc9d0 con 0x7ff218145110 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218069d00 0x7ff218143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218069d00 0x7ff218143b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39760/0 (socket says 172.21.15.31:39760) 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 -- 172.21.15.31:0/2330202113 learned_addr learned my addr 172.21.15.31:0/2330202113 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff2167fc640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21806a170 0x7ff2181e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff2177fe640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff218145110 0x7ff2181412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 -- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff218145110 msgr2=0x7ff2181412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff218145110 0x7ff2181412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 -- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21806a170 msgr2=0x7ff2181e0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21806a170 0x7ff2181e0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 -- 172.21.15.31:0/2330202113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100094d0 con 0x7ff218069d00 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff216ffd640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218069d00 0x7ff218143b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff210000c00 tx=0x7ff2100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff20ffff640 1 -- 172.21.15.31:0/2330202113 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210032880 con 0x7ff218069d00 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff20ffff640 1 -- 172.21.15.31:0/2330202113 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100329e0 con 0x7ff218069d00 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff20ffff640 1 -- 172.21.15.31:0/2330202113 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210032d90 con 0x7ff218069d00 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.561+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2181d2b80 con 0x7ff218069d00 2023-12-22T08:40:59.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.562+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2181d4010 con 0x7ff218069d00 2023-12-22T08:40:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.563+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2181e0c30 con 0x7ff218069d00 2023-12-22T08:40:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.563+0000 7ff20ffff640 1 -- 172.21.15.31:0/2330202113 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff21004d3f0 con 0x7ff218069d00 2023-12-22T08:40:59.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.563+0000 7ff20ffff640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff1f806a430 0x7ff1f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:40:59.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.563+0000 7ff20ffff640 1 -- 172.21.15.31:0/2330202113 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2100aa840 con 0x7ff218069d00 2023-12-22T08:40:59.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.564+0000 7ff2167fc640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff1f806a430 0x7ff1f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:40:59.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.564+0000 7ff2167fc640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff1f806a430 0x7ff1f806c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff218148470 tx=0x7ff200008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:40:59.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.568+0000 7ff20ffff640 1 -- 172.21.15.31:0/2330202113 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff2181e0c30 con 0x7ff218069d00 2023-12-22T08:40:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.780+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff2181e0c30 con 0x7ff218069d00 2023-12-22T08:40:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.780+0000 7ff20ffff640 1 -- 172.21.15.31:0/2330202113 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2181e0c30 con 0x7ff218069d00 2023-12-22T08:40:59.783 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:40:59.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff1f806a430 msgr2=0x7ff1f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff1f806a430 0x7ff1f806c8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff218148470 tx=0x7ff200008040 comp rx=0 tx=0).stop 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218069d00 msgr2=0x7ff218143b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218069d00 0x7ff218143b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff210000c00 tx=0x7ff2100046c0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 shutdown_connections 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff1f806a430 0x7ff1f806c8f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff218145110 0x7ff2181412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21806a170 0x7ff2181e0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 --2- 172.21.15.31:0/2330202113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff218069d00 0x7ff218143b40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 >> 172.21.15.31:0/2330202113 conn(0x7ff2180bd060 msgr2=0x7ff21806ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 shutdown_connections 2023-12-22T08:40:59.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:40:59.782+0000 7ff21d87d640 1 -- 172.21.15.31:0/2330202113 wait complete. 2023-12-22T08:40:59.795 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T08:40:59.795 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:40:59.795 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-12-22T08:40:59.795 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:40:59.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:40:59.795 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T08:40:59.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T08:40:59.796 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:40:59.796 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:40:59.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:59.796 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-12-22T08:40:59.856 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:40:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:40:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:59.857 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:40:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:40:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:40:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-12-22T08:40:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-12-22T08:40:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:40:59.858 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-22T08:40:59.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:40:59.859 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-22T08:40:59.859 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-22T08:40:59.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-12-22T08:40:59.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-12-22T08:40:59.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-12-22T08:40:59.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-22T08:40:59.859 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-22T08:41:00.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:00.317 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:41:00.394 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-12-22T08:41:00.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:00.398 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-12-22T08:41:00.456 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-12-22T08:41:00.456 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:41:00.456 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:41:00.456 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:41:00.457 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:41:00.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:00.457 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-22T08:41:00.457 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-22T08:41:00.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:41:00.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:41:00.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:41:00.457 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-22T08:41:01.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:01.234 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-12-22T08:41:01.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:01.280 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-12-22T08:41:01.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:01.374 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-22T08:41:01.374 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-22T08:41:01.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:41:01.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-22T08:41:01.374 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-22T08:41:01.496 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-22T08:41:01.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:01.497 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-22T08:41:01.497 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-22T08:41:01.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-22T08:41:01.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-22T08:41:01.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-22T08:41:01.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-22T08:41:01.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-22T08:41:01.497 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-22T08:41:01.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:01.765 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-22T08:41:01.765 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-22T08:41:01.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-12-22T08:41:01.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-12-22T08:41:01.765 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-22T08:41:01.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:41:01.914 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:01.960 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:41:01.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:41:01.960 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:02.053 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T08:41:02.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:02.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T08:41:02.212 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T08:41:02.212 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T08:41:02.212 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-22T08:41:02.689 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T08:41:02.689 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T08:41:02.689 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-22T08:41:02.689 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.69:3300,172.21.15.69:3301" 2023-12-22T08:41:02.689 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T08:41:02.720 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T08:41:02.720 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T08:41:02.720 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-22T08:41:02.720 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.69:3300,172.21.15.69:3301" 2023-12-22T08:41:02.720 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T08:41:02.720 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.69:6789,172.21.15.69:6790" 2023-12-22T08:41:02.720 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.69:6789,172.21.15.69:6790:/ 2023-12-22T08:41:02.720 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e4a54bac-4042-4984-af5f-75635705de5c" will pass to kernel 2023-12-22T08:41:02.723 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:41:02.723 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:41:02.723 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:41:02.723 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:41:02.723 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:41:02.728 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:41:02.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:02.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:02.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:02.815 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:02.879 INFO:teuthology.orchestra.run.smithi081.stdout:client4689 2023-12-22T08:41:02.879 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:41:02.879 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:02.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:02.931 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:03.042 INFO:teuthology.orchestra.run.smithi081.stdout:client4689 2023-12-22T08:41:03.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:03.043 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:03.114 INFO:teuthology.orchestra.run.smithi081.stdout:client4689 2023-12-22T08:41:03.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:03.114 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e4a54bac-4042-4984-af5f-75635705de5c.client4689/status') 2023-12-22T08:41:03.218 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4689 (3)172.21.15.81:0/1824890430 2023-12-22T08:41:03.219 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2023-12-22T08:41:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2023-12-22T08:41:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2023-12-22T08:41:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 7.0234e-05 s, 997 kB/s 2023-12-22T08:41:03.223 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-22T08:41:03.239 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:03.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.353+0000 7fdd147d0640 1 Processor -- start 2023-12-22T08:41:03.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.354+0000 7fdd147d0640 1 -- start start 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.354+0000 7fdd147d0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c070ec0 0x7fdd0c0b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.354+0000 7fdd147d0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd0c0712a0 0x7fdd0c1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.354+0000 7fdd147d0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c0b8550 con 0x7fdd0c148ef0 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.354+0000 7fdd147d0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c0b7a70 con 0x7fdd0c0712a0 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.354+0000 7fdd147d0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0b7d50 con 0x7fdd0c070ec0 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd11d6b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd0c0712a0 0x7fdd0c1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd11d6b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd0c0712a0 0x7fdd0c1489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39764/0 (socket says 172.21.15.31:39764) 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd11d6b640 1 -- 172.21.15.31:0/2293134533 learned_addr learned my addr 172.21.15.31:0/2293134533 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd1256c640 1 --2- 172.21.15.31:0/2293134533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c070ec0 0x7fdd0c0b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd11d6b640 1 -- 172.21.15.31:0/2293134533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c070ec0 msgr2=0x7fdd0c0b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:03.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd11d6b640 1 --2- 172.21.15.31:0/2293134533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c070ec0 0x7fdd0c0b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd11d6b640 1 -- 172.21.15.31:0/2293134533 >> v1:172.21.15.69:6789/0 conn(0x7fdd0c148ef0 legacy=0x7fdd0c14bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd11d6b640 1 -- 172.21.15.31:0/2293134533 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0b8030 con 0x7fdd0c0712a0 2023-12-22T08:41:03.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.355+0000 7fdd1256c640 1 --2- 172.21.15.31:0/2293134533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c070ec0 0x7fdd0c0b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:03.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.356+0000 7fdd11d6b640 1 --2- 172.21.15.31:0/2293134533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c0712a0 0x7fdd0c1489b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009870 tx=0x7fdcfc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4771e7c6f0892468 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.356+0000 7fdd1156a640 1 -- 172.21.15.31:0/2293134533 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc02f840 con 0x7fdd0c0712a0 2023-12-22T08:41:03.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.356+0000 7fdd1156a640 1 -- 172.21.15.31:0/2293134533 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc02f9a0 con 0x7fdd0c0712a0 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.356+0000 7fdd1156a640 1 -- 172.21.15.31:0/2293134533 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc02fd30 con 0x7fdd0c0712a0 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.356+0000 7fdd147d0640 1 -- 172.21.15.31:0/2293134533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c0712a0 msgr2=0x7fdd0c1489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.356+0000 7fdd147d0640 1 --2- 172.21.15.31:0/2293134533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c0712a0 0x7fdd0c1489b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009870 tx=0x7fdcfc02ba20 comp rx=0 tx=0).stop 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.357+0000 7fdd147d0640 1 -- 172.21.15.31:0/2293134533 shutdown_connections 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.357+0000 7fdd147d0640 1 --2- 172.21.15.31:0/2293134533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c0712a0 0x7fdd0c1489b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.357+0000 7fdd147d0640 1 --2- 172.21.15.31:0/2293134533 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c070ec0 0x7fdd0c0b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.357+0000 7fdd147d0640 1 -- 172.21.15.31:0/2293134533 >> 172.21.15.31:0/2293134533 conn(0x7fdd0c0be150 msgr2=0x7fdd0c0be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.357+0000 7fdd147d0640 1 -- 172.21.15.31:0/2293134533 shutdown_connections 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.357+0000 7fdd147d0640 1 -- 172.21.15.31:0/2293134533 wait complete. 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd147d0640 1 Processor -- start 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd147d0640 1 -- start start 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd147d0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c070ec0 0x7fdd0c138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd147d0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c0712a0 0x7fdd0c137d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd147d0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd0c148ef0 0x7fdd0c13b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd147d0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c13b710 con 0x7fdd0c070ec0 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd147d0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1369a0 con 0x7fdd0c148ef0 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd147d0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c138ec0 con 0x7fdd0c0712a0 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd1256c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c070ec0 0x7fdd0c138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd1256c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c070ec0 0x7fdd0c138810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39776/0 (socket says 172.21.15.31:39776) 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.358+0000 7fdd1256c640 1 -- 172.21.15.31:0/237060985 learned_addr learned my addr 172.21.15.31:0/237060985 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd12d6d640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd0c148ef0 0x7fdd0c13b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd11d6b640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c0712a0 0x7fdd0c137d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd1256c640 1 -- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c0712a0 msgr2=0x7fdd0c137d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd1256c640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c0712a0 0x7fdd0c137d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd1256c640 1 -- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd0c148ef0 msgr2=0x7fdd0c13b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd1256c640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd0c148ef0 0x7fdd0c13b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd1256c640 1 -- 172.21.15.31:0/237060985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc0094d0 con 0x7fdd0c070ec0 2023-12-22T08:41:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd1256c640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c070ec0 0x7fdd0c138810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800e7e0 tx=0x7fdd0800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd02ffd640 1 -- 172.21.15.31:0/237060985 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08004030 con 0x7fdd0c070ec0 2023-12-22T08:41:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd02ffd640 1 -- 172.21.15.31:0/237060985 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd08004190 con 0x7fdd0c070ec0 2023-12-22T08:41:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c1391a0 con 0x7fdd0c070ec0 2023-12-22T08:41:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd02ffd640 1 -- 172.21.15.31:0/237060985 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08004520 con 0x7fdd0c070ec0 2023-12-22T08:41:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.359+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c1ddf30 con 0x7fdd0c070ec0 2023-12-22T08:41:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.360+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c1367e0 con 0x7fdd0c070ec0 2023-12-22T08:41:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.361+0000 7fdd02ffd640 1 -- 172.21.15.31:0/237060985 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd0800c670 con 0x7fdd0c070ec0 2023-12-22T08:41:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.361+0000 7fdd02ffd640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcf006a430 0x7fdcf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.361+0000 7fdd02ffd640 1 -- 172.21.15.31:0/237060985 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd08088560 con 0x7fdd0c070ec0 2023-12-22T08:41:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.361+0000 7fdd11d6b640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcf006a430 0x7fdcf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.362+0000 7fdd11d6b640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcf006a430 0x7fdcf006c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc036000 tx=0x7fdcfc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.365+0000 7fdd02ffd640 1 -- 172.21.15.31:0/237060985 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdd0c1367e0 con 0x7fdd0c070ec0 2023-12-22T08:41:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.546+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd0c1367e0 con 0x7fdd0c070ec0 2023-12-22T08:41:03.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.547+0000 7fdd02ffd640 1 -- 172.21.15.31:0/237060985 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fdd0c1367e0 con 0x7fdd0c070ec0 2023-12-22T08:41:03.550 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:03.551 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcf006a430 msgr2=0x7fdcf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcf006a430 0x7fdcf006c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc036000 tx=0x7fdcfc008030 comp rx=0 tx=0).stop 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c070ec0 msgr2=0x7fdd0c138810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c070ec0 0x7fdd0c138810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800e7e0 tx=0x7fdd0800eca0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 shutdown_connections 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcf006a430 0x7fdcf006c8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd0c148ef0 0x7fdd0c13b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdd0c0712a0 0x7fdd0c137d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 --2- 172.21.15.31:0/237060985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd0c070ec0 0x7fdd0c138810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 >> 172.21.15.31:0/237060985 conn(0x7fdd0c0be150 msgr2=0x7fdd0c0b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 shutdown_connections 2023-12-22T08:41:03.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.549+0000 7fdd147d0640 1 -- 172.21.15.31:0/237060985 wait complete. 2023-12-22T08:41:03.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:03.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:03.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.669+0000 7fa5c87fd640 1 Processor -- start 2023-12-22T08:41:03.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.669+0000 7fa5c87fd640 1 -- start start 2023-12-22T08:41:03.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c87fd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa5c0069f70 0x7fa5c00b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c87fd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c014b1b0 0x7fa5c0144e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c87fd640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c0070570 con 0x7fa5c0144a20 2023-12-22T08:41:03.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c87fd640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c00719e0 con 0x7fa5c0069f70 2023-12-22T08:41:03.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c87fd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c006ff60 con 0x7fa5c014b1b0 2023-12-22T08:41:03.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c6599640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa5c0069f70 0x7fa5c00b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c6d9a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c014b1b0 0x7fa5c0144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c6599640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa5c0069f70 0x7fa5c00b9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:44586/0 (socket says 172.21.15.31:44586) 2023-12-22T08:41:03.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c6599640 1 -- 172.21.15.31:0/2455755594 learned_addr learned my addr 172.21.15.31:0/2455755594 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:03.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.670+0000 7fa5c5d98640 1 --1- 172.21.15.31:0/2455755594 >> v1:172.21.15.69:6789/0 conn(0x7fa5c0144a20 0x7fa5c014aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:33852/0 (socket says 172.21.15.31:33852) 2023-12-22T08:41:03.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.671+0000 7fa5c6d9a640 1 -- 172.21.15.31:0/2455755594 >> v2:172.21.15.69:3300/0 conn(0x7fa5c0069f70 msgr2=0x7fa5c00b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:03.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.671+0000 7fa5c6d9a640 1 --2- 172.21.15.31:0/2455755594 >> v2:172.21.15.69:3300/0 conn(0x7fa5c0069f70 0x7fa5c00b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.671+0000 7fa5c6d9a640 1 -- 172.21.15.31:0/2455755594 >> v1:172.21.15.69:6789/0 conn(0x7fa5c0144a20 legacy=0x7fa5c014aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.671+0000 7fa5c6d9a640 1 -- 172.21.15.31:0/2455755594 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c006bda0 con 0x7fa5c014b1b0 2023-12-22T08:41:03.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.671+0000 7fa5c6599640 1 --2- 172.21.15.31:0/2455755594 >> v2:172.21.15.69:3300/0 conn(0x7fa5c0069f70 0x7fa5c00b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:03.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c6d9a640 1 --2- 172.21.15.31:0/2455755594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c014b1b0 0x7fa5c0144e60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009d90 tx=0x7fa5bc02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84b103b0f010f7d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c5597640 1 -- 172.21.15.31:0/2455755594 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc02cce0 con 0x7fa5c014b1b0 2023-12-22T08:41:03.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c5597640 1 -- 172.21.15.31:0/2455755594 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc02ce40 con 0x7fa5c014b1b0 2023-12-22T08:41:03.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c5597640 1 -- 172.21.15.31:0/2455755594 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc034660 con 0x7fa5c014b1b0 2023-12-22T08:41:03.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c87fd640 1 -- 172.21.15.31:0/2455755594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c014b1b0 msgr2=0x7fa5c0144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/2455755594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c014b1b0 0x7fa5c0144e60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009d90 tx=0x7fa5bc02bf30 comp rx=0 tx=0).stop 2023-12-22T08:41:03.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c87fd640 1 -- 172.21.15.31:0/2455755594 shutdown_connections 2023-12-22T08:41:03.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/2455755594 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c014b1b0 0x7fa5c0144e60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/2455755594 >> v2:172.21.15.69:3300/0 conn(0x7fa5c0069f70 0x7fa5c00b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c87fd640 1 -- 172.21.15.31:0/2455755594 >> 172.21.15.31:0/2455755594 conn(0x7fa5c006ae10 msgr2=0x7fa5c006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:03.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c87fd640 1 -- 172.21.15.31:0/2455755594 shutdown_connections 2023-12-22T08:41:03.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.672+0000 7fa5c87fd640 1 -- 172.21.15.31:0/2455755594 wait complete. 2023-12-22T08:41:03.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.673+0000 7fa5c87fd640 1 Processor -- start 2023-12-22T08:41:03.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.673+0000 7fa5c87fd640 1 -- start start 2023-12-22T08:41:03.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c87fd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c0069f70 0x7fa5c01e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c87fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c0144a20 0x7fa5c009ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c87fd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5c014b1b0 0x7fa5c009f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c87fd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c009e960 con 0x7fa5c0144a20 2023-12-22T08:41:03.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c87fd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c01e3810 con 0x7fa5c014b1b0 2023-12-22T08:41:03.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c87fd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c0148470 con 0x7fa5c0069f70 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c5d98640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c0144a20 0x7fa5c009ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c5d98640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c0144a20 0x7fa5c009ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39790/0 (socket says 172.21.15.31:39790) 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c5d98640 1 -- 172.21.15.31:0/3226691634 learned_addr learned my addr 172.21.15.31:0/3226691634 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c6599640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c0069f70 0x7fa5c01e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.674+0000 7fa5c6d9a640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5c014b1b0 0x7fa5c009f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5c5d98640 1 -- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c0069f70 msgr2=0x7fa5c01e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5c5d98640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c0069f70 0x7fa5c01e32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5c5d98640 1 -- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5c014b1b0 msgr2=0x7fa5c009f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5c5d98640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5c014b1b0 0x7fa5c009f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5c5d98640 1 -- 172.21.15.31:0/3226691634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80094d0 con 0x7fa5c0144a20 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5c5d98640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c0144a20 0x7fa5c009ce40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000c500 tx=0x7fa5b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5b6ffd640 1 -- 172.21.15.31:0/3226691634 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0007500 con 0x7fa5c0144a20 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5b6ffd640 1 -- 172.21.15.31:0/3226691634 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0007660 con 0x7fa5c0144a20 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc009a70 con 0x7fa5c0144a20 2023-12-22T08:41:03.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5b6ffd640 1 -- 172.21.15.31:0/3226691634 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00049e0 con 0x7fa5c0144a20 2023-12-22T08:41:03.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.675+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c00a29b0 con 0x7fa5c0144a20 2023-12-22T08:41:03.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.676+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c0073a40 con 0x7fa5c0144a20 2023-12-22T08:41:03.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.676+0000 7fa5b6ffd640 1 -- 172.21.15.31:0/3226691634 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5b0004c00 con 0x7fa5c0144a20 2023-12-22T08:41:03.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.677+0000 7fa5b6ffd640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa5a406a430 0x7fa5a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.677+0000 7fa5b6ffd640 1 -- 172.21.15.31:0/3226691634 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5b0087e10 con 0x7fa5c0144a20 2023-12-22T08:41:03.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.677+0000 7fa5c6599640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa5a406a430 0x7fa5a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.678+0000 7fa5c6599640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa5a406a430 0x7fa5a406c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006ca0 tx=0x7fa5b8009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.681+0000 7fa5b6ffd640 1 -- 172.21.15.31:0/3226691634 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5b0053540 con 0x7fa5c0144a20 2023-12-22T08:41:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.857+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5c0143c20 con 0x7fa5c0144a20 2023-12-22T08:41:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.857+0000 7fa5b6ffd640 1 -- 172.21.15.31:0/3226691634 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5b0018020 con 0x7fa5c0144a20 2023-12-22T08:41:03.861 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:03.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa5a406a430 msgr2=0x7fa5a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa5a406a430 0x7fa5a406c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006ca0 tx=0x7fa5b8009240 comp rx=0 tx=0).stop 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c0144a20 msgr2=0x7fa5c009ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c0144a20 0x7fa5c009ce40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000c500 tx=0x7fa5b000c9c0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 shutdown_connections 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa5a406a430 0x7fa5a406c8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5c014b1b0 0x7fa5c009f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5c0144a20 0x7fa5c009ce40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 --2- 172.21.15.31:0/3226691634 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa5c0069f70 0x7fa5c01e32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 >> 172.21.15.31:0/3226691634 conn(0x7fa5c006ae10 msgr2=0x7fa5c00b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 shutdown_connections 2023-12-22T08:41:03.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.859+0000 7fa5c87fd640 1 -- 172.21.15.31:0/3226691634 wait complete. 2023-12-22T08:41:03.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:03.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.977+0000 7fca7fc1a640 1 Processor -- start 2023-12-22T08:41:03.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7fc1a640 1 -- start start 2023-12-22T08:41:03.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7fc1a640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca780b8df0 0x7fca780b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7fc1a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca7814b240 0x7fca78152130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7fc1a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca780b3ed0 con 0x7fca7814ae00 2023-12-22T08:41:03.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7fc1a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca780b33c0 con 0x7fca7814b240 2023-12-22T08:41:03.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7fc1a640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca780b91d0 con 0x7fca780b8df0 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7e1b7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca7814b240 0x7fca78152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7d1b5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fca7814ae00 0x7fca780b7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47320/0 (socket says 172.21.15.31:47320) 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.978+0000 7fca7d1b5640 1 -- 172.21.15.31:0/2677495691 learned_addr learned my addr 172.21.15.31:0/2677495691 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.979+0000 7fca7d9b6640 1 --2- 172.21.15.31:0/2677495691 >> v2:172.21.15.69:3300/0 conn(0x7fca780b8df0 0x7fca780b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.979+0000 7fca7e1b7640 1 -- 172.21.15.31:0/2677495691 >> v2:172.21.15.69:3300/0 conn(0x7fca780b8df0 msgr2=0x7fca780b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.979+0000 7fca7e1b7640 1 --2- 172.21.15.31:0/2677495691 >> v2:172.21.15.69:3300/0 conn(0x7fca780b8df0 0x7fca780b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.979+0000 7fca7e1b7640 1 -- 172.21.15.31:0/2677495691 >> v1:172.21.15.31:6789/0 conn(0x7fca7814ae00 legacy=0x7fca780b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.979+0000 7fca7e1b7640 1 -- 172.21.15.31:0/2677495691 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78142030 con 0x7fca7814b240 2023-12-22T08:41:03.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.979+0000 7fca7c9b4640 1 -- 172.21.15.31:0/2677495691 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690712481 0 0) 0x7fca780b3ed0 con 0x7fca7814ae00 2023-12-22T08:41:03.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.979+0000 7fca7e1b7640 1 --2- 172.21.15.31:0/2677495691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca7814b240 0x7fca78152130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fca780a33e0 tx=0x7fca7002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819570eaedfcf3bf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7c9b4640 1 -- 172.21.15.31:0/2677495691 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7002cd00 con 0x7fca7814b240 2023-12-22T08:41:03.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7c9b4640 1 -- 172.21.15.31:0/2677495691 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7002ce60 con 0x7fca7814b240 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7c9b4640 1 -- 172.21.15.31:0/2677495691 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70034660 con 0x7fca7814b240 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7fc1a640 1 -- 172.21.15.31:0/2677495691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca7814b240 msgr2=0x7fca78152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/2677495691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca7814b240 0x7fca78152130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fca780a33e0 tx=0x7fca7002bf50 comp rx=0 tx=0).stop 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7fc1a640 1 -- 172.21.15.31:0/2677495691 shutdown_connections 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/2677495691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca7814b240 0x7fca78152130 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/2677495691 >> v2:172.21.15.69:3300/0 conn(0x7fca780b8df0 0x7fca780b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7fc1a640 1 -- 172.21.15.31:0/2677495691 >> 172.21.15.31:0/2677495691 conn(0x7fca7806ae10 msgr2=0x7fca7806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7fc1a640 1 -- 172.21.15.31:0/2677495691 shutdown_connections 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.980+0000 7fca7fc1a640 1 -- 172.21.15.31:0/2677495691 wait complete. 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.981+0000 7fca7fc1a640 1 Processor -- start 2023-12-22T08:41:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.981+0000 7fca7fc1a640 1 -- start start 2023-12-22T08:41:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7fc1a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780b8df0 0x7fca7813f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7fc1a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7814ae00 0x7fca78143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7fc1a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7814b240 0x7fca78144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7fc1a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7813fe50 con 0x7fca780b8df0 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7fc1a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78141230 con 0x7fca7814ae00 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7fc1a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca78142650 con 0x7fca7814b240 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d9b6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780b8df0 0x7fca7813f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d9b6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780b8df0 0x7fca7813f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39804/0 (socket says 172.21.15.31:39804) 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d9b6640 1 -- 172.21.15.31:0/1541495786 learned_addr learned my addr 172.21.15.31:0/1541495786 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d1b5640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7814ae00 0x7fca78143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7e1b7640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7814b240 0x7fca78144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d9b6640 1 -- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7814b240 msgr2=0x7fca78144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d9b6640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7814b240 0x7fca78144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d9b6640 1 -- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7814ae00 msgr2=0x7fca78143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:03.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d9b6640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7814ae00 0x7fca78143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d9b6640 1 -- 172.21.15.31:0/1541495786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70009a70 con 0x7fca780b8df0 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.982+0000 7fca7d1b5640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7814ae00 0x7fca78143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.983+0000 7fca7d9b6640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780b8df0 0x7fca7813f910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca7400d800 tx=0x7fca7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.983+0000 7fca6e7fc640 1 -- 172.21.15.31:0/1541495786 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7400b6c0 con 0x7fca780b8df0 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.983+0000 7fca6e7fc640 1 -- 172.21.15.31:0/1541495786 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7400b820 con 0x7fca780b8df0 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.983+0000 7fca6e7fc640 1 -- 172.21.15.31:0/1541495786 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7400bbb0 con 0x7fca780b8df0 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.983+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca78140be0 con 0x7fca780b8df0 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.983+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca780b7870 con 0x7fca780b8df0 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.984+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca78073a40 con 0x7fca780b8df0 2023-12-22T08:41:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.984+0000 7fca6e7fc640 1 -- 172.21.15.31:0/1541495786 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca7400bd10 con 0x7fca780b8df0 2023-12-22T08:41:03.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.985+0000 7fca6e7fc640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca5c06a430 0x7fca5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:03.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.985+0000 7fca6e7fc640 1 -- 172.21.15.31:0/1541495786 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca74088ee0 con 0x7fca780b8df0 2023-12-22T08:41:03.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.985+0000 7fca7d1b5640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca5c06a430 0x7fca5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:03.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.985+0000 7fca7d1b5640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca5c06a430 0x7fca5c06c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fca78140550 tx=0x7fca68007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:03.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:03.989+0000 7fca6e7fc640 1 -- 172.21.15.31:0/1541495786 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fca74054430 con 0x7fca780b8df0 2023-12-22T08:41:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.162+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca780b85a0 con 0x7fca780b8df0 2023-12-22T08:41:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.162+0000 7fca6e7fc640 1 -- 172.21.15.31:0/1541495786 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca74057a50 con 0x7fca780b8df0 2023-12-22T08:41:04.166 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:41:04.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca5c06a430 msgr2=0x7fca5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca5c06a430 0x7fca5c06c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fca78140550 tx=0x7fca68007c10 comp rx=0 tx=0).stop 2023-12-22T08:41:04.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780b8df0 msgr2=0x7fca7813f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780b8df0 0x7fca7813f910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca7400d800 tx=0x7fca7400dcc0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 shutdown_connections 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fca5c06a430 0x7fca5c06c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7814b240 0x7fca78144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7814ae00 0x7fca78143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 --2- 172.21.15.31:0/1541495786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca780b8df0 0x7fca7813f910 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 >> 172.21.15.31:0/1541495786 conn(0x7fca7806ae10 msgr2=0x7fca78147af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 shutdown_connections 2023-12-22T08:41:04.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.164+0000 7fca7fc1a640 1 -- 172.21.15.31:0/1541495786 wait complete. 2023-12-22T08:41:04.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.283+0000 7f828805f640 1 Processor -- start 2023-12-22T08:41:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.283+0000 7f828805f640 1 -- start start 2023-12-22T08:41:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f828805f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8280065e30 0x7f82800bb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f828805f640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f82800bae10 0x7f828006ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f828805f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800ba610 con 0x7f82800bb530 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f828805f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82800659a0 con 0x7f8280065e30 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f828805f640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82800b9eb0 con 0x7f82800bae10 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f82855fa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8280065e30 0x7f82800bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f82855fa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8280065e30 0x7f82800bb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39816/0 (socket says 172.21.15.31:39816) 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f82855fa640 1 -- 172.21.15.31:0/1194529801 learned_addr learned my addr 172.21.15.31:0/1194529801 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f82865fc640 1 --2- 172.21.15.31:0/1194529801 >> v2:172.21.15.69:3300/0 conn(0x7f82800bae10 0x7f828006ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f82855fa640 1 -- 172.21.15.31:0/1194529801 >> v2:172.21.15.69:3300/0 conn(0x7f82800bae10 msgr2=0x7f828006ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f82855fa640 1 --2- 172.21.15.31:0/1194529801 >> v2:172.21.15.69:3300/0 conn(0x7f82800bae10 0x7f828006ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f82855fa640 1 -- 172.21.15.31:0/1194529801 >> v1:172.21.15.69:6789/0 conn(0x7f82800bb530 legacy=0x7f828014c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.284+0000 7f82855fa640 1 -- 172.21.15.31:0/1194529801 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800ba860 con 0x7f8280065e30 2023-12-22T08:41:04.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.285+0000 7f82855fa640 1 --2- 172.21.15.31:0/1194529801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8280065e30 0x7f82800bb910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f828006b6b0 tx=0x7f827c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af7a91a871fce79 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.285+0000 7f8284df9640 1 -- 172.21.15.31:0/1194529801 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0317e0 con 0x7f8280065e30 2023-12-22T08:41:04.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.285+0000 7f8284df9640 1 -- 172.21.15.31:0/1194529801 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c031940 con 0x7f8280065e30 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.285+0000 7f8284df9640 1 -- 172.21.15.31:0/1194529801 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c031cd0 con 0x7f8280065e30 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.285+0000 7f828805f640 1 -- 172.21.15.31:0/1194529801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8280065e30 msgr2=0x7f82800bb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.285+0000 7f828805f640 1 --2- 172.21.15.31:0/1194529801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8280065e30 0x7f82800bb910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f828006b6b0 tx=0x7f827c02b880 comp rx=0 tx=0).stop 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.286+0000 7f828805f640 1 -- 172.21.15.31:0/1194529801 shutdown_connections 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.286+0000 7f828805f640 1 --2- 172.21.15.31:0/1194529801 >> v2:172.21.15.69:3300/0 conn(0x7f82800bae10 0x7f828006ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.286+0000 7f828805f640 1 --2- 172.21.15.31:0/1194529801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8280065e30 0x7f82800bb910 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.286+0000 7f828805f640 1 -- 172.21.15.31:0/1194529801 >> 172.21.15.31:0/1194529801 conn(0x7f82800b9290 msgr2=0x7f82800b9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.286+0000 7f828805f640 1 -- 172.21.15.31:0/1194529801 shutdown_connections 2023-12-22T08:41:04.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.286+0000 7f828805f640 1 -- 172.21.15.31:0/1194529801 wait complete. 2023-12-22T08:41:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f828805f640 1 Processor -- start 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f828805f640 1 -- start start 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f828805f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8280065e30 0x7f82801d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f828805f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82800bae10 0x7f82801e19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f828805f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f82800bb530 0x7f82801e1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f828805f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82801d4000 con 0x7f82800bae10 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f828805f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82801e1540 con 0x7f8280065e30 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f828805f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b42c0 con 0x7f82800bb530 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f82855fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82800bae10 0x7f82801e19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f82855fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82800bae10 0x7f82801e19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39830/0 (socket says 172.21.15.31:39830) 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.287+0000 7f82855fa640 1 -- 172.21.15.31:0/1861732333 learned_addr learned my addr 172.21.15.31:0/1861732333 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f8285dfb640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8280065e30 0x7f82801d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82855fa640 1 -- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f82800bb530 msgr2=0x7f82801e1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82855fa640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f82800bb530 0x7f82801e1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82855fa640 1 -- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8280065e30 msgr2=0x7f82801d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82855fa640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8280065e30 0x7f82801d3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82855fa640 1 -- 172.21.15.31:0/1861732333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0094d0 con 0x7f82800bae10 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f8285dfb640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8280065e30 0x7f82801d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82855fa640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82800bae10 0x7f82801e19d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f827c02b8c0 tx=0x7f827c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82727fc640 1 -- 172.21.15.31:0/1861732333 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c032880 con 0x7f82800bae10 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82727fc640 1 -- 172.21.15.31:0/1861732333 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c032a00 con 0x7f82800bae10 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82800b4510 con 0x7f82800bae10 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f82727fc640 1 -- 172.21.15.31:0/1861732333 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c032db0 con 0x7f82800bae10 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.288+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828006fa40 con 0x7f82800bae10 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.289+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828006f5c0 con 0x7f82800bae10 2023-12-22T08:41:04.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.289+0000 7f82727fc640 1 -- 172.21.15.31:0/1861732333 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f827c04e450 con 0x7f82800bae10 2023-12-22T08:41:04.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.290+0000 7f82727fc640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f826406a460 0x7f826406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.290+0000 7f82727fc640 1 -- 172.21.15.31:0/1861732333 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f827c0aab50 con 0x7f82800bae10 2023-12-22T08:41:04.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.290+0000 7f8285dfb640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f826406a460 0x7f826406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.291+0000 7f8285dfb640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f826406a460 0x7f826406c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8274000f60 tx=0x7f8274009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.294+0000 7f82727fc640 1 -- 172.21.15.31:0/1861732333 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f828006f5c0 con 0x7f82800bae10 2023-12-22T08:41:04.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.470+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82801e16f0 con 0x7f82800bae10 2023-12-22T08:41:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.470+0000 7f82727fc640 1 -- 172.21.15.31:0/1861732333 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82801e16f0 con 0x7f82800bae10 2023-12-22T08:41:04.474 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f826406a460 msgr2=0x7f826406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f826406a460 0x7f826406c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8274000f60 tx=0x7f8274009040 comp rx=0 tx=0).stop 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82800bae10 msgr2=0x7f82801e19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82800bae10 0x7f82801e19d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f827c02b8c0 tx=0x7f827c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 shutdown_connections 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f826406a460 0x7f826406c920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f82800bb530 0x7f82801e1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82800bae10 0x7f82801e19d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 --2- 172.21.15.31:0/1861732333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8280065e30 0x7f82801d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 >> 172.21.15.31:0/1861732333 conn(0x7f82800b9290 msgr2=0x7f828006a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 shutdown_connections 2023-12-22T08:41:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.472+0000 7f828805f640 1 -- 172.21.15.31:0/1861732333 wait complete. 2023-12-22T08:41:04.486 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:04.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.589+0000 7f574299f640 1 Processor -- start 2023-12-22T08:41:04.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.589+0000 7f574299f640 1 -- start start 2023-12-22T08:41:04.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f574299f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c06a6d0 0x7f573c14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f574299f640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f573c0ba550 0x7f573c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f574299f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c0bb310 con 0x7f573c14b1f0 2023-12-22T08:41:04.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f574299f640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c0bf960 con 0x7f573c0ba550 2023-12-22T08:41:04.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f574299f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0bb5b0 con 0x7f573c06a6d0 2023-12-22T08:41:04.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f573b7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f573c14b1f0 0x7f573c0b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47330/0 (socket says 172.21.15.31:47330) 2023-12-22T08:41:04.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f573b7fe640 1 -- 172.21.15.31:0/655894903 learned_addr learned my addr 172.21.15.31:0/655894903 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:04.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f573bfff640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c06a6d0 0x7f573c14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739836965 0 0) 0x7f573c0bb310 con 0x7f573c14b1f0 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f5740f3c640 1 --2- 172.21.15.31:0/655894903 >> v2:172.21.15.69:3300/0 conn(0x7f573c0ba550 0x7f573c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5724003520 con 0x7f573c14b1f0 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.590+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2491036427 0 0) 0x7f5724003520 con 0x7f573c14b1f0 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c06a6d0 msgr2=0x7f573c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c06a6d0 0x7f573c14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 >> v2:172.21.15.69:3300/0 conn(0x7f573c0ba550 msgr2=0x7f573c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 --2- 172.21.15.31:0/655894903 >> v2:172.21.15.69:3300/0 conn(0x7f573c0ba550 0x7f573c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0c0120 con 0x7f573c14b1f0 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f572c001670 con 0x7f573c14b1f0 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 >> v1:172.21.15.31:6789/0 conn(0x7f573c14b1f0 legacy=0x7f573c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5724003970 0x7f5724003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57240047c0 0x7f5724004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c06a6d0 0x7f5724005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0bf960 con 0x7f5724003970 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0bb5b0 con 0x7f57240047c0 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572400b980 con 0x7f573c06a6d0 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573bfff640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5724003970 0x7f5724003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573b7fe640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57240047c0 0x7f5724004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f5740f3c640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c06a6d0 0x7f5724005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573bfff640 1 -- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c06a6d0 msgr2=0x7f5724005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573bfff640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c06a6d0 0x7f5724005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573bfff640 1 -- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57240047c0 msgr2=0x7f5724004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573bfff640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57240047c0 0x7f5724004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.591+0000 7f573bfff640 1 -- 172.21.15.31:0/655894903 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724003520 con 0x7f5724003970 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f573bfff640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5724003970 0x7f5724003d90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5730009ac0 tx=0x7f57240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f1d312c4ec2d20 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573002c6b0 con 0x7f5724003970 2023-12-22T08:41:04.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573002c810 con 0x7f5724003970 2023-12-22T08:41:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f573affd640 1 -- 172.21.15.31:0/655894903 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573002cba0 con 0x7f5724003970 2023-12-22T08:41:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f574299f640 1 -- 172.21.15.31:0/655894903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5724003970 msgr2=0x7f5724003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f574299f640 1 --2- 172.21.15.31:0/655894903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5724003970 0x7f5724003d90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5730009ac0 tx=0x7f57240057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f5740f3c640 1 -- 172.21.15.31:0/655894903 reap_dead start 2023-12-22T08:41:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f574299f640 1 -- 172.21.15.31:0/655894903 shutdown_connections 2023-12-22T08:41:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f574299f640 1 -- 172.21.15.31:0/655894903 >> 172.21.15.31:0/655894903 conn(0x7f573c0c0350 msgr2=0x7f573c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f574299f640 1 -- 172.21.15.31:0/655894903 shutdown_connections 2023-12-22T08:41:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.592+0000 7f574299f640 1 -- 172.21.15.31:0/655894903 wait complete. 2023-12-22T08:41:04.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.593+0000 7f574299f640 1 Processor -- start 2023-12-22T08:41:04.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f574299f640 1 -- start start 2023-12-22T08:41:04.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f574299f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5724003970 0x7f573c0b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f574299f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f573c09a080 0x7f573c1d62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f574299f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c1dfcd0 0x7f573c1e0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f574299f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0b6fb0 con 0x7f573c09a080 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f574299f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c1d67f0 con 0x7f5724003970 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f574299f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c09a560 con 0x7f573c1dfcd0 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f573b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f573c09a080 0x7f573c1d62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f573b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f573c09a080 0x7f573c1d62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39848/0 (socket says 172.21.15.31:39848) 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.594+0000 7f573b7fe640 1 -- 172.21.15.31:0/2664123339 learned_addr learned my addr 172.21.15.31:0/2664123339 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f573b7fe640 1 -- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c1dfcd0 msgr2=0x7f573c1e0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f573bfff640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5724003970 0x7f573c0b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f573b7fe640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c1dfcd0 0x7f573c1e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f573b7fe640 1 -- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5724003970 msgr2=0x7f573c0b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f573b7fe640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5724003970 0x7f573c0b6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f573b7fe640 1 -- 172.21.15.31:0/2664123339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c1d7910 con 0x7f573c09a080 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f573b7fe640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f573c09a080 0x7f573c1d62b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f572c007290 tx=0x7f572c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f5738ff9640 1 -- 172.21.15.31:0/2664123339 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c0016e0 con 0x7f573c09a080 2023-12-22T08:41:04.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f5738ff9640 1 -- 172.21.15.31:0/2664123339 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00f940 con 0x7f573c09a080 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c1d7bf0 con 0x7f573c09a080 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f5738ff9640 1 -- 172.21.15.31:0/2664123339 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00fcd0 con 0x7f573c09a080 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.595+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c0a52b0 con 0x7f573c09a080 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.596+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c1d5bf0 con 0x7f573c09a080 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.596+0000 7f5738ff9640 1 -- 172.21.15.31:0/2664123339 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f572c01d460 con 0x7f573c09a080 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.597+0000 7f5738ff9640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f572806a430 0x7f572806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.597+0000 7f5738ff9640 1 -- 172.21.15.31:0/2664123339 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f572c088a10 con 0x7f573c09a080 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.597+0000 7f573bfff640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f572806a430 0x7f572806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.598+0000 7f573bfff640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f572806a430 0x7f572806c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5730036000 tx=0x7f5730030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.601+0000 7f5738ff9640 1 -- 172.21.15.31:0/2664123339 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f573c1d5bf0 con 0x7f573c09a080 2023-12-22T08:41:04.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.776+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f573c1d5fd0 con 0x7f573c09a080 2023-12-22T08:41:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.777+0000 7f5738ff9640 1 -- 172.21.15.31:0/2664123339 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f573c1d5fd0 con 0x7f573c09a080 2023-12-22T08:41:04.781 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:04.781 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:04.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f572806a430 msgr2=0x7f572806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f572806a430 0x7f572806c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5730036000 tx=0x7f5730030000 comp rx=0 tx=0).stop 2023-12-22T08:41:04.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f573c09a080 msgr2=0x7f573c1d62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f573c09a080 0x7f573c1d62b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f572c007290 tx=0x7f572c007750 comp rx=0 tx=0).stop 2023-12-22T08:41:04.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 shutdown_connections 2023-12-22T08:41:04.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f572806a430 0x7f572806c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f573c1dfcd0 0x7f573c1e0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f573c09a080 0x7f573c1d62b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 --2- 172.21.15.31:0/2664123339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5724003970 0x7f573c0b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 >> 172.21.15.31:0/2664123339 conn(0x7f573c0c0350 msgr2=0x7f573c0be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:04.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 shutdown_connections 2023-12-22T08:41:04.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.779+0000 7f574299f640 1 -- 172.21.15.31:0/2664123339 wait complete. 2023-12-22T08:41:04.793 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:04.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:04.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.899+0000 7f4d04241640 1 Processor -- start 2023-12-22T08:41:04.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.899+0000 7f4d04241640 1 -- start start 2023-12-22T08:41:04.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d04241640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4cfc0b8690 0x7f4cfc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d04241640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc14ab10 con 0x7f4cfc0b77d0 2023-12-22T08:41:04.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d04241640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc06c2f0 con 0x7f4cfc144d80 2023-12-22T08:41:04.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d04241640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc0ba620 con 0x7f4cfc0b8690 2023-12-22T08:41:04.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d017dc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4cfc0b77d0 0x7f4cfc144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41632/0 (socket says 172.21.15.31:41632) 2023-12-22T08:41:04.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d017dc640 1 -- 172.21.15.31:0/3421797547 learned_addr learned my addr 172.21.15.31:0/3421797547 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:04.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d01fdd640 1 --2- 172.21.15.31:0/3421797547 >> v2:172.21.15.69:3300/0 conn(0x7f4cfc0b8690 0x7f4cfc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375411094 0 0) 0x7f4cfc14ab10 con 0x7f4cfc0b77d0 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce4003520 con 0x7f4cfc0b77d0 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1217175283 0 0) 0x7f4ce4003520 con 0x7f4cfc0b77d0 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 >> v2:172.21.15.69:3300/0 conn(0x7f4cfc0b8690 msgr2=0x7f4cfc0b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 --2- 172.21.15.31:0/3421797547 >> v2:172.21.15.69:3300/0 conn(0x7f4cfc0b8690 0x7f4cfc0b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 >> v1:172.21.15.69:6789/0 conn(0x7f4cfc144d80 legacy=0x7f4cfc14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0b9e60 con 0x7f4cfc0b77d0 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f4cf0001670 con 0x7f4cfc0b77d0 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 >> v1:172.21.15.31:6789/0 conn(0x7f4cfc0b77d0 legacy=0x7f4cfc144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4003970 0x7f4ce4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4ce40047c0 0x7f4ce4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.900+0000 7f4d00fdb640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ce4005180 0x7f4ce400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0ba620 con 0x7f4ce4005180 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce400c120 con 0x7f4ce4003970 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce400c2e0 con 0x7f4ce40047c0 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d027de640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ce4005180 0x7f4ce400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d01fdd640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4003970 0x7f4ce4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d017dc640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4ce40047c0 0x7f4ce4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d027de640 1 -- 172.21.15.31:0/3421797547 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4ce40047c0 msgr2=0x7f4ce4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d027de640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4ce40047c0 0x7f4ce4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d027de640 1 -- 172.21.15.31:0/3421797547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4003970 msgr2=0x7f4ce4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d027de640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4003970 0x7f4ce4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.901+0000 7f4d027de640 1 -- 172.21.15.31:0/3421797547 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4003520 con 0x7f4ce4005180 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d027de640 1 -- 172.21.15.31:0/3421797547 reap_dead start 2023-12-22T08:41:04.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d027de640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ce4005180 0x7f4ce400b980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4cec001e20 tx=0x7f4ce40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedab2b6b4ae70ec server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec003b70 con 0x7f4ce4005180 2023-12-22T08:41:04.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec003cd0 con 0x7f4ce4005180 2023-12-22T08:41:04.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d00fdb640 1 -- 172.21.15.31:0/3421797547 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0052f0 con 0x7f4ce4005180 2023-12-22T08:41:04.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d04241640 1 -- 172.21.15.31:0/3421797547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ce4005180 msgr2=0x7f4ce400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d04241640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ce4005180 0x7f4ce400b980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4cec001e20 tx=0x7f4ce40057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d04241640 1 -- 172.21.15.31:0/3421797547 shutdown_connections 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d04241640 1 --2- 172.21.15.31:0/3421797547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ce4005180 0x7f4ce400b980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d04241640 1 -- 172.21.15.31:0/3421797547 >> 172.21.15.31:0/3421797547 conn(0x7f4cfc06b6a0 msgr2=0x7f4cfc06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d04241640 1 -- 172.21.15.31:0/3421797547 shutdown_connections 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.902+0000 7f4d04241640 1 -- 172.21.15.31:0/3421797547 wait complete. 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d04241640 1 Processor -- start 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d04241640 1 -- start start 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d04241640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4005180 0x7f4cfc1dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d04241640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4cfc140340 0x7f4cfc141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d04241640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cfc0bf840 0x7f4cfc14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d04241640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc14c250 con 0x7f4cfc0bf840 2023-12-22T08:41:04.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d04241640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc13fbf0 con 0x7f4ce4005180 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d04241640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc1410b0 con 0x7f4cfc140340 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d027de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cfc0bf840 0x7f4cfc14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d027de640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cfc0bf840 0x7f4cfc14e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39616/0 (socket says 172.21.15.31:39616) 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d027de640 1 -- 172.21.15.31:0/4219135504 learned_addr learned my addr 172.21.15.31:0/4219135504 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d01fdd640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4005180 0x7f4cfc1dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d017dc640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4cfc140340 0x7f4cfc141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.904+0000 7f4d027de640 1 -- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4cfc140340 msgr2=0x7f4cfc141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d027de640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4cfc140340 0x7f4cfc141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d027de640 1 -- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4005180 msgr2=0x7f4cfc1dffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:04.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d027de640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4005180 0x7f4cfc1dffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d027de640 1 -- 172.21.15.31:0/4219135504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0bfcc0 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d017dc640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4cfc140340 0x7f4cfc141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d01fdd640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4005180 0x7f4cfc1dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d027de640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cfc0bf840 0x7f4cfc14e330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4cec001f10 tx=0x7f4cec0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4cfa7fc640 1 -- 172.21.15.31:0/4219135504 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec006d50 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4cfa7fc640 1 -- 172.21.15.31:0/4219135504 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec007020 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc13f910 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4cfa7fc640 1 -- 172.21.15.31:0/4219135504 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec007390 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.905+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc13edf0 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.906+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc13f770 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.906+0000 7f4cfa7fc640 1 -- 172.21.15.31:0/4219135504 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4cec0074f0 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.907+0000 7f4cfa7fc640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4ce806a430 0x7f4ce806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.907+0000 7f4cfa7fc640 1 -- 172.21.15.31:0/4219135504 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cec003e40 con 0x7f4cfc0bf840 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.907+0000 7f4d01fdd640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4ce806a430 0x7f4ce806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:04.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.907+0000 7f4d01fdd640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4ce806a430 0x7f4ce806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009a40 tx=0x7f4cf4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:04.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:04.911+0000 7f4cfa7fc640 1 -- 172.21.15.31:0/4219135504 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4cfc13f770 con 0x7f4cfc0bf840 2023-12-22T08:41:05.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.085+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4cfc144180 con 0x7f4cfc0bf840 2023-12-22T08:41:05.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.086+0000 7f4cfa7fc640 1 -- 172.21.15.31:0/4219135504 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cec046020 con 0x7f4cfc0bf840 2023-12-22T08:41:05.089 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4ce806a430 msgr2=0x7f4ce806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4ce806a430 0x7f4ce806c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4009a40 tx=0x7f4cf4008040 comp rx=0 tx=0).stop 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cfc0bf840 msgr2=0x7f4cfc14e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cfc0bf840 0x7f4cfc14e330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4cec001f10 tx=0x7f4cec0014a0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 shutdown_connections 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4ce806a430 0x7f4ce806c8f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cfc0bf840 0x7f4cfc14e330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4cfc140340 0x7f4cfc141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 --2- 172.21.15.31:0/4219135504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ce4005180 0x7f4cfc1dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 >> 172.21.15.31:0/4219135504 conn(0x7f4cfc06b6a0 msgr2=0x7f4cfc0b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:05.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 shutdown_connections 2023-12-22T08:41:05.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.088+0000 7f4d04241640 1 -- 172.21.15.31:0/4219135504 wait complete. 2023-12-22T08:41:05.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:05.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.207+0000 7fe6964a1640 1 Processor -- start 2023-12-22T08:41:05.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.207+0000 7fe6964a1640 1 -- start start 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe6964a1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe690144d80 0x7fe6900b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe6964a1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6900b77d0 0x7fe69014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe6964a1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69014ab10 con 0x7fe6900b8690 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe6964a1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69006c2f0 con 0x7fe690144d80 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe6964a1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900ba620 con 0x7fe6900b77d0 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe6900b8690 0x7fe690144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41638/0 (socket says 172.21.15.31:41638) 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68ffff640 1 -- 172.21.15.31:0/3033108031 learned_addr learned my addr 172.21.15.31:0/3033108031 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68f7fe640 1 --2- 172.21.15.31:0/3033108031 >> v2:172.21.15.69:3300/0 conn(0x7fe690144d80 0x7fe6900b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193826540 0 0) 0x7fe69014ab10 con 0x7fe6900b8690 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe678003520 con 0x7fe6900b8690 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe694a3e640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6900b77d0 0x7fe69014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3855230570 0 0) 0x7fe678003520 con 0x7fe6900b8690 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6900b77d0 msgr2=0x7fe69014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6900b77d0 0x7fe69014afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 >> v2:172.21.15.69:3300/0 conn(0x7fe690144d80 msgr2=0x7fe6900b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 --2- 172.21.15.31:0/3033108031 >> v2:172.21.15.69:3300/0 conn(0x7fe690144d80 0x7fe6900b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900b9e60 con 0x7fe6900b8690 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7fe684001670 con 0x7fe6900b8690 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 >> v1:172.21.15.31:6789/0 conn(0x7fe6900b8690 legacy=0x7fe690144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe678003970 0x7fe678003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6780047c0 0x7fe678004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6900b77d0 0x7fe678005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69006c2f0 con 0x7fe6780047c0 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900ba620 con 0x7fe678003970 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67800b980 con 0x7fe6900b77d0 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.208+0000 7fe68f7fe640 1 --2- 172.21.15.31:0/3033108031 >> v2:172.21.15.69:3300/0 conn(0x7fe690144d80 0x7fe6900b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe68f7fe640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6780047c0 0x7fe678004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe68ffff640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe678003970 0x7fe678003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe694a3e640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6900b77d0 0x7fe678005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe68f7fe640 1 -- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6900b77d0 msgr2=0x7fe678005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe68f7fe640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6900b77d0 0x7fe678005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe68f7fe640 1 -- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe678003970 msgr2=0x7fe678003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe68f7fe640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe678003970 0x7fe678003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe68f7fe640 1 -- 172.21.15.31:0/3033108031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe678003520 con 0x7fe6780047c0 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.209+0000 7fe68f7fe640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6780047c0 0x7fe678004c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe680009ca0 tx=0x7fe6780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ccc37e153a546f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680004020 con 0x7fe6780047c0 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe680004180 con 0x7fe6780047c0 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe68effd640 1 -- 172.21.15.31:0/3033108031 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68002c960 con 0x7fe6780047c0 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe6964a1640 1 -- 172.21.15.31:0/3033108031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6780047c0 msgr2=0x7fe678004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe6964a1640 1 --2- 172.21.15.31:0/3033108031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6780047c0 0x7fe678004c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe680009ca0 tx=0x7fe6780057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe694a3e640 1 -- 172.21.15.31:0/3033108031 reap_dead start 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe6964a1640 1 -- 172.21.15.31:0/3033108031 shutdown_connections 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe6964a1640 1 -- 172.21.15.31:0/3033108031 >> 172.21.15.31:0/3033108031 conn(0x7fe69006b6a0 msgr2=0x7fe69006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe6964a1640 1 -- 172.21.15.31:0/3033108031 shutdown_connections 2023-12-22T08:41:05.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.210+0000 7fe6964a1640 1 -- 172.21.15.31:0/3033108031 wait complete. 2023-12-22T08:41:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.211+0000 7fe6964a1640 1 Processor -- start 2023-12-22T08:41:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe6964a1640 1 -- start start 2023-12-22T08:41:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe6964a1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6780047c0 0x7fe69014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe6964a1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6901492e0 0x7fe690145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe6964a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe690139cc0 0x7fe69013a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe6964a1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69014a860 con 0x7fe690139cc0 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe6964a1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe690149d00 con 0x7fe6901492e0 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe6964a1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe690149760 con 0x7fe6780047c0 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe694a3e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe690139cc0 0x7fe69013a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe694a3e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe690139cc0 0x7fe69013a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39640/0 (socket says 172.21.15.31:39640) 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe694a3e640 1 -- 172.21.15.31:0/939788926 learned_addr learned my addr 172.21.15.31:0/939788926 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe68f7fe640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6901492e0 0x7fe690145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.212+0000 7fe68ffff640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6780047c0 0x7fe69014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe694a3e640 1 -- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6780047c0 msgr2=0x7fe69014a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe694a3e640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6780047c0 0x7fe69014a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe694a3e640 1 -- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6901492e0 msgr2=0x7fe690145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe694a3e640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6901492e0 0x7fe690145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe694a3e640 1 -- 172.21.15.31:0/939788926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe690149a20 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe68f7fe640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6901492e0 0x7fe690145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe694a3e640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe690139cc0 0x7fe69013a170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6900b8fd0 tx=0x7fe68800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe68cff9640 1 -- 172.21.15.31:0/939788926 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800e040 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe68cff9640 1 -- 172.21.15.31:0/939788926 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68800f040 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6901473c0 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe68cff9640 1 -- 172.21.15.31:0/939788926 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688015430 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.213+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69013a6b0 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.214+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe690147220 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.214+0000 7fe68cff9640 1 -- 172.21.15.31:0/939788926 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe688015590 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.215+0000 7fe68cff9640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe67c06a430 0x7fe67c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.215+0000 7fe68cff9640 1 -- 172.21.15.31:0/939788926 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe688088f30 con 0x7fe690139cc0 2023-12-22T08:41:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.215+0000 7fe68ffff640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe67c06a430 0x7fe67c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.217+0000 7fe68ffff640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe67c06a430 0x7fe67c06c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe690141620 tx=0x7fe684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.220+0000 7fe68cff9640 1 -- 172.21.15.31:0/939788926 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe690147220 con 0x7fe690139cc0 2023-12-22T08:41:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.392+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6901478e0 con 0x7fe690139cc0 2023-12-22T08:41:05.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.392+0000 7fe68cff9640 1 -- 172.21.15.31:0/939788926 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6901478e0 con 0x7fe690139cc0 2023-12-22T08:41:05.396 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:41:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe67c06a430 msgr2=0x7fe67c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe67c06a430 0x7fe67c06c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe690141620 tx=0x7fe684009040 comp rx=0 tx=0).stop 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe690139cc0 msgr2=0x7fe69013a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe690139cc0 0x7fe69013a170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6900b8fd0 tx=0x7fe68800f580 comp rx=0 tx=0).stop 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 shutdown_connections 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe67c06a430 0x7fe67c06c8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe690139cc0 0x7fe69013a170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6901492e0 0x7fe690145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 --2- 172.21.15.31:0/939788926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe6780047c0 0x7fe69014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 >> 172.21.15.31:0/939788926 conn(0x7fe69006b6a0 msgr2=0x7fe69006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 shutdown_connections 2023-12-22T08:41:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.395+0000 7fe6964a1640 1 -- 172.21.15.31:0/939788926 wait complete. 2023-12-22T08:41:05.408 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.516+0000 7fc324261640 1 Processor -- start 2023-12-22T08:41:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.516+0000 7fc324261640 1 -- start start 2023-12-22T08:41:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.516+0000 7fc324261640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc31c0bc000 0x7fc31c0b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.516+0000 7fc324261640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 0x7fc31c1426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.516+0000 7fc324261640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0b5f00 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.516+0000 7fc324261640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c0b8650 con 0x7fc31c0bc000 2023-12-22T08:41:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.516+0000 7fc324261640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0b61e0 con 0x7fc31c14be60 2023-12-22T08:41:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.516+0000 7fc3217fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc31c0bc000 0x7fc31c0b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.517+0000 7fc3217fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc31c0bc000 0x7fc31c0b8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39654/0 (socket says 172.21.15.31:39654) 2023-12-22T08:41:05.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.517+0000 7fc3217fc640 1 -- 172.21.15.31:0/1456845893 learned_addr learned my addr 172.21.15.31:0/1456845893 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:05.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.517+0000 7fc3217fc640 1 -- 172.21.15.31:0/1456845893 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 msgr2=0x7fc31c1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:05.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.517+0000 7fc3217fc640 1 --2- 172.21.15.31:0/1456845893 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 0x7fc31c1426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.517+0000 7fc3217fc640 1 -- 172.21.15.31:0/1456845893 >> v1:172.21.15.69:6789/0 conn(0x7fc31c0bb1c0 legacy=0x7fc31c0b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:05.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.517+0000 7fc3217fc640 1 -- 172.21.15.31:0/1456845893 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c0b7910 con 0x7fc31c0bc000 2023-12-22T08:41:05.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc3217fc640 1 --2- 172.21.15.31:0/1456845893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bc000 0x7fc31c0b8110 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009870 tx=0x7fc30c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9ad1ae520fb8a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc320ffb640 1 -- 172.21.15.31:0/1456845893 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c030840 con 0x7fc31c0bc000 2023-12-22T08:41:05.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc320ffb640 1 -- 172.21.15.31:0/1456845893 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c0309a0 con 0x7fc31c0bc000 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc320ffb640 1 -- 172.21.15.31:0/1456845893 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c030d30 con 0x7fc31c0bc000 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc324261640 1 -- 172.21.15.31:0/1456845893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bc000 msgr2=0x7fc31c0b8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc324261640 1 --2- 172.21.15.31:0/1456845893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bc000 0x7fc31c0b8110 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009870 tx=0x7fc30c02b980 comp rx=0 tx=0).stop 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc324261640 1 -- 172.21.15.31:0/1456845893 shutdown_connections 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc324261640 1 --2- 172.21.15.31:0/1456845893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bc000 0x7fc31c0b8110 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc324261640 1 --2- 172.21.15.31:0/1456845893 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 0x7fc31c1426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc324261640 1 -- 172.21.15.31:0/1456845893 >> 172.21.15.31:0/1456845893 conn(0x7fc31c069ee0 msgr2=0x7fc31c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc324261640 1 -- 172.21.15.31:0/1456845893 shutdown_connections 2023-12-22T08:41:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.518+0000 7fc324261640 1 -- 172.21.15.31:0/1456845893 wait complete. 2023-12-22T08:41:05.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.519+0000 7fc324261640 1 Processor -- start 2023-12-22T08:41:05.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.519+0000 7fc324261640 1 -- start start 2023-12-22T08:41:05.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc324261640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bb1c0 0x7fc31c0be560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc324261640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc31c0bc000 0x7fc31c143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc324261640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 0x7fc31c1de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc324261640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0beaa0 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc324261640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c143160 con 0x7fc31c0bc000 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc324261640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0bd1b0 con 0x7fc31c14be60 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc321ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bb1c0 0x7fc31c0be560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc321ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bb1c0 0x7fc31c0be560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39656/0 (socket says 172.21.15.31:39656) 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc321ffd640 1 -- 172.21.15.31:0/3333477142 learned_addr learned my addr 172.21.15.31:0/3333477142 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc3217fc640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc31c0bc000 0x7fc31c143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc321ffd640 1 -- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 msgr2=0x7fc31c1de5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc3227fe640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 0x7fc31c1de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc321ffd640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 0x7fc31c1de5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc321ffd640 1 -- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc31c0bc000 msgr2=0x7fc31c143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc321ffd640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc31c0bc000 0x7fc31c143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc321ffd640 1 -- 172.21.15.31:0/3333477142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0094d0 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc3217fc640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc31c0bc000 0x7fc31c143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:05.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.520+0000 7fc3227fe640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 0x7fc31c1de5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.521+0000 7fc321ffd640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bb1c0 0x7fc31c0be560 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc31800c460 tx=0x7fc31800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.521+0000 7fc3127fc640 1 -- 172.21.15.31:0/3333477142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318012830 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.521+0000 7fc3127fc640 1 -- 172.21.15.31:0/3333477142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3180129d0 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.521+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c144400 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.521+0000 7fc3127fc640 1 -- 172.21.15.31:0/3333477142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318012d80 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.521+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c0bce40 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.522+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c0bcca0 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.522+0000 7fc3127fc640 1 -- 172.21.15.31:0/3333477142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc31801a3b0 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.523+0000 7fc3127fc640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc30006a460 0x7fc30006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.523+0000 7fc3127fc640 1 -- 172.21.15.31:0/3333477142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc318088500 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.523+0000 7fc3217fc640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc30006a460 0x7fc30006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.523+0000 7fc3217fc640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc30006a460 0x7fc30006c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc30c036000 tx=0x7fc30c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.527+0000 7fc3127fc640 1 -- 172.21.15.31:0/3333477142 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc31c0bcca0 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.701+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc31c0bcca0 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.702+0000 7fc3127fc640 1 -- 172.21.15.31:0/3333477142 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc31c0bcca0 con 0x7fc31c0bb1c0 2023-12-22T08:41:05.704 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:41:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.703+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc30006a460 msgr2=0x7fc30006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.703+0000 7fc324261640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc30006a460 0x7fc30006c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc30c036000 tx=0x7fc30c03b040 comp rx=0 tx=0).stop 2023-12-22T08:41:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.703+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bb1c0 msgr2=0x7fc31c0be560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.703+0000 7fc324261640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bb1c0 0x7fc31c0be560 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc31800c460 tx=0x7fc31800c920 comp rx=0 tx=0).stop 2023-12-22T08:41:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.704+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 shutdown_connections 2023-12-22T08:41:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.704+0000 7fc324261640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc30006a460 0x7fc30006c920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.704+0000 7fc324261640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc31c14be60 0x7fc31c1de5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.704+0000 7fc324261640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc31c0bc000 0x7fc31c143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.704+0000 7fc324261640 1 --2- 172.21.15.31:0/3333477142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc31c0bb1c0 0x7fc31c0be560 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.704+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 >> 172.21.15.31:0/3333477142 conn(0x7fc31c069ee0 msgr2=0x7fc31c13e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.704+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 shutdown_connections 2023-12-22T08:41:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.704+0000 7fc324261640 1 -- 172.21.15.31:0/3333477142 wait complete. 2023-12-22T08:41:05.717 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:05.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.820+0000 7f6001ff1640 1 Processor -- start 2023-12-22T08:41:05.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.820+0000 7f6001ff1640 1 -- start start 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f6001ff1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5ffc0ba3a0 0x7f5ffc06f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f6001ff1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc14ca90 0x7f5ffc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f6001ff1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc0ba780 con 0x7f5ffc0b46e0 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f6001ff1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc06f900 con 0x7f5ffc0ba3a0 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f6001ff1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc14c600 con 0x7f5ffc14ca90 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffbfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5ffc0b46e0 0x7f5ffc0b4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41640/0 (socket says 172.21.15.31:41640) 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffbfff640 1 -- 172.21.15.31:0/148114265 learned_addr learned my addr 172.21.15.31:0/148114265 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffb7fe640 1 --2- 172.21.15.31:0/148114265 >> v2:172.21.15.69:3300/0 conn(0x7f5ffc0ba3a0 0x7f5ffc06f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffaffd640 1 --2- 172.21.15.31:0/148114265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc14ca90 0x7f5ffc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffa7fc640 1 -- 172.21.15.31:0/148114265 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889717809 0 0) 0x7f5ffc0ba780 con 0x7f5ffc0b46e0 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffa7fc640 1 -- 172.21.15.31:0/148114265 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe4003520 con 0x7f5ffc0b46e0 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffb7fe640 1 -- 172.21.15.31:0/148114265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc14ca90 msgr2=0x7f5ffc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffb7fe640 1 --2- 172.21.15.31:0/148114265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc14ca90 0x7f5ffc06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffb7fe640 1 -- 172.21.15.31:0/148114265 >> v1:172.21.15.31:6789/0 conn(0x7f5ffc0b46e0 legacy=0x7f5ffc0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.821+0000 7f5ffb7fe640 1 -- 172.21.15.31:0/148114265 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc14bfb0 con 0x7f5ffc0ba3a0 2023-12-22T08:41:05.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.822+0000 7f5ffb7fe640 1 --2- 172.21.15.31:0/148114265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 0x7f5ffc06f230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0097a0 tx=0x7f5fec02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99cd7f881dac2044 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.822+0000 7f5ffa7fc640 1 -- 172.21.15.31:0/148114265 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec031830 con 0x7f5ffc0ba3a0 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.822+0000 7f5ffa7fc640 1 -- 172.21.15.31:0/148114265 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec031990 con 0x7f5ffc0ba3a0 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.822+0000 7f5ffa7fc640 1 -- 172.21.15.31:0/148114265 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec031d00 con 0x7f5ffc0ba3a0 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.823+0000 7f6001ff1640 1 -- 172.21.15.31:0/148114265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 msgr2=0x7f5ffc06f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.823+0000 7f6001ff1640 1 --2- 172.21.15.31:0/148114265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 0x7f5ffc06f230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0097a0 tx=0x7f5fec02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.823+0000 7f6001ff1640 1 -- 172.21.15.31:0/148114265 shutdown_connections 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.823+0000 7f6001ff1640 1 --2- 172.21.15.31:0/148114265 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc14ca90 0x7f5ffc06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.823+0000 7f6001ff1640 1 --2- 172.21.15.31:0/148114265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 0x7f5ffc06f230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.823+0000 7f6001ff1640 1 -- 172.21.15.31:0/148114265 >> 172.21.15.31:0/148114265 conn(0x7f5ffc0bac30 msgr2=0x7f5ffc0bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.823+0000 7f6001ff1640 1 -- 172.21.15.31:0/148114265 shutdown_connections 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.823+0000 7f6001ff1640 1 -- 172.21.15.31:0/148114265 wait complete. 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.824+0000 7f6001ff1640 1 Processor -- start 2023-12-22T08:41:05.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.824+0000 7f6001ff1640 1 -- start start 2023-12-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f6001ff1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc0b46e0 0x7f5ffc1483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f6001ff1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 0x7f5ffc1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f6001ff1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc14ca90 0x7f5ffc1e1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f6001ff1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1496f0 con 0x7f5ffc14ca90 2023-12-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f6001ff1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0b93a0 con 0x7f5ffc0ba3a0 2023-12-22T08:41:05.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f6001ff1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc146d10 con 0x7f5ffc0b46e0 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc14ca90 0x7f5ffc1e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc14ca90 0x7f5ffc1e1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39660/0 (socket says 172.21.15.31:39660) 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 -- 172.21.15.31:0/271780462 learned_addr learned my addr 172.21.15.31:0/271780462 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffb7fe640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc0b46e0 0x7f5ffc1483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffaffd640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 0x7f5ffc1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 -- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc0b46e0 msgr2=0x7f5ffc1483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc0b46e0 0x7f5ffc1483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 -- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 msgr2=0x7f5ffc1491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 0x7f5ffc1491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 -- 172.21.15.31:0/271780462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec009400 con 0x7f5ffc14ca90 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5ffbfff640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc14ca90 0x7f5ffc1e1590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400cad0 tx=0x7f5ff400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5fe3fff640 1 -- 172.21.15.31:0/271780462 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400ac30 con 0x7f5ffc14ca90 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f5fe3fff640 1 -- 172.21.15.31:0/271780462 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff400ad90 con 0x7f5ffc14ca90 2023-12-22T08:41:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.825+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc146ff0 con 0x7f5ffc14ca90 2023-12-22T08:41:05.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.826+0000 7f5fe3fff640 1 -- 172.21.15.31:0/271780462 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4012620 con 0x7f5ffc14ca90 2023-12-22T08:41:05.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.826+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc1477f0 con 0x7f5ffc14ca90 2023-12-22T08:41:05.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.827+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc147510 con 0x7f5ffc14ca90 2023-12-22T08:41:05.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.827+0000 7f5fe3fff640 1 -- 172.21.15.31:0/271780462 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ff4007070 con 0x7f5ffc14ca90 2023-12-22T08:41:05.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.827+0000 7f5fe3fff640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f5fe806a460 0x7f5fe806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:05.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.828+0000 7f5fe3fff640 1 -- 172.21.15.31:0/271780462 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ff40887e0 con 0x7f5ffc14ca90 2023-12-22T08:41:05.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.828+0000 7f5ffb7fe640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f5fe806a460 0x7f5fe806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:05.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.828+0000 7f5ffb7fe640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f5fe806a460 0x7f5fe806c920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5fec036000 tx=0x7f5fec03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:05.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:05.832+0000 7f5fe3fff640 1 -- 172.21.15.31:0/271780462 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5ffc147510 con 0x7f5ffc14ca90 2023-12-22T08:41:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.007+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ffc147510 con 0x7f5ffc14ca90 2023-12-22T08:41:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.008+0000 7f5fe3fff640 1 -- 172.21.15.31:0/271780462 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f5ffc147510 con 0x7f5ffc14ca90 2023-12-22T08:41:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:06.011 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:06.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f5fe806a460 msgr2=0x7f5fe806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f5fe806a460 0x7f5fe806c920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5fec036000 tx=0x7f5fec03c040 comp rx=0 tx=0).stop 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc14ca90 msgr2=0x7f5ffc1e1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc14ca90 0x7f5ffc1e1590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400cad0 tx=0x7f5ff400cf90 comp rx=0 tx=0).stop 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 shutdown_connections 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f5fe806a460 0x7f5fe806c920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc14ca90 0x7f5ffc1e1590 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ffc0ba3a0 0x7f5ffc1491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 --2- 172.21.15.31:0/271780462 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5ffc0b46e0 0x7f5ffc1483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 >> 172.21.15.31:0/271780462 conn(0x7f5ffc0bac30 msgr2=0x7f5ffc06d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 shutdown_connections 2023-12-22T08:41:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.010+0000 7f6001ff1640 1 -- 172.21.15.31:0/271780462 wait complete. 2023-12-22T08:41:06.023 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:06.024 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.129+0000 7fa45cec4640 1 Processor -- start 2023-12-22T08:41:06.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.129+0000 7fa45cec4640 1 -- start start 2023-12-22T08:41:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.130+0000 7fa45cec4640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa4580b7bf0 0x7fa458070f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.130+0000 7fa45cec4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa4581554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.130+0000 7fa45cec4640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45806b730 con 0x7fa4580b5150 2023-12-22T08:41:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.130+0000 7fa45cec4640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45806c8e0 con 0x7fa4580b7bf0 2023-12-22T08:41:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.130+0000 7fa45cec4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4580718c0 con 0x7fa45814b2c0 2023-12-22T08:41:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa45659c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa4580b7bf0 0x7fa458070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa456d9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa4581554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa455d9b640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa4580b5150 0x7fa45814abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:47300/0 (socket says 172.21.15.31:47300) 2023-12-22T08:41:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa455d9b640 1 -- 172.21.15.31:0/3364877650 learned_addr learned my addr 172.21.15.31:0/3364877650 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa45659c640 1 -- 172.21.15.31:0/3364877650 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 msgr2=0x7fa4581554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa45659c640 1 --2- 172.21.15.31:0/3364877650 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa4581554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa45659c640 1 -- 172.21.15.31:0/3364877650 >> v1:172.21.15.69:6789/0 conn(0x7fa4580b5150 legacy=0x7fa45814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa45659c640 1 -- 172.21.15.31:0/3364877650 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45806b450 con 0x7fa4580b7bf0 2023-12-22T08:41:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.131+0000 7fa45559a640 1 -- 172.21.15.31:0/3364877650 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602940664 0 0) 0x7fa45806b730 con 0x7fa4580b5150 2023-12-22T08:41:06.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45659c640 1 --2- 172.21.15.31:0/3364877650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 0x7fa458070f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa448009d90 tx=0x7fa44802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43aa10b815b84931 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45559a640 1 -- 172.21.15.31:0/3364877650 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44802cce0 con 0x7fa4580b7bf0 2023-12-22T08:41:06.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45559a640 1 -- 172.21.15.31:0/3364877650 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44802ce40 con 0x7fa4580b7bf0 2023-12-22T08:41:06.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45559a640 1 -- 172.21.15.31:0/3364877650 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa448034660 con 0x7fa4580b7bf0 2023-12-22T08:41:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45cec4640 1 -- 172.21.15.31:0/3364877650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 msgr2=0x7fa458070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3364877650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 0x7fa458070f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa448009d90 tx=0x7fa44802bf30 comp rx=0 tx=0).stop 2023-12-22T08:41:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45cec4640 1 -- 172.21.15.31:0/3364877650 shutdown_connections 2023-12-22T08:41:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3364877650 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa4581554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3364877650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 0x7fa458070f20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45cec4640 1 -- 172.21.15.31:0/3364877650 >> 172.21.15.31:0/3364877650 conn(0x7fa4580be1f0 msgr2=0x7fa4580be5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45cec4640 1 -- 172.21.15.31:0/3364877650 shutdown_connections 2023-12-22T08:41:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.132+0000 7fa45cec4640 1 -- 172.21.15.31:0/3364877650 wait complete. 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45cec4640 1 Processor -- start 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45cec4640 1 -- start start 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45cec4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580b5150 0x7fa45813fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45cec4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 0x7fa458148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45cec4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa458147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45cec4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa458148690 con 0x7fa4580b5150 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45cec4640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa458147b50 con 0x7fa4580b7bf0 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45cec4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa458146930 con 0x7fa45814b2c0 2023-12-22T08:41:06.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580b5150 0x7fa45813fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580b5150 0x7fa45813fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39672/0 (socket says 172.21.15.31:39672) 2023-12-22T08:41:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.134+0000 7fa45659c640 1 -- 172.21.15.31:0/3309350510 learned_addr learned my addr 172.21.15.31:0/3309350510 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa455d9b640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 0x7fa458148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa456d9d640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa458147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa45659c640 1 -- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 msgr2=0x7fa458147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa45659c640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa458147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa45659c640 1 -- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 msgr2=0x7fa458148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa45659c640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 0x7fa458148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa45659c640 1 -- 172.21.15.31:0/3309350510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448009a70 con 0x7fa4580b5150 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa456d9d640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa458147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa45659c640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580b5150 0x7fa45813fb80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa448009d90 tx=0x7fa448004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa44effd640 1 -- 172.21.15.31:0/3309350510 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44803d600 con 0x7fa4580b5150 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa44effd640 1 -- 172.21.15.31:0/3309350510 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44803d760 con 0x7fa4580b5150 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa458145710 con 0x7fa4580b5150 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa44effd640 1 -- 172.21.15.31:0/3309350510 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44803db10 con 0x7fa4580b5150 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.135+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa458146c10 con 0x7fa4580b5150 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.136+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45806c5d0 con 0x7fa4580b5150 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.136+0000 7fa44effd640 1 -- 172.21.15.31:0/3309350510 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa44803b040 con 0x7fa4580b5150 2023-12-22T08:41:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.137+0000 7fa44effd640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa43806a430 0x7fa43806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.137+0000 7fa44effd640 1 -- 172.21.15.31:0/3309350510 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4480aab50 con 0x7fa4580b5150 2023-12-22T08:41:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.137+0000 7fa455d9b640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa43806a430 0x7fa43806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.137+0000 7fa455d9b640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa43806a430 0x7fa43806c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4580b70e0 tx=0x7fa440007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.141+0000 7fa44effd640 1 -- 172.21.15.31:0/3309350510 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa4480762f0 con 0x7fa4580b5150 2023-12-22T08:41:06.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.318+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa458073a40 con 0x7fa4580b5150 2023-12-22T08:41:06.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.319+0000 7fa44effd640 1 -- 172.21.15.31:0/3309350510 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4480390a0 con 0x7fa4580b5150 2023-12-22T08:41:06.321 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:06.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa43806a430 msgr2=0x7fa43806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa43806a430 0x7fa43806c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4580b70e0 tx=0x7fa440007b50 comp rx=0 tx=0).stop 2023-12-22T08:41:06.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580b5150 msgr2=0x7fa45813fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580b5150 0x7fa45813fb80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa448009d90 tx=0x7fa448004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 shutdown_connections 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa43806a430 0x7fa43806c8f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa45814b2c0 0x7fa458147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4580b7bf0 0x7fa458148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 --2- 172.21.15.31:0/3309350510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580b5150 0x7fa45813fb80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 >> 172.21.15.31:0/3309350510 conn(0x7fa4580be1f0 msgr2=0x7fa458143c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 shutdown_connections 2023-12-22T08:41:06.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.321+0000 7fa45cec4640 1 -- 172.21.15.31:0/3309350510 wait complete. 2023-12-22T08:41:06.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:06.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.439+0000 7f396590a640 1 Processor -- start 2023-12-22T08:41:06.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.439+0000 7f396590a640 1 -- start start 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.440+0000 7f396590a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3960142f20 0x7f39600b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.440+0000 7f396590a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39601498f0 con 0x7f39600b94b0 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.440+0000 7f396590a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3960148fc0 con 0x7f39600a0cc0 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.440+0000 7f396590a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600b37e0 con 0x7f3960142f20 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.440+0000 7f395effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3960142f20 0x7f39600b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.440+0000 7f395f7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f39600b94b0 0x7f3960153280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41648/0 (socket says 172.21.15.31:41648) 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.440+0000 7f395f7fe640 1 -- 172.21.15.31:0/3558508028 learned_addr learned my addr 172.21.15.31:0/3558508028 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.441+0000 7f395effd640 1 -- 172.21.15.31:0/3558508028 >> v1:172.21.15.69:6789/0 conn(0x7f39600a0cc0 legacy=0x7f39600b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.441+0000 7f395effd640 1 -- 172.21.15.31:0/3558508028 >> v1:172.21.15.31:6789/0 conn(0x7f39600b94b0 legacy=0x7f3960153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.441+0000 7f395effd640 1 -- 172.21.15.31:0/3558508028 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39601492a0 con 0x7f3960142f20 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.441+0000 7f395dffb640 1 -- 172.21.15.31:0/3558508028 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436178171 0 0) 0x7f39601498f0 con 0x7f39600b94b0 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.441+0000 7f395effd640 1 --2- 172.21.15.31:0/3558508028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3960142f20 0x7f39600b4290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f39580097a0 tx=0x7f395802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1600571e88eb2ae server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.441+0000 7f395dffb640 1 -- 172.21.15.31:0/3558508028 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958030610 con 0x7f3960142f20 2023-12-22T08:41:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.441+0000 7f395dffb640 1 -- 172.21.15.31:0/3558508028 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958030770 con 0x7f3960142f20 2023-12-22T08:41:06.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.441+0000 7f395dffb640 1 -- 172.21.15.31:0/3558508028 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958030b00 con 0x7f3960142f20 2023-12-22T08:41:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.442+0000 7f396590a640 1 -- 172.21.15.31:0/3558508028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3960142f20 msgr2=0x7f39600b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.442+0000 7f396590a640 1 --2- 172.21.15.31:0/3558508028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3960142f20 0x7f39600b4290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f39580097a0 tx=0x7f395802b960 comp rx=0 tx=0).stop 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.442+0000 7f396590a640 1 -- 172.21.15.31:0/3558508028 shutdown_connections 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.442+0000 7f396590a640 1 --2- 172.21.15.31:0/3558508028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3960142f20 0x7f39600b4290 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.442+0000 7f396590a640 1 -- 172.21.15.31:0/3558508028 >> 172.21.15.31:0/3558508028 conn(0x7f39600be1e0 msgr2=0x7f39600be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.442+0000 7f396590a640 1 -- 172.21.15.31:0/3558508028 shutdown_connections 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.442+0000 7f396590a640 1 -- 172.21.15.31:0/3558508028 wait complete. 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.443+0000 7f396590a640 1 Processor -- start 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.443+0000 7f396590a640 1 -- start start 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f396590a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39600a0cc0 0x7f3960147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f396590a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39600b94b0 0x7f39601486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f396590a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3960142f20 0x7f39600a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f396590a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600a3140 con 0x7f39600a0cc0 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f396590a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960148bf0 con 0x7f39600b94b0 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f396590a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3960146850 con 0x7f3960142f20 2023-12-22T08:41:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39600a0cc0 0x7f3960147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39600a0cc0 0x7f3960147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39692/0 (socket says 172.21.15.31:39692) 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 -- 172.21.15.31:0/4264279209 learned_addr learned my addr 172.21.15.31:0/4264279209 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395e7fc640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39600b94b0 0x7f39601486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395f7fe640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3960142f20 0x7f39600a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 -- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3960142f20 msgr2=0x7f39600a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3960142f20 0x7f39600a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 -- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39600b94b0 msgr2=0x7f39601486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39600b94b0 0x7f39601486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 -- 172.21.15.31:0/4264279209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009400 con 0x7f39600a0cc0 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395f7fe640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3960142f20 0x7f39600a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.444+0000 7f395effd640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39600a0cc0 0x7f3960147880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39580097a0 tx=0x7f39580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.445+0000 7f3957fff640 1 -- 172.21.15.31:0/4264279209 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395803f070 con 0x7f39600a0cc0 2023-12-22T08:41:06.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.445+0000 7f3957fff640 1 -- 172.21.15.31:0/4264279209 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958006e10 con 0x7f39600a0cc0 2023-12-22T08:41:06.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.445+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3960147f20 con 0x7f39600a0cc0 2023-12-22T08:41:06.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.445+0000 7f3957fff640 1 -- 172.21.15.31:0/4264279209 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958004270 con 0x7f39600a0cc0 2023-12-22T08:41:06.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.445+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39600a2d60 con 0x7f39600a0cc0 2023-12-22T08:41:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.446+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3960066e90 con 0x7f39600a0cc0 2023-12-22T08:41:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.446+0000 7f3957fff640 1 -- 172.21.15.31:0/4264279209 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3958043070 con 0x7f39600a0cc0 2023-12-22T08:41:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.446+0000 7f3957fff640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f394006a430 0x7f394006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.446+0000 7f3957fff640 1 -- 172.21.15.31:0/4264279209 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39580aa630 con 0x7f39600a0cc0 2023-12-22T08:41:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.447+0000 7f395e7fc640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f394006a430 0x7f394006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.447+0000 7f395e7fc640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f394006a430 0x7f394006c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f39600a2a80 tx=0x7f3948007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.451+0000 7f3957fff640 1 -- 172.21.15.31:0/4264279209 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3958075c30 con 0x7f39600a0cc0 2023-12-22T08:41:06.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.626+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39600a3560 con 0x7f39600a0cc0 2023-12-22T08:41:06.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.627+0000 7f3957fff640 1 -- 172.21.15.31:0/4264279209 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39600a3560 con 0x7f39600a0cc0 2023-12-22T08:41:06.630 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:41:06.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f394006a430 msgr2=0x7f394006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f394006a430 0x7f394006c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f39600a2a80 tx=0x7f3948007e30 comp rx=0 tx=0).stop 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39600a0cc0 msgr2=0x7f3960147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39600a0cc0 0x7f3960147880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39580097a0 tx=0x7f39580046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 shutdown_connections 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f394006a430 0x7f394006c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3960142f20 0x7f39600a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39600b94b0 0x7f39601486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 --2- 172.21.15.31:0/4264279209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39600a0cc0 0x7f3960147880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 >> 172.21.15.31:0/4264279209 conn(0x7f39600be1e0 msgr2=0x7f3960140af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 shutdown_connections 2023-12-22T08:41:06.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.629+0000 7f396590a640 1 -- 172.21.15.31:0/4264279209 wait complete. 2023-12-22T08:41:06.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:06.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0b052b6640 1 Processor -- start 2023-12-22T08:41:06.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0b052b6640 1 -- start start 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0b052b6640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0b000b8090 0x7f0b000b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0b052b6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0b00148ad0 0x7f0b0006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0b052b6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0006ccb0 con 0x7f0b000b8470 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0b052b6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b00070bf0 con 0x7f0b00148ad0 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0b052b6640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b000b6450 con 0x7f0b000b8090 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0afe7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0b00148ad0 0x7f0b0006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0aff7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0b000b8470 0x7f0b0006c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41652/0 (socket says 172.21.15.31:41652) 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.748+0000 7f0aff7fe640 1 -- 172.21.15.31:0/3428464311 learned_addr learned my addr 172.21.15.31:0/3428464311 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.749+0000 7f0afeffd640 1 --2- 172.21.15.31:0/3428464311 >> v2:172.21.15.69:3300/0 conn(0x7f0b000b8090 0x7f0b000b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.749+0000 7f0afe7fc640 1 -- 172.21.15.31:0/3428464311 >> v2:172.21.15.69:3300/0 conn(0x7f0b000b8090 msgr2=0x7f0b000b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:06.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.749+0000 7f0afe7fc640 1 --2- 172.21.15.31:0/3428464311 >> v2:172.21.15.69:3300/0 conn(0x7f0b000b8090 0x7f0b000b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.749+0000 7f0afe7fc640 1 -- 172.21.15.31:0/3428464311 >> v1:172.21.15.31:6789/0 conn(0x7f0b000b8470 legacy=0x7f0b0006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.749+0000 7f0afe7fc640 1 -- 172.21.15.31:0/3428464311 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b00071440 con 0x7f0b00148ad0 2023-12-22T08:41:06.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.749+0000 7f0afe7fc640 1 --2- 172.21.15.31:0/3428464311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b00148ad0 0x7f0b0006f910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0b0006e450 tx=0x7f0af402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff57791692439db4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0afdffb640 1 -- 172.21.15.31:0/3428464311 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4031830 con 0x7f0b00148ad0 2023-12-22T08:41:06.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0afdffb640 1 -- 172.21.15.31:0/3428464311 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4031990 con 0x7f0b00148ad0 2023-12-22T08:41:06.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0afdffb640 1 -- 172.21.15.31:0/3428464311 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4031d20 con 0x7f0b00148ad0 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0b052b6640 1 -- 172.21.15.31:0/3428464311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b00148ad0 msgr2=0x7f0b0006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0b052b6640 1 --2- 172.21.15.31:0/3428464311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b00148ad0 0x7f0b0006f910 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0b0006e450 tx=0x7f0af402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0b052b6640 1 -- 172.21.15.31:0/3428464311 shutdown_connections 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0b052b6640 1 --2- 172.21.15.31:0/3428464311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b00148ad0 0x7f0b0006f910 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0b052b6640 1 --2- 172.21.15.31:0/3428464311 >> v2:172.21.15.69:3300/0 conn(0x7f0b000b8090 0x7f0b000b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0b052b6640 1 -- 172.21.15.31:0/3428464311 >> 172.21.15.31:0/3428464311 conn(0x7f0b000b8a00 msgr2=0x7f0b000b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0b052b6640 1 -- 172.21.15.31:0/3428464311 shutdown_connections 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.750+0000 7f0b052b6640 1 -- 172.21.15.31:0/3428464311 wait complete. 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.751+0000 7f0b052b6640 1 Processor -- start 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.751+0000 7f0b052b6640 1 -- start start 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0b052b6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b000b8090 0x7f0b001e4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0b052b6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b000b8470 0x7f0b001e0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0b052b6640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b0014cbe0 0x7f0b000b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0b052b6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000b4a60 con 0x7f0b000b8470 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0b052b6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000b51a0 con 0x7f0b000b8090 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0b052b6640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000b26e0 con 0x7f0b0014cbe0 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b000b8470 0x7f0b001e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b000b8470 0x7f0b001e0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39710/0 (socket says 172.21.15.31:39710) 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afe7fc640 1 -- 172.21.15.31:0/2224082377 learned_addr learned my addr 172.21.15.31:0/2224082377 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afeffd640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b000b8090 0x7f0b001e4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0aff7fe640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b0014cbe0 0x7f0b000b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afe7fc640 1 -- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b0014cbe0 msgr2=0x7f0b000b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afe7fc640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b0014cbe0 0x7f0b000b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afe7fc640 1 -- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b000b8090 msgr2=0x7f0b001e4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afe7fc640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b000b8090 0x7f0b001e4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afe7fc640 1 -- 172.21.15.31:0/2224082377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4009400 con 0x7f0b000b8470 2023-12-22T08:41:06.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.752+0000 7f0afeffd640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b000b8090 0x7f0b001e4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:06.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.753+0000 7f0afe7fc640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b000b8470 0x7f0b001e0130 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0af4034040 tx=0x7f0af40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.753+0000 7f0ae77fe640 1 -- 172.21.15.31:0/2224082377 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af403aa60 con 0x7f0b000b8470 2023-12-22T08:41:06.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.753+0000 7f0ae77fe640 1 -- 172.21.15.31:0/2224082377 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af403abe0 con 0x7f0b000b8470 2023-12-22T08:41:06.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.753+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000b2ed0 con 0x7f0b000b8470 2023-12-22T08:41:06.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.753+0000 7f0ae77fe640 1 -- 172.21.15.31:0/2224082377 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4044400 con 0x7f0b000b8470 2023-12-22T08:41:06.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.753+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b000b29d0 con 0x7f0b000b8470 2023-12-22T08:41:06.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.754+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b00070550 con 0x7f0b000b8470 2023-12-22T08:41:06.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.754+0000 7f0ae77fe640 1 -- 172.21.15.31:0/2224082377 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0af404d440 con 0x7f0b000b8470 2023-12-22T08:41:06.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.755+0000 7f0ae77fe640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0aec06a430 0x7f0aec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:06.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.755+0000 7f0ae77fe640 1 -- 172.21.15.31:0/2224082377 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0af40aaa50 con 0x7f0b000b8470 2023-12-22T08:41:06.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.755+0000 7f0afeffd640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0aec06a430 0x7f0aec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:06.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.755+0000 7f0afeffd640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0aec06a430 0x7f0aec06c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0af0006fd0 tx=0x7f0af0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:06.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.759+0000 7f0ae77fe640 1 -- 172.21.15.31:0/2224082377 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0af40761f0 con 0x7f0b000b8470 2023-12-22T08:41:06.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.935+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b00070550 con 0x7f0b000b8470 2023-12-22T08:41:06.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.936+0000 7f0ae77fe640 1 -- 172.21.15.31:0/2224082377 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0af40350a0 con 0x7f0b000b8470 2023-12-22T08:41:06.938 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:41:06.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0aec06a430 msgr2=0x7f0aec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0aec06a430 0x7f0aec06c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0af0006fd0 tx=0x7f0af0008040 comp rx=0 tx=0).stop 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b000b8470 msgr2=0x7f0b001e0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b000b8470 0x7f0b001e0130 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0af4034040 tx=0x7f0af40046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 shutdown_connections 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0aec06a430 0x7f0aec06c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b0014cbe0 0x7f0b000b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b000b8470 0x7f0b001e0130 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 --2- 172.21.15.31:0/2224082377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b000b8090 0x7f0b001e4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 >> 172.21.15.31:0/2224082377 conn(0x7f0b000b8a00 msgr2=0x7f0b000b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 shutdown_connections 2023-12-22T08:41:06.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:06.938+0000 7f0b052b6640 1 -- 172.21.15.31:0/2224082377 wait complete. 2023-12-22T08:41:06.951 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.055+0000 7f169152e640 1 Processor -- start 2023-12-22T08:41:07.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.055+0000 7f169152e640 1 -- start start 2023-12-22T08:41:07.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f169152e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f168c1544e0 0x7f168c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f169152e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0bb310 con 0x7f168c0ba550 2023-12-22T08:41:07.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f169152e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0bf960 con 0x7f168c06a6d0 2023-12-22T08:41:07.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f169152e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0bb5b0 con 0x7f168c1544e0 2023-12-22T08:41:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f168b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f168c1544e0 0x7f168c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f168a7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f168c0ba550 0x7f168c0b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41662/0 (socket says 172.21.15.31:41662) 2023-12-22T08:41:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f168a7fc640 1 -- 172.21.15.31:0/764674494 learned_addr learned my addr 172.21.15.31:0/764674494 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f168b7fe640 1 -- 172.21.15.31:0/764674494 >> v1:172.21.15.69:6789/0 conn(0x7f168c06a6d0 legacy=0x7f168c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.056+0000 7f168b7fe640 1 -- 172.21.15.31:0/764674494 >> v1:172.21.15.31:6789/0 conn(0x7f168c0ba550 legacy=0x7f168c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.057+0000 7f168b7fe640 1 -- 172.21.15.31:0/764674494 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0c0120 con 0x7f168c1544e0 2023-12-22T08:41:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.057+0000 7f168b7fe640 1 --2- 172.21.15.31:0/764674494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c1544e0 0x7f168c1568d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f16840097a0 tx=0x7f168402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e47877afb02d3eb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.057+0000 7f1689ffb640 1 -- 172.21.15.31:0/764674494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684030710 con 0x7f168c1544e0 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.057+0000 7f1689ffb640 1 -- 172.21.15.31:0/764674494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168402e050 con 0x7f168c1544e0 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.057+0000 7f1689ffb640 1 -- 172.21.15.31:0/764674494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684030a90 con 0x7f168c1544e0 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.058+0000 7f169152e640 1 -- 172.21.15.31:0/764674494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c1544e0 msgr2=0x7f168c1568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.058+0000 7f169152e640 1 --2- 172.21.15.31:0/764674494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c1544e0 0x7f168c1568d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f16840097a0 tx=0x7f168402b790 comp rx=0 tx=0).stop 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.058+0000 7f169152e640 1 -- 172.21.15.31:0/764674494 shutdown_connections 2023-12-22T08:41:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.058+0000 7f169152e640 1 --2- 172.21.15.31:0/764674494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c1544e0 0x7f168c1568d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.058+0000 7f169152e640 1 -- 172.21.15.31:0/764674494 >> 172.21.15.31:0/764674494 conn(0x7f168c0c0350 msgr2=0x7f168c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.058+0000 7f169152e640 1 -- 172.21.15.31:0/764674494 shutdown_connections 2023-12-22T08:41:07.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.058+0000 7f169152e640 1 -- 172.21.15.31:0/764674494 wait complete. 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.059+0000 7f169152e640 1 Processor -- start 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.059+0000 7f169152e640 1 -- start start 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f169152e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c06a6d0 0x7f168c1e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f169152e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c0ba550 0x7f168c0a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f169152e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f168c1544e0 0x7f168c0a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f169152e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1e3aa0 con 0x7f168c0ba550 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f169152e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0a5ad0 con 0x7f168c06a6d0 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f169152e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0a3970 con 0x7f168c1544e0 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c0ba550 0x7f168c0a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c0ba550 0x7f168c0a4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39742/0 (socket says 172.21.15.31:39742) 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 -- 172.21.15.31:0/1888845174 learned_addr learned my addr 172.21.15.31:0/1888845174 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168affd640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c06a6d0 0x7f168c1e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168b7fe640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f168c1544e0 0x7f168c0a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 -- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f168c1544e0 msgr2=0x7f168c0a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f168c1544e0 0x7f168c0a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 -- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c06a6d0 msgr2=0x7f168c1e3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c06a6d0 0x7f168c1e3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 -- 172.21.15.31:0/1888845174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1684009400 con 0x7f168c0ba550 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.060+0000 7f168a7fc640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c0ba550 0x7f168c0a4190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f167400c7b0 tx=0x7f167400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.061+0000 7f16837fe640 1 -- 172.21.15.31:0/1888845174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740072d0 con 0x7f168c0ba550 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.061+0000 7f16837fe640 1 -- 172.21.15.31:0/1888845174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1674007450 con 0x7f168c0ba550 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.061+0000 7f16837fe640 1 -- 172.21.15.31:0/1888845174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740047e0 con 0x7f168c0ba550 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.061+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c0a33b0 con 0x7f168c0ba550 2023-12-22T08:41:07.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.061+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c0b9430 con 0x7f168c0ba550 2023-12-22T08:41:07.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.062+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c073a40 con 0x7f168c0ba550 2023-12-22T08:41:07.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.062+0000 7f16837fe640 1 -- 172.21.15.31:0/1888845174 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1674004940 con 0x7f168c0ba550 2023-12-22T08:41:07.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.062+0000 7f16837fe640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166c06a430 0x7f166c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.063+0000 7f16837fe640 1 -- 172.21.15.31:0/1888845174 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1674087cd0 con 0x7f168c0ba550 2023-12-22T08:41:07.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.063+0000 7f168affd640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166c06a430 0x7f166c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.063+0000 7f168affd640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166c06a430 0x7f166c06c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f167c0012e0 tx=0x7f167c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.067+0000 7f16837fe640 1 -- 172.21.15.31:0/1888845174 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1674053400 con 0x7f168c0ba550 2023-12-22T08:41:07.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.244+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f168c06b0d0 con 0x7f168c0ba550 2023-12-22T08:41:07.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.245+0000 7f16837fe640 1 -- 172.21.15.31:0/1888845174 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f1674018020 con 0x7f168c0ba550 2023-12-22T08:41:07.248 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:07.248 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:07.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166c06a430 msgr2=0x7f166c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166c06a430 0x7f166c06c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f167c0012e0 tx=0x7f167c009040 comp rx=0 tx=0).stop 2023-12-22T08:41:07.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c0ba550 msgr2=0x7f168c0a4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c0ba550 0x7f168c0a4190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f167400c7b0 tx=0x7f167400cc70 comp rx=0 tx=0).stop 2023-12-22T08:41:07.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 shutdown_connections 2023-12-22T08:41:07.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166c06a430 0x7f166c06c8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f168c1544e0 0x7f168c0a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168c0ba550 0x7f168c0a4190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 --2- 172.21.15.31:0/1888845174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c06a6d0 0x7f168c1e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 >> 172.21.15.31:0/1888845174 conn(0x7f168c0c0350 msgr2=0x7f168c0be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 shutdown_connections 2023-12-22T08:41:07.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.247+0000 7f169152e640 1 -- 172.21.15.31:0/1888845174 wait complete. 2023-12-22T08:41:07.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:07.261 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:07.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.367+0000 7f34893f0640 1 Processor -- start 2023-12-22T08:41:07.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.367+0000 7f34893f0640 1 -- start start 2023-12-22T08:41:07.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.367+0000 7f34893f0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b8690 0x7f34840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.367+0000 7f34893f0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f34840b77d0 0x7f3484144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f34893f0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348414ab10 con 0x7f3484144bb0 2023-12-22T08:41:07.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f34893f0640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348406c2f0 con 0x7f34840b77d0 2023-12-22T08:41:07.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f34893f0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840ba620 con 0x7f34840b8690 2023-12-22T08:41:07.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f34837fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3484144bb0 0x7f348414afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41674/0 (socket says 172.21.15.31:41674) 2023-12-22T08:41:07.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f34837fe640 1 -- 172.21.15.31:0/1013428867 learned_addr learned my addr 172.21.15.31:0/1013428867 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f3482ffd640 1 --2- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b8690 0x7f34840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f347bfff640 1 --2- 172.21.15.31:0/1013428867 >> v2:172.21.15.69:3300/0 conn(0x7f34840b77d0 0x7f3484144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f34827fc640 1 -- 172.21.15.31:0/1013428867 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789595629 0 0) 0x7f348414ab10 con 0x7f3484144bb0 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f34827fc640 1 -- 172.21.15.31:0/1013428867 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3470003520 con 0x7f3484144bb0 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f34827fc640 1 -- 172.21.15.31:0/1013428867 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3577387911 0 0) 0x7f3470003520 con 0x7f3484144bb0 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f347bfff640 1 -- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b8690 msgr2=0x7f34840b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f347bfff640 1 --2- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b8690 0x7f34840b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f347bfff640 1 -- 172.21.15.31:0/1013428867 >> v1:172.21.15.31:6789/0 conn(0x7f3484144bb0 legacy=0x7f348414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f347bfff640 1 -- 172.21.15.31:0/1013428867 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840b9e60 con 0x7f34840b77d0 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.368+0000 7f3482ffd640 1 --2- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b8690 0x7f34840b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.369+0000 7f347bfff640 1 --2- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34840b77d0 0x7f3484144670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f346c0097a0 tx=0x7f346c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa4428c8b89677f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.369+0000 7f34827fc640 1 -- 172.21.15.31:0/1013428867 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0019f0 con 0x7f34840b77d0 2023-12-22T08:41:07.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.369+0000 7f34827fc640 1 -- 172.21.15.31:0/1013428867 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c02e050 con 0x7f34840b77d0 2023-12-22T08:41:07.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.369+0000 7f34827fc640 1 -- 172.21.15.31:0/1013428867 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c030730 con 0x7f34840b77d0 2023-12-22T08:41:07.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.370+0000 7f34893f0640 1 -- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34840b77d0 msgr2=0x7f3484144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.370+0000 7f34893f0640 1 --2- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34840b77d0 0x7f3484144670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f346c0097a0 tx=0x7f346c02b710 comp rx=0 tx=0).stop 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.370+0000 7f34893f0640 1 -- 172.21.15.31:0/1013428867 shutdown_connections 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.370+0000 7f34893f0640 1 --2- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34840b77d0 0x7f3484144670 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.370+0000 7f34893f0640 1 --2- 172.21.15.31:0/1013428867 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b8690 0x7f34840b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.370+0000 7f34893f0640 1 -- 172.21.15.31:0/1013428867 >> 172.21.15.31:0/1013428867 conn(0x7f348406b6a0 msgr2=0x7f348406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.370+0000 7f34893f0640 1 -- 172.21.15.31:0/1013428867 shutdown_connections 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.370+0000 7f34893f0640 1 -- 172.21.15.31:0/1013428867 wait complete. 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.371+0000 7f34893f0640 1 Processor -- start 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.371+0000 7f34893f0640 1 -- start start 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f34893f0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b77d0 0x7f34841d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f34893f0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34840b8690 0x7f34841e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f34893f0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3484144bb0 0x7f34841e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f34893f0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34841d7560 con 0x7f34840b8690 2023-12-22T08:41:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f34893f0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34841d7a90 con 0x7f3484144bb0 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f34893f0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3484146360 con 0x7f34840b77d0 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34840b8690 0x7f34841e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34840b8690 0x7f34841e3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39750/0 (socket says 172.21.15.31:39750) 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 -- 172.21.15.31:0/1751653353 learned_addr learned my addr 172.21.15.31:0/1751653353 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f3482ffd640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b77d0 0x7f34841d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f34837fe640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3484144bb0 0x7f34841e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 -- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b77d0 msgr2=0x7f34841d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b77d0 0x7f34841d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 -- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3484144bb0 msgr2=0x7f34841e39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3484144bb0 0x7f34841e39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 -- 172.21.15.31:0/1751653353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474009400 con 0x7f34840b8690 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347bfff640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34840b8690 0x7f34841e3480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f346c0098c0 tx=0x7f346c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347b7fe640 1 -- 172.21.15.31:0/1751653353 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c03b810 con 0x7f34840b8690 2023-12-22T08:41:07.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347b7fe640 1 -- 172.21.15.31:0/1751653353 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c03b970 con 0x7f34840b8690 2023-12-22T08:41:07.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c009400 con 0x7f34840b8690 2023-12-22T08:41:07.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.372+0000 7f347b7fe640 1 -- 172.21.15.31:0/1751653353 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c03bd20 con 0x7f34840b8690 2023-12-22T08:41:07.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.373+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34841d77b0 con 0x7f34840b8690 2023-12-22T08:41:07.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.373+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484073a40 con 0x7f34840b8690 2023-12-22T08:41:07.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.374+0000 7f347b7fe640 1 -- 172.21.15.31:0/1751653353 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f346c039040 con 0x7f34840b8690 2023-12-22T08:41:07.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.374+0000 7f347b7fe640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f346406a430 0x7f346406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.375+0000 7f347b7fe640 1 -- 172.21.15.31:0/1751653353 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f346c0a9fc0 con 0x7f34840b8690 2023-12-22T08:41:07.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.375+0000 7f3482ffd640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f346406a430 0x7f346406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.375+0000 7f3482ffd640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f346406a430 0x7f346406c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3474009c60 tx=0x7f3474008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.379+0000 7f347b7fe640 1 -- 172.21.15.31:0/1751653353 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f346c0dcc80 con 0x7f34840b8690 2023-12-22T08:41:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.553+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3484143aa0 con 0x7f34840b8690 2023-12-22T08:41:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.554+0000 7f347b7fe640 1 -- 172.21.15.31:0/1751653353 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f346c0370a0 con 0x7f34840b8690 2023-12-22T08:41:07.556 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:07.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f346406a430 msgr2=0x7f346406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f346406a430 0x7f346406c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3474009c60 tx=0x7f3474008040 comp rx=0 tx=0).stop 2023-12-22T08:41:07.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34840b8690 msgr2=0x7f34841e3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34840b8690 0x7f34841e3480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f346c0098c0 tx=0x7f346c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 shutdown_connections 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f346406a430 0x7f346406c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3484144bb0 0x7f34841e39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34840b8690 0x7f34841e3480 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 --2- 172.21.15.31:0/1751653353 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34840b77d0 0x7f34841d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 >> 172.21.15.31:0/1751653353 conn(0x7f348406b6a0 msgr2=0x7f34840ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 shutdown_connections 2023-12-22T08:41:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.556+0000 7f34893f0640 1 -- 172.21.15.31:0/1751653353 wait complete. 2023-12-22T08:41:07.569 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:07.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.674+0000 7f19b9a7d640 1 Processor -- start 2023-12-22T08:41:07.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.674+0000 7f19b9a7d640 1 -- start start 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.675+0000 7f19b9a7d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19b4142f20 0x7f19b40b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.675+0000 7f19b9a7d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b40b94b0 0x7f19b4153280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.675+0000 7f19b9a7d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b41498f0 con 0x7f19b40a0cc0 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.675+0000 7f19b9a7d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40b37e0 con 0x7f19b4142f20 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.675+0000 7f19b9a7d640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b4148fc0 con 0x7f19b40b94b0 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.675+0000 7f19b37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19b4142f20 0x7f19b40b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.675+0000 7f19b2ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f19b40a0cc0 0x7f19b40b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41688/0 (socket says 172.21.15.31:41688) 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.675+0000 7f19b2ffd640 1 -- 172.21.15.31:0/2291053901 learned_addr learned my addr 172.21.15.31:0/2291053901 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b3fff640 1 --2- 172.21.15.31:0/2291053901 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b40b94b0 0x7f19b4153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b37fe640 1 -- 172.21.15.31:0/2291053901 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b40b94b0 msgr2=0x7f19b4153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b37fe640 1 --2- 172.21.15.31:0/2291053901 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b40b94b0 0x7f19b4153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b37fe640 1 -- 172.21.15.31:0/2291053901 >> v1:172.21.15.31:6789/0 conn(0x7f19b40a0cc0 legacy=0x7f19b40b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b37fe640 1 -- 172.21.15.31:0/2291053901 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b41492a0 con 0x7f19b4142f20 2023-12-22T08:41:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b27fc640 1 -- 172.21.15.31:0/2291053901 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763484796 0 0) 0x7f19b41498f0 con 0x7f19b40a0cc0 2023-12-22T08:41:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b37fe640 1 --2- 172.21.15.31:0/2291053901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b4142f20 0x7f19b40b4290 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19a40097a0 tx=0x7f19a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8705d84d856284f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b27fc640 1 -- 172.21.15.31:0/2291053901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4030610 con 0x7f19b4142f20 2023-12-22T08:41:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b27fc640 1 -- 172.21.15.31:0/2291053901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4030770 con 0x7f19b4142f20 2023-12-22T08:41:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.676+0000 7f19b27fc640 1 -- 172.21.15.31:0/2291053901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4030b00 con 0x7f19b4142f20 2023-12-22T08:41:07.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.677+0000 7f19b9a7d640 1 -- 172.21.15.31:0/2291053901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b4142f20 msgr2=0x7f19b40b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.677+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/2291053901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b4142f20 0x7f19b40b4290 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19a40097a0 tx=0x7f19a402b960 comp rx=0 tx=0).stop 2023-12-22T08:41:07.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.677+0000 7f19b9a7d640 1 -- 172.21.15.31:0/2291053901 shutdown_connections 2023-12-22T08:41:07.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.677+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/2291053901 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b40b94b0 0x7f19b4153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.677+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/2291053901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b4142f20 0x7f19b40b4290 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.677+0000 7f19b9a7d640 1 -- 172.21.15.31:0/2291053901 >> 172.21.15.31:0/2291053901 conn(0x7f19b40be1e0 msgr2=0x7f19b40be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.677+0000 7f19b9a7d640 1 -- 172.21.15.31:0/2291053901 shutdown_connections 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.677+0000 7f19b9a7d640 1 -- 172.21.15.31:0/2291053901 wait complete. 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.678+0000 7f19b9a7d640 1 Processor -- start 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.678+0000 7f19b9a7d640 1 -- start start 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b9a7d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b40a0cc0 0x7f19b413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b9a7d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b40b94b0 0x7f19b40bd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b9a7d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b4142f20 0x7f19b41e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b9a7d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40bd7c0 con 0x7f19b40b94b0 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b9a7d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b413e4c0 con 0x7f19b40a0cc0 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b9a7d640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b413e030 con 0x7f19b4142f20 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b40b94b0 0x7f19b40bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b40b94b0 0x7f19b40bd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39768/0 (socket says 172.21.15.31:39768) 2023-12-22T08:41:07.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 -- 172.21.15.31:0/1593552063 learned_addr learned my addr 172.21.15.31:0/1593552063 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b37fe640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b40a0cc0 0x7f19b413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b3fff640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b4142f20 0x7f19b41e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 -- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b4142f20 msgr2=0x7f19b41e13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b4142f20 0x7f19b41e13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 -- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b40a0cc0 msgr2=0x7f19b413fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b40a0cc0 0x7f19b413fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 -- 172.21.15.31:0/1593552063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4009400 con 0x7f19b40b94b0 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b3fff640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b4142f20 0x7f19b41e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.679+0000 7f19b2ffd640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b40b94b0 0x7f19b40bd280 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c4e0 tx=0x7f19a800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.680+0000 7f199bfff640 1 -- 172.21.15.31:0/1593552063 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80074e0 con 0x7f19b40b94b0 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.680+0000 7f199bfff640 1 -- 172.21.15.31:0/1593552063 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8007660 con 0x7f19b40b94b0 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.680+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b413d700 con 0x7f19b40b94b0 2023-12-22T08:41:07.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.680+0000 7f199bfff640 1 -- 172.21.15.31:0/1593552063 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8004a20 con 0x7f19b40b94b0 2023-12-22T08:41:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.680+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b413dcc0 con 0x7f19b40b94b0 2023-12-22T08:41:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.681+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b4066e90 con 0x7f19b40b94b0 2023-12-22T08:41:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.681+0000 7f199bfff640 1 -- 172.21.15.31:0/1593552063 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f19a8004b80 con 0x7f19b40b94b0 2023-12-22T08:41:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.681+0000 7f199bfff640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f19a006a460 0x7f19a006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.682+0000 7f199bfff640 1 -- 172.21.15.31:0/1593552063 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19a8087af0 con 0x7f19b40b94b0 2023-12-22T08:41:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.682+0000 7f19b37fe640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f19a006a460 0x7f19a006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.682+0000 7f19b37fe640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f19a006a460 0x7f19a006c920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19a4036000 tx=0x7f19a403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.686+0000 7f199bfff640 1 -- 172.21.15.31:0/1593552063 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f19a80531b0 con 0x7f19b40b94b0 2023-12-22T08:41:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.862+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19b413e1e0 con 0x7f19b40b94b0 2023-12-22T08:41:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.863+0000 7f199bfff640 1 -- 172.21.15.31:0/1593552063 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19b413e1e0 con 0x7f19b40b94b0 2023-12-22T08:41:07.865 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:41:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f19a006a460 msgr2=0x7f19a006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f19a006a460 0x7f19a006c920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19a4036000 tx=0x7f19a403b040 comp rx=0 tx=0).stop 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b40b94b0 msgr2=0x7f19b40bd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b40b94b0 0x7f19b40bd280 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c4e0 tx=0x7f19a800c9a0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 shutdown_connections 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f19a006a460 0x7f19a006c920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f19b4142f20 0x7f19b41e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19b40b94b0 0x7f19b40bd280 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 --2- 172.21.15.31:0/1593552063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b40a0cc0 0x7f19b413fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 >> 172.21.15.31:0/1593552063 conn(0x7f19b40be1e0 msgr2=0x7f19b4140740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 shutdown_connections 2023-12-22T08:41:07.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.865+0000 7f19b9a7d640 1 -- 172.21.15.31:0/1593552063 wait complete. 2023-12-22T08:41:07.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:07.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.984+0000 7f615cf18640 1 Processor -- start 2023-12-22T08:41:07.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.984+0000 7f615cf18640 1 -- start start 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f615cf18640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6158144d80 0x7f61580b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f615cf18640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615814ab10 con 0x7f61580b8690 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f615cf18640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615806c2f0 con 0x7f61580b77d0 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f615cf18640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61580ba620 con 0x7f6158144d80 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f615659c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f61580b8690 0x7f6158144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41704/0 (socket says 172.21.15.31:41704) 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f615659c640 1 -- 172.21.15.31:0/747778557 learned_addr learned my addr 172.21.15.31:0/747778557 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f6155d9b640 1 --2- 172.21.15.31:0/747778557 >> v2:172.21.15.31:3300/0 conn(0x7f6158144d80 0x7f61580b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f615559a640 1 -- 172.21.15.31:0/747778557 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145459113 0 0) 0x7f615814ab10 con 0x7f61580b8690 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f615559a640 1 -- 172.21.15.31:0/747778557 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6144003520 con 0x7f61580b8690 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f6155d9b640 1 -- 172.21.15.31:0/747778557 >> v1:172.21.15.69:6789/0 conn(0x7f61580b77d0 legacy=0x7f615814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f6155d9b640 1 -- 172.21.15.31:0/747778557 >> v1:172.21.15.31:6789/0 conn(0x7f61580b8690 legacy=0x7f6158144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.985+0000 7f6155d9b640 1 -- 172.21.15.31:0/747778557 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61580b9e60 con 0x7f6158144d80 2023-12-22T08:41:07.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.986+0000 7f6155d9b640 1 --2- 172.21.15.31:0/747778557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6158144d80 0x7f61580b8a70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61400097a0 tx=0x7f614002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce8625ba584a39f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.986+0000 7f615559a640 1 -- 172.21.15.31:0/747778557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140031830 con 0x7f6158144d80 2023-12-22T08:41:07.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.986+0000 7f615559a640 1 -- 172.21.15.31:0/747778557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6140031990 con 0x7f6158144d80 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.986+0000 7f615559a640 1 -- 172.21.15.31:0/747778557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140031d20 con 0x7f6158144d80 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.987+0000 7f615cf18640 1 -- 172.21.15.31:0/747778557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6158144d80 msgr2=0x7f61580b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.987+0000 7f615cf18640 1 --2- 172.21.15.31:0/747778557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6158144d80 0x7f61580b8a70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61400097a0 tx=0x7f614002b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.987+0000 7f615cf18640 1 -- 172.21.15.31:0/747778557 shutdown_connections 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.987+0000 7f615cf18640 1 --2- 172.21.15.31:0/747778557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6158144d80 0x7f61580b8a70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.987+0000 7f615cf18640 1 -- 172.21.15.31:0/747778557 >> 172.21.15.31:0/747778557 conn(0x7f615806b6a0 msgr2=0x7f615806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.987+0000 7f615cf18640 1 -- 172.21.15.31:0/747778557 shutdown_connections 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.987+0000 7f615cf18640 1 -- 172.21.15.31:0/747778557 wait complete. 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.988+0000 7f615cf18640 1 Processor -- start 2023-12-22T08:41:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.988+0000 7f615cf18640 1 -- start start 2023-12-22T08:41:07.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f615cf18640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61580b77d0 0x7f6158149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f615cf18640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61580b8690 0x7f61581457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f615cf18640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6158144d80 0x7f6158148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f615cf18640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6158149b00 con 0x7f61580b8690 2023-12-22T08:41:07.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f615cf18640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6158149890 con 0x7f61580b77d0 2023-12-22T08:41:07.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f615cf18640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6158141900 con 0x7f6158144d80 2023-12-22T08:41:07.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61580b8690 0x7f61581457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61580b8690 0x7f61581457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39778/0 (socket says 172.21.15.31:39778) 2023-12-22T08:41:07.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 -- 172.21.15.31:0/2632183714 learned_addr learned my addr 172.21.15.31:0/2632183714 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:07.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f615659c640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61580b77d0 0x7f6158149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6156d9d640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6158144d80 0x7f6158148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 -- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6158144d80 msgr2=0x7f6158148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6158144d80 0x7f6158148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 -- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61580b77d0 msgr2=0x7f6158149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61580b77d0 0x7f6158149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 -- 172.21.15.31:0/2632183714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140009400 con 0x7f61580b8690 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f615659c640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61580b77d0 0x7f6158149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f6155d9b640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61580b8690 0x7f61581457e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f614002bee0 tx=0x7f61400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.989+0000 7f614effd640 1 -- 172.21.15.31:0/2632183714 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614003a8f0 con 0x7f61580b8690 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.990+0000 7f614effd640 1 -- 172.21.15.31:0/2632183714 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614003aa70 con 0x7f61580b8690 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.990+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6158148bc0 con 0x7f61580b8690 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.990+0000 7f614effd640 1 -- 172.21.15.31:0/2632183714 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614003ae20 con 0x7f61580b8690 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.990+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6158147380 con 0x7f61580b8690 2023-12-22T08:41:07.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.991+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6158073a40 con 0x7f61580b8690 2023-12-22T08:41:07.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.991+0000 7f614effd640 1 -- 172.21.15.31:0/2632183714 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f614004d440 con 0x7f61580b8690 2023-12-22T08:41:07.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.991+0000 7f614effd640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f613806a430 0x7f613806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:07.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.992+0000 7f614effd640 1 -- 172.21.15.31:0/2632183714 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61400aaa50 con 0x7f61580b8690 2023-12-22T08:41:07.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.992+0000 7f615659c640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f613806a430 0x7f613806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:07.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.992+0000 7f615659c640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f613806a430 0x7f613806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61500011e0 tx=0x7f6150009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:07.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:07.996+0000 7f614effd640 1 -- 172.21.15.31:0/2632183714 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f61400761f0 con 0x7f61580b8690 2023-12-22T08:41:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.172+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6158073a40 con 0x7f61580b8690 2023-12-22T08:41:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.172+0000 7f614effd640 1 -- 172.21.15.31:0/2632183714 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6140035020 con 0x7f61580b8690 2023-12-22T08:41:08.175 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:41:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f613806a430 msgr2=0x7f613806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f613806a430 0x7f613806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61500011e0 tx=0x7f6150009040 comp rx=0 tx=0).stop 2023-12-22T08:41:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61580b8690 msgr2=0x7f61581457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61580b8690 0x7f61581457e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f614002bee0 tx=0x7f61400046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 shutdown_connections 2023-12-22T08:41:08.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f613806a430 0x7f613806c8f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6158144d80 0x7f6158148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61580b8690 0x7f61581457e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 --2- 172.21.15.31:0/2632183714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61580b77d0 0x7f6158149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 >> 172.21.15.31:0/2632183714 conn(0x7f615806b6a0 msgr2=0x7f6158143060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 shutdown_connections 2023-12-22T08:41:08.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.174+0000 7f615cf18640 1 -- 172.21.15.31:0/2632183714 wait complete. 2023-12-22T08:41:08.197 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-22T08:41:08.201 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:08.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.306+0000 7f169dcca640 1 Processor -- start 2023-12-22T08:41:08.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.306+0000 7f169dcca640 1 -- start start 2023-12-22T08:41:08.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.306+0000 7f169dcca640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f169806a6d0 0x7f169814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.306+0000 7f169dcca640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169814b1f0 0x7f16980b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.306+0000 7f169dcca640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16980bb310 con 0x7f16980ba550 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.306+0000 7f169dcca640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16980bf960 con 0x7f169806a6d0 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.306+0000 7f169dcca640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16980bb5b0 con 0x7f169814b1f0 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f16977fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f169806a6d0 0x7f169814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f1696ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169814b1f0 0x7f16980b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f1697fff640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f16980ba550 0x7f169814e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:47330/0 (socket says 172.21.15.31:47330) 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f1697fff640 1 -- 172.21.15.31:0/341807351 learned_addr learned my addr 172.21.15.31:0/341807351 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f1696ffd640 1 -- 172.21.15.31:0/341807351 >> v2:172.21.15.69:3300/0 conn(0x7f169806a6d0 msgr2=0x7f169814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f1696ffd640 1 --2- 172.21.15.31:0/341807351 >> v2:172.21.15.69:3300/0 conn(0x7f169806a6d0 0x7f169814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f1696ffd640 1 -- 172.21.15.31:0/341807351 >> v1:172.21.15.69:6789/0 conn(0x7f16980ba550 legacy=0x7f169814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f1696ffd640 1 -- 172.21.15.31:0/341807351 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16980c0120 con 0x7f169814b1f0 2023-12-22T08:41:08.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.307+0000 7f16977fe640 1 --2- 172.21.15.31:0/341807351 >> v2:172.21.15.69:3300/0 conn(0x7f169806a6d0 0x7f169814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f1696ffd640 1 --2- 172.21.15.31:0/341807351 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169814b1f0 0x7f16980b9ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097a0 tx=0x7f168c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81e938dfe589b07 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f16967fc640 1 -- 172.21.15.31:0/341807351 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c031830 con 0x7f169814b1f0 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f16967fc640 1 -- 172.21.15.31:0/341807351 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c031990 con 0x7f169814b1f0 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f16967fc640 1 -- 172.21.15.31:0/341807351 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c031d20 con 0x7f169814b1f0 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f169dcca640 1 -- 172.21.15.31:0/341807351 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169814b1f0 msgr2=0x7f16980b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f169dcca640 1 --2- 172.21.15.31:0/341807351 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169814b1f0 0x7f16980b9ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097a0 tx=0x7f168c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f169dcca640 1 -- 172.21.15.31:0/341807351 shutdown_connections 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f169dcca640 1 --2- 172.21.15.31:0/341807351 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169814b1f0 0x7f16980b9ac0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.308+0000 7f169dcca640 1 --2- 172.21.15.31:0/341807351 >> v2:172.21.15.69:3300/0 conn(0x7f169806a6d0 0x7f169814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.309+0000 7f169dcca640 1 -- 172.21.15.31:0/341807351 >> 172.21.15.31:0/341807351 conn(0x7f16980c0350 msgr2=0x7f16980c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.309+0000 7f169dcca640 1 -- 172.21.15.31:0/341807351 shutdown_connections 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.309+0000 7f169dcca640 1 -- 172.21.15.31:0/341807351 wait complete. 2023-12-22T08:41:08.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.310+0000 7f169dcca640 1 Processor -- start 2023-12-22T08:41:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.310+0000 7f169dcca640 1 -- start start 2023-12-22T08:41:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.310+0000 7f169dcca640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169806a6d0 0x7f1698099c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.310+0000 7f169dcca640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16980ba550 0x7f16980b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.310+0000 7f169dcca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169814b1f0 0x7f169809eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.310+0000 7f169dcca640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16981e4200 con 0x7f169814b1f0 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.310+0000 7f169dcca640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169809b280 con 0x7f16980ba550 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.310+0000 7f169dcca640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16981e3440 con 0x7f169806a6d0 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169814b1f0 0x7f169809eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169814b1f0 0x7f169809eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39792/0 (socket says 172.21.15.31:39792) 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 -- 172.21.15.31:0/2201025992 learned_addr learned my addr 172.21.15.31:0/2201025992 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f16977fe640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169806a6d0 0x7f1698099c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1696ffd640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16980ba550 0x7f16980b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 -- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169806a6d0 msgr2=0x7f1698099c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169806a6d0 0x7f1698099c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 -- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16980ba550 msgr2=0x7f16980b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16980ba550 0x7f16980b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 -- 172.21.15.31:0/2201025992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688009400 con 0x7f169814b1f0 2023-12-22T08:41:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f1697fff640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169814b1f0 0x7f169809eab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f169000caf0 tx=0x7f169000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f167ffff640 1 -- 172.21.15.31:0/2201025992 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000aca0 con 0x7f169814b1f0 2023-12-22T08:41:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f167ffff640 1 -- 172.21.15.31:0/2201025992 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000ae00 con 0x7f169814b1f0 2023-12-22T08:41:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c009400 con 0x7f169814b1f0 2023-12-22T08:41:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f167ffff640 1 -- 172.21.15.31:0/2201025992 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690012600 con 0x7f169814b1f0 2023-12-22T08:41:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.311+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16981e3ce0 con 0x7f169814b1f0 2023-12-22T08:41:08.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.312+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16981e3ed0 con 0x7f169814b1f0 2023-12-22T08:41:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.313+0000 7f167ffff640 1 -- 172.21.15.31:0/2201025992 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1690007070 con 0x7f169814b1f0 2023-12-22T08:41:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.313+0000 7f167ffff640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f168406a430 0x7f168406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.313+0000 7f167ffff640 1 -- 172.21.15.31:0/2201025992 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1690088720 con 0x7f169814b1f0 2023-12-22T08:41:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.313+0000 7f16977fe640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f168406a430 0x7f168406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.314+0000 7f16977fe640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f168406a430 0x7f168406c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1688009c60 tx=0x7f1688008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.317+0000 7f167ffff640 1 -- 172.21.15.31:0/2201025992 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1690053dc0 con 0x7f169814b1f0 2023-12-22T08:41:08.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.494+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1698073a40 con 0x7f169814b1f0 2023-12-22T08:41:08.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.495+0000 7f167ffff640 1 -- 172.21.15.31:0/2201025992 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f1690017090 con 0x7f169814b1f0 2023-12-22T08:41:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:08.498 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f168406a430 msgr2=0x7f168406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f168406a430 0x7f168406c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1688009c60 tx=0x7f1688008040 comp rx=0 tx=0).stop 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169814b1f0 msgr2=0x7f169809eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169814b1f0 0x7f169809eab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f169000caf0 tx=0x7f169000a060 comp rx=0 tx=0).stop 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 shutdown_connections 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f168406a430 0x7f168406c8f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169814b1f0 0x7f169809eab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16980ba550 0x7f16980b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 --2- 172.21.15.31:0/2201025992 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169806a6d0 0x7f1698099c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 >> 172.21.15.31:0/2201025992 conn(0x7f16980c0350 msgr2=0x7f16980a1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 shutdown_connections 2023-12-22T08:41:08.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.497+0000 7f169dcca640 1 -- 172.21.15.31:0/2201025992 wait complete. 2023-12-22T08:41:08.511 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:08.511 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.617+0000 7fc6ed1ab640 1 Processor -- start 2023-12-22T08:41:08.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.617+0000 7fc6ed1ab640 1 -- start start 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6ed1ab640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc6e80b8690 0x7fc6e80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6ed1ab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e8144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6ed1ab640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e814ab10 con 0x7fc6e8144bb0 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6ed1ab640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e806c2f0 con 0x7fc6e80b8690 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6ed1ab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80ba620 con 0x7fc6e80b77d0 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e759e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc6e8144bb0 0x7fc6e814afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41716/0 (socket says 172.21.15.31:41716) 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e759e640 1 -- 172.21.15.31:0/863219856 learned_addr learned my addr 172.21.15.31:0/863219856 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e6d9d640 1 --2- 172.21.15.31:0/863219856 >> v2:172.21.15.69:3300/0 conn(0x7fc6e80b8690 0x7fc6e80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e659c640 1 --2- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e8144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e5d9b640 1 -- 172.21.15.31:0/863219856 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800808144 0 0) 0x7fc6e814ab10 con 0x7fc6e8144bb0 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e5d9b640 1 -- 172.21.15.31:0/863219856 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d4003520 con 0x7fc6e8144bb0 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e6d9d640 1 -- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 msgr2=0x7fc6e8144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e6d9d640 1 --2- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e8144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e6d9d640 1 -- 172.21.15.31:0/863219856 >> v1:172.21.15.31:6789/0 conn(0x7fc6e8144bb0 legacy=0x7fc6e814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e6d9d640 1 -- 172.21.15.31:0/863219856 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80b9e60 con 0x7fc6e80b8690 2023-12-22T08:41:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.618+0000 7fc6e659c640 1 --2- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e8144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.619+0000 7fc6e6d9d640 1 --2- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e80b8690 0x7fc6e80b8a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00097a0 tx=0x7fc6e002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ad13d5ff2e59390 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.619+0000 7fc6e5d9b640 1 -- 172.21.15.31:0/863219856 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e002e070 con 0x7fc6e80b8690 2023-12-22T08:41:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.619+0000 7fc6e5d9b640 1 -- 172.21.15.31:0/863219856 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e00315a0 con 0x7fc6e80b8690 2023-12-22T08:41:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.619+0000 7fc6e5d9b640 1 -- 172.21.15.31:0/863219856 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0031930 con 0x7fc6e80b8690 2023-12-22T08:41:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.620+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e80b8690 msgr2=0x7fc6e80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.620+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e80b8690 0x7fc6e80b8a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00097a0 tx=0x7fc6e002b840 comp rx=0 tx=0).stop 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.620+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/863219856 shutdown_connections 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.620+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e8144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.620+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/863219856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e80b8690 0x7fc6e80b8a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.620+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/863219856 >> 172.21.15.31:0/863219856 conn(0x7fc6e806b6a0 msgr2=0x7fc6e806bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.620+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/863219856 shutdown_connections 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.620+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/863219856 wait complete. 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.621+0000 7fc6ed1ab640 1 Processor -- start 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.621+0000 7fc6ed1ab640 1 -- start start 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6ed1ab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e81483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6ed1ab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e80b8690 0x7fc6e81494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6ed1ab640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e8144bb0 0x7fc6e8139830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6ed1ab640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8147130 con 0x7fc6e80b8690 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6ed1ab640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8147410 con 0x7fc6e8144bb0 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6ed1ab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81476f0 con 0x7fc6e80b77d0 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e80b8690 0x7fc6e81494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e80b8690 0x7fc6e81494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39794/0 (socket says 172.21.15.31:39794) 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e659c640 1 -- 172.21.15.31:0/3950415738 learned_addr learned my addr 172.21.15.31:0/3950415738 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e6d9d640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e81483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e759e640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e8144bb0 0x7fc6e8139830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e659c640 1 -- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 msgr2=0x7fc6e81483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e659c640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e81483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e659c640 1 -- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e8144bb0 msgr2=0x7fc6e8139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e659c640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e8144bb0 0x7fc6e8139830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e659c640 1 -- 172.21.15.31:0/3950415738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0009400 con 0x7fc6e80b8690 2023-12-22T08:41:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e6d9d640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e81483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.622+0000 7fc6e759e640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e8144bb0 0x7fc6e8139830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.623+0000 7fc6e659c640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e80b8690 0x7fc6e81494a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000ebe0 tx=0x7fc6d000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.623+0000 7fc6df7fe640 1 -- 172.21.15.31:0/3950415738 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0009760 con 0x7fc6e80b8690 2023-12-22T08:41:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.623+0000 7fc6df7fe640 1 -- 172.21.15.31:0/3950415738 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d000cc30 con 0x7fc6e80b8690 2023-12-22T08:41:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.623+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0009400 con 0x7fc6e80b8690 2023-12-22T08:41:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.623+0000 7fc6df7fe640 1 -- 172.21.15.31:0/3950415738 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d000eee0 con 0x7fc6e80b8690 2023-12-22T08:41:08.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.623+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e8141b30 con 0x7fc6e80b8690 2023-12-22T08:41:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.624+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8073a40 con 0x7fc6e80b8690 2023-12-22T08:41:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.624+0000 7fc6df7fe640 1 -- 172.21.15.31:0/3950415738 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6d0013470 con 0x7fc6e80b8690 2023-12-22T08:41:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.625+0000 7fc6df7fe640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6c806a430 0x7fc6c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.625+0000 7fc6df7fe640 1 -- 172.21.15.31:0/3950415738 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6d0088ee0 con 0x7fc6e80b8690 2023-12-22T08:41:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.625+0000 7fc6e6d9d640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6c806a430 0x7fc6c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.625+0000 7fc6e6d9d640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6c806a430 0x7fc6c806c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0036000 tx=0x7fc6e003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.629+0000 7fc6df7fe640 1 -- 172.21.15.31:0/3950415738 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc6d0054560 con 0x7fc6e80b8690 2023-12-22T08:41:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.804+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6e8147270 con 0x7fc6e80b8690 2023-12-22T08:41:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.805+0000 7fc6df7fe640 1 -- 172.21.15.31:0/3950415738 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6e8147270 con 0x7fc6e80b8690 2023-12-22T08:41:08.807 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:08.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6c806a430 msgr2=0x7fc6c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6c806a430 0x7fc6c806c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0036000 tx=0x7fc6e003d040 comp rx=0 tx=0).stop 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e80b8690 msgr2=0x7fc6e81494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e80b8690 0x7fc6e81494a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000ebe0 tx=0x7fc6d000c520 comp rx=0 tx=0).stop 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 shutdown_connections 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6c806a430 0x7fc6c806c8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e8144bb0 0x7fc6e8139830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e80b8690 0x7fc6e81494a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.806+0000 7fc6ed1ab640 1 --2- 172.21.15.31:0/3950415738 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e80b77d0 0x7fc6e81483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.807+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 >> 172.21.15.31:0/3950415738 conn(0x7fc6e806b6a0 msgr2=0x7fc6e81424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.807+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 shutdown_connections 2023-12-22T08:41:08.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.807+0000 7fc6ed1ab640 1 -- 172.21.15.31:0/3950415738 wait complete. 2023-12-22T08:41:08.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:08.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.926+0000 7f6c83ab6640 1 Processor -- start 2023-12-22T08:41:08.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.926+0000 7f6c83ab6640 1 -- start start 2023-12-22T08:41:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c83ab6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c7c144d80 0x7f6c7c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c83ab6640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 0x7f6c7c14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c83ab6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c14ab10 con 0x7f6c7c0b8690 2023-12-22T08:41:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c83ab6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c06c2f0 con 0x7f6c7c144d80 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c83ab6640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0ba620 con 0x7f6c7c0b77d0 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c81051640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c7c144d80 0x7f6c7c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c81852640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6c7c0b8690 0x7f6c7c144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41718/0 (socket says 172.21.15.31:41718) 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c81852640 1 -- 172.21.15.31:0/2668455011 learned_addr learned my addr 172.21.15.31:0/2668455011 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c82053640 1 --2- 172.21.15.31:0/2668455011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 0x7f6c7c14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c81051640 1 -- 172.21.15.31:0/2668455011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 msgr2=0x7f6c7c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c81051640 1 --2- 172.21.15.31:0/2668455011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 0x7f6c7c14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c81051640 1 -- 172.21.15.31:0/2668455011 >> v1:172.21.15.31:6789/0 conn(0x7f6c7c0b8690 legacy=0x7f6c7c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.927+0000 7f6c81051640 1 -- 172.21.15.31:0/2668455011 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0b9e60 con 0x7f6c7c144d80 2023-12-22T08:41:08.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c81051640 1 --2- 172.21.15.31:0/2668455011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c144d80 0x7f6c7c0b8a70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0097a0 tx=0x7f6c6c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d89ee22bede516 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c80850640 1 -- 172.21.15.31:0/2668455011 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c02e070 con 0x7f6c7c144d80 2023-12-22T08:41:08.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c80850640 1 -- 172.21.15.31:0/2668455011 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0315a0 con 0x7f6c7c144d80 2023-12-22T08:41:08.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c80850640 1 -- 172.21.15.31:0/2668455011 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c031930 con 0x7f6c7c144d80 2023-12-22T08:41:08.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c83ab6640 1 -- 172.21.15.31:0/2668455011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c144d80 msgr2=0x7f6c7c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/2668455011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c144d80 0x7f6c7c0b8a70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0097a0 tx=0x7f6c6c02b840 comp rx=0 tx=0).stop 2023-12-22T08:41:08.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c83ab6640 1 -- 172.21.15.31:0/2668455011 shutdown_connections 2023-12-22T08:41:08.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/2668455011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 0x7f6c7c14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/2668455011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c144d80 0x7f6c7c0b8a70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.928+0000 7f6c83ab6640 1 -- 172.21.15.31:0/2668455011 >> 172.21.15.31:0/2668455011 conn(0x7f6c7c06b6a0 msgr2=0x7f6c7c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:08.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.929+0000 7f6c83ab6640 1 -- 172.21.15.31:0/2668455011 shutdown_connections 2023-12-22T08:41:08.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.929+0000 7f6c83ab6640 1 -- 172.21.15.31:0/2668455011 wait complete. 2023-12-22T08:41:08.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c83ab6640 1 Processor -- start 2023-12-22T08:41:08.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c83ab6640 1 -- start start 2023-12-22T08:41:08.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c83ab6640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 0x7f6c7c140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c83ab6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c0b8690 0x7f6c7c145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c83ab6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c7c144d80 0x7f6c7c13b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c83ab6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c13f630 con 0x7f6c7c0b8690 2023-12-22T08:41:08.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c83ab6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c13f910 con 0x7f6c7c144d80 2023-12-22T08:41:08.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c83ab6640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c13fbf0 con 0x7f6c7c0b77d0 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c81051640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c0b8690 0x7f6c7c145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c81051640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c0b8690 0x7f6c7c145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39812/0 (socket says 172.21.15.31:39812) 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.930+0000 7f6c81051640 1 -- 172.21.15.31:0/89028783 learned_addr learned my addr 172.21.15.31:0/89028783 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c82053640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c7c144d80 0x7f6c7c13b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c81852640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 0x7f6c7c140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c81051640 1 -- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 msgr2=0x7f6c7c140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c81051640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 0x7f6c7c140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c81051640 1 -- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c7c144d80 msgr2=0x7f6c7c13b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c81051640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c7c144d80 0x7f6c7c13b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c81051640 1 -- 172.21.15.31:0/89028783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c009400 con 0x7f6c7c0b8690 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c82053640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c7c144d80 0x7f6c7c13b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c81051640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c0b8690 0x7f6c7c145750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c034040 tx=0x7f6c6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c727fc640 1 -- 172.21.15.31:0/89028783 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c032840 con 0x7f6c7c0b8690 2023-12-22T08:41:08.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c727fc640 1 -- 172.21.15.31:0/89028783 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0329c0 con 0x7f6c7c0b8690 2023-12-22T08:41:08.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c727fc640 1 -- 172.21.15.31:0/89028783 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c032d70 con 0x7f6c7c0b8690 2023-12-22T08:41:08.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c13d7d0 con 0x7f6c7c0b8690 2023-12-22T08:41:08.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.931+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c14a590 con 0x7f6c7c0b8690 2023-12-22T08:41:08.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.932+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c073a40 con 0x7f6c7c0b8690 2023-12-22T08:41:08.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.932+0000 7f6c727fc640 1 -- 172.21.15.31:0/89028783 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c6c04e430 con 0x7f6c7c0b8690 2023-12-22T08:41:08.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.933+0000 7f6c727fc640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c6006a460 0x7f6c6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:08.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.933+0000 7f6c727fc640 1 -- 172.21.15.31:0/89028783 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c6c0aa920 con 0x7f6c7c0b8690 2023-12-22T08:41:08.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.933+0000 7f6c81852640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c6006a460 0x7f6c6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:08.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.933+0000 7f6c81852640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c6006a460 0x7f6c6006c920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c1dd540 tx=0x7f6c78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:08.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:08.937+0000 7f6c727fc640 1 -- 172.21.15.31:0/89028783 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6c6c075f10 con 0x7f6c7c0b8690 2023-12-22T08:41:09.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.113+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c7c13f770 con 0x7f6c7c0b8690 2023-12-22T08:41:09.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.114+0000 7f6c727fc640 1 -- 172.21.15.31:0/89028783 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c7c13f770 con 0x7f6c7c0b8690 2023-12-22T08:41:09.116 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:41:09.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.115+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c6006a460 msgr2=0x7f6c6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.115+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c6006a460 0x7f6c6006c920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c1dd540 tx=0x7f6c78009040 comp rx=0 tx=0).stop 2023-12-22T08:41:09.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.115+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c0b8690 msgr2=0x7f6c7c145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.115+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c0b8690 0x7f6c7c145750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c034040 tx=0x7f6c6c0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.116+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 shutdown_connections 2023-12-22T08:41:09.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.116+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6c6006a460 0x7f6c6006c920 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.116+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c7c144d80 0x7f6c7c13b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.116+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c7c0b8690 0x7f6c7c145750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.116+0000 7f6c83ab6640 1 --2- 172.21.15.31:0/89028783 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c7c0b77d0 0x7f6c7c140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.116+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 >> 172.21.15.31:0/89028783 conn(0x7f6c7c06b6a0 msgr2=0x7f6c7c1420c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:09.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.116+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 shutdown_connections 2023-12-22T08:41:09.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.116+0000 7f6c83ab6640 1 -- 172.21.15.31:0/89028783 wait complete. 2023-12-22T08:41:09.129 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.235+0000 7f7e5a177640 1 Processor -- start 2023-12-22T08:41:09.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.235+0000 7f7e5a177640 1 -- start start 2023-12-22T08:41:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e5a177640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54144d80 0x7f7e540b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e5a177640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7e540b77d0 0x7f7e5414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e5a177640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5414ab10 con 0x7f7e540b8690 2023-12-22T08:41:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e5a177640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5406c2f0 con 0x7f7e540b77d0 2023-12-22T08:41:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e5a177640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540ba620 con 0x7f7e54144d80 2023-12-22T08:41:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e537fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7e540b8690 0x7f7e54144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41726/0 (socket says 172.21.15.31:41726) 2023-12-22T08:41:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e537fe640 1 -- 172.21.15.31:0/1272145848 learned_addr learned my addr 172.21.15.31:0/1272145848 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:09.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e53fff640 1 --2- 172.21.15.31:0/1272145848 >> v2:172.21.15.69:3300/0 conn(0x7f7e540b77d0 0x7f7e5414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e52ffd640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54144d80 0x7f7e540b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776188207 0 0) 0x7f7e5414ab10 con 0x7f7e540b8690 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e3c003520 con 0x7f7e540b8690 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911339351 0 0) 0x7f7e3c003520 con 0x7f7e540b8690 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54144d80 msgr2=0x7f7e540b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54144d80 0x7f7e540b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 >> v2:172.21.15.69:3300/0 conn(0x7f7e540b77d0 msgr2=0x7f7e5414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 --2- 172.21.15.31:0/1272145848 >> v2:172.21.15.69:3300/0 conn(0x7f7e540b77d0 0x7f7e5414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540b9e60 con 0x7f7e540b8690 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f7e48001670 con 0x7f7e540b8690 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 >> v1:172.21.15.31:6789/0 conn(0x7f7e540b8690 legacy=0x7f7e54144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54144d80 0x7f7e3c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c003ef0 0x7f7e3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c004d00 0x7f7e3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5406c2f0 con 0x7f7e3c003ef0 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e540ba620 con 0x7f7e3c004d00 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c00b9d0 con 0x7f7e54144d80 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e53fff640 1 --2- 172.21.15.31:0/1272145848 >> v2:172.21.15.69:3300/0 conn(0x7f7e540b77d0 0x7f7e5414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.236+0000 7f7e52ffd640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c003ef0 0x7f7e3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e537fe640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54144d80 0x7f7e3c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e53fff640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c004d00 0x7f7e3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e52ffd640 1 -- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54144d80 msgr2=0x7f7e3c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e52ffd640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54144d80 0x7f7e3c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e52ffd640 1 -- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c004d00 msgr2=0x7f7e3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e52ffd640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c004d00 0x7f7e3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e52ffd640 1 -- 172.21.15.31:0/1272145848 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c003520 con 0x7f7e3c003ef0 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e53fff640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c004d00 0x7f7e3c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.237+0000 7f7e52ffd640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c003ef0 0x7f7e3c0047c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009af0 tx=0x7f7e3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4fe3657076841 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4402c6b0 con 0x7f7e3c003ef0 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4402c810 con 0x7f7e3c003ef0 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e527fc640 1 -- 172.21.15.31:0/1272145848 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4402cba0 con 0x7f7e3c003ef0 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e5a177640 1 -- 172.21.15.31:0/1272145848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c003ef0 msgr2=0x7f7e3c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e5a177640 1 --2- 172.21.15.31:0/1272145848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e3c003ef0 0x7f7e3c0047c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009af0 tx=0x7f7e3c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e53fff640 1 -- 172.21.15.31:0/1272145848 reap_dead start 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e5a177640 1 -- 172.21.15.31:0/1272145848 shutdown_connections 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e5a177640 1 -- 172.21.15.31:0/1272145848 >> 172.21.15.31:0/1272145848 conn(0x7f7e5406b6a0 msgr2=0x7f7e5406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e5a177640 1 -- 172.21.15.31:0/1272145848 shutdown_connections 2023-12-22T08:41:09.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.238+0000 7f7e5a177640 1 -- 172.21.15.31:0/1272145848 wait complete. 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.239+0000 7f7e5a177640 1 Processor -- start 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.239+0000 7f7e5a177640 1 -- start start 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e5a177640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c003ef0 0x7f7e541df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e5a177640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e54149ff0 0x7f7e541412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e5a177640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54149200 0x7f7e541e2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e5a177640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54141db0 con 0x7f7e54149ff0 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e5a177640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e541417e0 con 0x7f7e3c003ef0 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e5a177640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e54140e10 con 0x7f7e54149200 2023-12-22T08:41:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e52ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e54149ff0 0x7f7e541412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e52ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e54149ff0 0x7f7e541412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39820/0 (socket says 172.21.15.31:39820) 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e52ffd640 1 -- 172.21.15.31:0/3391063846 learned_addr learned my addr 172.21.15.31:0/3391063846 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e537fe640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c003ef0 0x7f7e541df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e52ffd640 1 -- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54149200 msgr2=0x7f7e541e2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e53fff640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54149200 0x7f7e541e2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e52ffd640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54149200 0x7f7e541e2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e52ffd640 1 -- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c003ef0 msgr2=0x7f7e541df7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e52ffd640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c003ef0 0x7f7e541df7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e52ffd640 1 -- 172.21.15.31:0/3391063846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5414a450 con 0x7f7e54149ff0 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.240+0000 7f7e537fe640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c003ef0 0x7f7e541df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.241+0000 7f7e52ffd640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e54149ff0 0x7f7e541412a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009af0 tx=0x7f7e44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.241+0000 7f7e3bfff640 1 -- 172.21.15.31:0/3391063846 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44003810 con 0x7f7e54149ff0 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.241+0000 7f7e3bfff640 1 -- 172.21.15.31:0/3391063846 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e44003970 con 0x7f7e54149ff0 2023-12-22T08:41:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.241+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5413f730 con 0x7f7e54149ff0 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.241+0000 7f7e3bfff640 1 -- 172.21.15.31:0/3391063846 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44003ce0 con 0x7f7e54149ff0 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.241+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e54140370 con 0x7f7e54149ff0 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.242+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5413fc50 con 0x7f7e54149ff0 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.242+0000 7f7e3bfff640 1 -- 172.21.15.31:0/3391063846 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e44034440 con 0x7f7e54149ff0 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.243+0000 7f7e3bfff640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e4006a430 0x7f7e4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.243+0000 7f7e3bfff640 1 -- 172.21.15.31:0/3391063846 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e440aa7f0 con 0x7f7e54149ff0 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.243+0000 7f7e537fe640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e4006a430 0x7f7e4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.243+0000 7f7e537fe640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e4006a430 0x7f7e4006c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7e480014f0 tx=0x7f7e48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.247+0000 7f7e3bfff640 1 -- 172.21.15.31:0/3391063846 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7e44075e80 con 0x7f7e54149ff0 2023-12-22T08:41:09.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.426+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e54073a40 con 0x7f7e54149ff0 2023-12-22T08:41:09.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.426+0000 7f7e3bfff640 1 -- 172.21.15.31:0/3391063846 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e440044e0 con 0x7f7e54149ff0 2023-12-22T08:41:09.429 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:41:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e4006a430 msgr2=0x7f7e4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e4006a430 0x7f7e4006c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7e480014f0 tx=0x7f7e48009040 comp rx=0 tx=0).stop 2023-12-22T08:41:09.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e54149ff0 msgr2=0x7f7e541412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e54149ff0 0x7f7e541412a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009af0 tx=0x7f7e44004730 comp rx=0 tx=0).stop 2023-12-22T08:41:09.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 shutdown_connections 2023-12-22T08:41:09.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7e4006a430 0x7f7e4006c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7e54149200 0x7f7e541e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e54149ff0 0x7f7e541412a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 --2- 172.21.15.31:0/3391063846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e3c003ef0 0x7f7e541df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 >> 172.21.15.31:0/3391063846 conn(0x7f7e5406b6a0 msgr2=0x7f7e541431a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:09.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 shutdown_connections 2023-12-22T08:41:09.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.428+0000 7f7e5a177640 1 -- 172.21.15.31:0/3391063846 wait complete. 2023-12-22T08:41:09.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-12-22T08:41:09.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.546+0000 7fe29f59e640 1 Processor -- start 2023-12-22T08:41:09.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.546+0000 7fe29f59e640 1 -- start start 2023-12-22T08:41:09.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29f59e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a00b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29f59e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe2a00b8120 0x7fe2a00b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29f59e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a0142f20 con 0x7fe2a014bcf0 2023-12-22T08:41:09.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29f59e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a00b5130 con 0x7fe2a00b8120 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29f59e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a006f510 con 0x7fe2a00b7c20 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29dd9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe2a00b8120 0x7fe2a00b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29ed9d640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe2a014bcf0 0x7fe2a00b9910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:47342/0 (socket says 172.21.15.31:47342) 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29e59c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a00b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29dd9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe2a00b8120 0x7fe2a00b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:53582/0 (socket says 172.21.15.31:53582) 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.547+0000 7fe29ed9d640 1 -- 172.21.15.31:0/2747677297 learned_addr learned my addr 172.21.15.31:0/2747677297 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.548+0000 7fe29dd9b640 1 -- 172.21.15.31:0/2747677297 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 msgr2=0x7fe2a00b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.548+0000 7fe29dd9b640 1 --2- 172.21.15.31:0/2747677297 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a00b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.548+0000 7fe29dd9b640 1 -- 172.21.15.31:0/2747677297 >> v1:172.21.15.69:6789/0 conn(0x7fe2a014bcf0 legacy=0x7fe2a00b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.548+0000 7fe29dd9b640 1 -- 172.21.15.31:0/2747677297 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a00ba020 con 0x7fe2a00b8120 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.548+0000 7fe29d59a640 1 -- 172.21.15.31:0/2747677297 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388476869 0 0) 0x7fe2a0142f20 con 0x7fe2a014bcf0 2023-12-22T08:41:09.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.548+0000 7fe29e59c640 1 --2- 172.21.15.31:0/2747677297 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a00b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:09.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29dd9b640 1 --2- 172.21.15.31:0/2747677297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 0x7fe2a00b4ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2880097d0 tx=0x7fe28802b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68eb1e23246452fb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29d59a640 1 -- 172.21.15.31:0/2747677297 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288031800 con 0x7fe2a00b8120 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29d59a640 1 -- 172.21.15.31:0/2747677297 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe288031960 con 0x7fe2a00b8120 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29d59a640 1 -- 172.21.15.31:0/2747677297 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288031cf0 con 0x7fe2a00b8120 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29f59e640 1 -- 172.21.15.31:0/2747677297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 msgr2=0x7fe2a00b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2747677297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 0x7fe2a00b4ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2880097d0 tx=0x7fe28802b8a0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29f59e640 1 -- 172.21.15.31:0/2747677297 shutdown_connections 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2747677297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 0x7fe2a00b4ac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2747677297 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a00b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29f59e640 1 -- 172.21.15.31:0/2747677297 >> 172.21.15.31:0/2747677297 conn(0x7fe2a0070d80 msgr2=0x7fe2a0071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.549+0000 7fe29f59e640 1 -- 172.21.15.31:0/2747677297 shutdown_connections 2023-12-22T08:41:09.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.550+0000 7fe29f59e640 1 -- 172.21.15.31:0/2747677297 wait complete. 2023-12-22T08:41:09.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29f59e640 1 Processor -- start 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29f59e640 1 -- start start 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29f59e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a01438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29f59e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 0x7fe2a00b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a014bcf0 0x7fe2a01de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29f59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a01d4dd0 con 0x7fe2a014bcf0 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29f59e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a00b6b00 con 0x7fe2a00b8120 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29f59e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0143f50 con 0x7fe2a00b7c20 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a014bcf0 0x7fe2a01de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a014bcf0 0x7fe2a01de3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39832/0 (socket says 172.21.15.31:39832) 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.551+0000 7fe29ed9d640 1 -- 172.21.15.31:0/2788616195 learned_addr learned my addr 172.21.15.31:0/2788616195 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29dd9b640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 0x7fe2a00b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29e59c640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a01438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29ed9d640 1 -- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 msgr2=0x7fe2a01438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29ed9d640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a01438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29ed9d640 1 -- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 msgr2=0x7fe2a00b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29ed9d640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 0x7fe2a00b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29ed9d640 1 -- 172.21.15.31:0/2788616195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290009a70 con 0x7fe2a014bcf0 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29e59c640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a01438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29ed9d640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a014bcf0 0x7fe2a01de3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c410 tx=0x7fe29800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe296ffd640 1 -- 172.21.15.31:0/2788616195 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980074e0 con 0x7fe2a014bcf0 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe296ffd640 1 -- 172.21.15.31:0/2788616195 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe298007640 con 0x7fe2a014bcf0 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe288009400 con 0x7fe2a014bcf0 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe296ffd640 1 -- 172.21.15.31:0/2788616195 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298004a20 con 0x7fe2a014bcf0 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.552+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a01d5290 con 0x7fe2a014bcf0 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.553+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a0070650 con 0x7fe2a014bcf0 2023-12-22T08:41:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.554+0000 7fe296ffd640 1 -- 172.21.15.31:0/2788616195 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe298004b80 con 0x7fe2a014bcf0 2023-12-22T08:41:09.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.554+0000 7fe296ffd640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe28006a460 0x7fe28006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:09.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.554+0000 7fe296ffd640 1 -- 172.21.15.31:0/2788616195 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2980885c0 con 0x7fe2a014bcf0 2023-12-22T08:41:09.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.554+0000 7fe29e59c640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe28006a460 0x7fe28006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:09.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.555+0000 7fe29e59c640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe28006a460 0x7fe28006c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe290007640 tx=0x7fe29000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:09.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.558+0000 7fe296ffd640 1 -- 172.21.15.31:0/2788616195 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe298053bc0 con 0x7fe2a014bcf0 2023-12-22T08:41:09.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:09.804+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7fe2a01de110 con 0x7fe2a014bcf0 2023-12-22T08:41:10.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.521+0000 7fe296ffd640 1 -- 172.21.15.31:0/2788616195 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v45) v1 ==== 166+0+0 (secure 0 0 0) 0x7fe2a01de110 con 0x7fe2a014bcf0 2023-12-22T08:41:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe28006a460 msgr2=0x7fe28006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe28006a460 0x7fe28006c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe290007640 tx=0x7fe29000b040 comp rx=0 tx=0).stop 2023-12-22T08:41:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a014bcf0 msgr2=0x7fe2a01de3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a014bcf0 0x7fe2a01de3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c410 tx=0x7fe29800c8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 shutdown_connections 2023-12-22T08:41:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe28006a460 0x7fe28006c920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2a014bcf0 0x7fe2a01de3f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2a00b8120 0x7fe2a00b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 --2- 172.21.15.31:0/2788616195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe2a00b7c20 0x7fe2a01438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 >> 172.21.15.31:0/2788616195 conn(0x7fe2a0070d80 msgr2=0x7fe2a00b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 shutdown_connections 2023-12-22T08:41:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.524+0000 7fe29f59e640 1 -- 172.21.15.31:0/2788616195 wait complete. 2023-12-22T08:41:10.540 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T08:41:10.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f101a348640 1 Processor -- start 2023-12-22T08:41:10.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f101a348640 1 -- start start 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f101a348640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f10140be410 0x7f101414e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f101a348640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140ba4e0 0x7f10140b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f101a348640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10140b7fb0 0x7f10140bac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f101a348640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140b8bd0 con 0x7f10140b7fb0 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f101a348640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101406ae10 con 0x7f10140be410 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f101a348640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b9420 con 0x7f10140ba4e0 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f10188e5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10140b7fb0 0x7f10140bac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f10188e5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f10140b7fb0 0x7f10140bac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39840/0 (socket says 172.21.15.31:39840) 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.653+0000 7f10188e5640 1 -- 172.21.15.31:0/226693689 learned_addr learned my addr 172.21.15.31:0/226693689 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.654+0000 7f10137fe640 1 --2- 172.21.15.31:0/226693689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140ba4e0 0x7f10140b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.654+0000 7f1013fff640 1 --2- 172.21.15.31:0/226693689 >> v2:172.21.15.69:3300/0 conn(0x7f10140be410 0x7f101414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.654+0000 7f10188e5640 1 -- 172.21.15.31:0/226693689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140ba4e0 msgr2=0x7f10140b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:10.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.654+0000 7f10188e5640 1 --2- 172.21.15.31:0/226693689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140ba4e0 0x7f10140b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.654+0000 7f10188e5640 1 -- 172.21.15.31:0/226693689 >> v2:172.21.15.69:3300/0 conn(0x7f10140be410 msgr2=0x7f101414e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:10.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.654+0000 7f10188e5640 1 --2- 172.21.15.31:0/226693689 >> v2:172.21.15.69:3300/0 conn(0x7f10140be410 0x7f101414e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.654+0000 7f10188e5640 1 -- 172.21.15.31:0/226693689 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140b9670 con 0x7f10140b7fb0 2023-12-22T08:41:10.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.654+0000 7f10188e5640 1 --2- 172.21.15.31:0/226693689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140bac10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10140b93b0 tx=0x7f100c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3938454ed5bc33d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f1012ffd640 1 -- 172.21.15.31:0/226693689 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c02c9e0 con 0x7f10140b7fb0 2023-12-22T08:41:10.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f1012ffd640 1 -- 172.21.15.31:0/226693689 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c02cb40 con 0x7f10140b7fb0 2023-12-22T08:41:10.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f1012ffd640 1 -- 172.21.15.31:0/226693689 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c0343f0 con 0x7f10140b7fb0 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 -- 172.21.15.31:0/226693689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 msgr2=0x7f10140bac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 --2- 172.21.15.31:0/226693689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140bac10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10140b93b0 tx=0x7f100c02be40 comp rx=0 tx=0).stop 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 -- 172.21.15.31:0/226693689 shutdown_connections 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 --2- 172.21.15.31:0/226693689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140bac10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 --2- 172.21.15.31:0/226693689 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140ba4e0 0x7f10140b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 --2- 172.21.15.31:0/226693689 >> v2:172.21.15.69:3300/0 conn(0x7f10140be410 0x7f101414e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 -- 172.21.15.31:0/226693689 >> 172.21.15.31:0/226693689 conn(0x7f1014069ee0 msgr2=0x7f101406a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 -- 172.21.15.31:0/226693689 shutdown_connections 2023-12-22T08:41:10.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.655+0000 7f101a348640 1 -- 172.21.15.31:0/226693689 wait complete. 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.656+0000 7f101a348640 1 Processor -- start 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f101a348640 1 -- start start 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f101a348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f101a348640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10140ba4e0 0x7f10140b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f101a348640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140be410 0x7f101414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f101a348640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b7870 con 0x7f10140b7fb0 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f101a348640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b3220 con 0x7f10140ba4e0 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f101a348640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b2c60 con 0x7f10140be410 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f1013fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f1013fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140b7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39842/0 (socket says 172.21.15.31:39842) 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f1013fff640 1 -- 172.21.15.31:0/773893919 learned_addr learned my addr 172.21.15.31:0/773893919 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f10137fe640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10140ba4e0 0x7f10140b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.657+0000 7f10188e5640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140be410 0x7f101414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1013fff640 1 -- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140be410 msgr2=0x7f101414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1013fff640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140be410 0x7f101414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1013fff640 1 -- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10140ba4e0 msgr2=0x7f10140b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1013fff640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10140ba4e0 0x7f10140b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1013fff640 1 -- 172.21.15.31:0/773893919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c009b30 con 0x7f10140b7fb0 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f10137fe640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10140ba4e0 0x7f10140b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1013fff640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140b7330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e9b0 tx=0x7f0ffc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1010ff9640 1 -- 172.21.15.31:0/773893919 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc009670 con 0x7f10140b7fb0 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1010ff9640 1 -- 172.21.15.31:0/773893919 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00c9a0 con 0x7f10140b7fb0 2023-12-22T08:41:10.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10140b2f40 con 0x7f10140b7fb0 2023-12-22T08:41:10.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f1010ff9640 1 -- 172.21.15.31:0/773893919 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00cd50 con 0x7f10140b7fb0 2023-12-22T08:41:10.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.658+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10141461a0 con 0x7f10140b7fb0 2023-12-22T08:41:10.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.659+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1014073a40 con 0x7f10140b7fb0 2023-12-22T08:41:10.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.659+0000 7f1010ff9640 1 -- 172.21.15.31:0/773893919 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ffc013470 con 0x7f10140b7fb0 2023-12-22T08:41:10.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.660+0000 7f1010ff9640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0ff406a430 0x7f0ff406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:10.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.660+0000 7f1010ff9640 1 -- 172.21.15.31:0/773893919 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ffc088b70 con 0x7f10140b7fb0 2023-12-22T08:41:10.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.660+0000 7f10137fe640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0ff406a430 0x7f0ff406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:10.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.661+0000 7f10137fe640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0ff406a430 0x7f0ff406c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f10141ddbd0 tx=0x7f1004008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:10.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.664+0000 7f1010ff9640 1 -- 172.21.15.31:0/773893919 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0ffc054170 con 0x7f10140b7fb0 2023-12-22T08:41:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.839+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f10140b7d90 con 0x7f10140b7fb0 2023-12-22T08:41:10.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.844+0000 7f1010ff9640 1 -- 172.21.15.31:0/773893919 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ffc057790 con 0x7f10140b7fb0 2023-12-22T08:41:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.846+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0ff406a430 msgr2=0x7f0ff406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.846+0000 7f101a348640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0ff406a430 0x7f0ff406c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f10141ddbd0 tx=0x7f1004008040 comp rx=0 tx=0).stop 2023-12-22T08:41:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 msgr2=0x7f10140b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140b7330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e9b0 tx=0x7f0ffc00ee70 comp rx=0 tx=0).stop 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 shutdown_connections 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0ff406a430 0x7f0ff406c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f10140be410 0x7f101414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10140ba4e0 0x7f10140b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 --2- 172.21.15.31:0/773893919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10140b7fb0 0x7f10140b7330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 >> 172.21.15.31:0/773893919 conn(0x7f1014069ee0 msgr2=0x7f1014143110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 shutdown_connections 2023-12-22T08:41:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:10.847+0000 7f101a348640 1 -- 172.21.15.31:0/773893919 wait complete. 2023-12-22T08:41:10.860 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T08:41:10.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:41:10.960 DEBUG:teuthology.orchestra.run.smithi069:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:41:11.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T08:41:11.163 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T08:41:11.163 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:41:11.163 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:11.219 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:41:11.220 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:11.268 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:41:11.268 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:11.364 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:11.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.471+0000 7f9c728ce640 1 Processor -- start 2023-12-22T08:41:11.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.471+0000 7f9c728ce640 1 -- start start 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c728ce640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9c6c1544e0 0x7f9c6c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c728ce640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0bb310 con 0x7f9c6c06a6d0 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c728ce640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c0bf960 con 0x7f9c6c0ba550 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c728ce640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0bb5b0 con 0x7f9c6c1544e0 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9c6c06a6d0 0x7f9c6c14acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41734/0 (socket says 172.21.15.31:41734) 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6bfff640 1 -- 172.21.15.31:0/876036065 learned_addr learned my addr 172.21.15.31:0/876036065 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589670049 0 0) 0x7f9c6c0bb310 con 0x7f9c6c06a6d0 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c70e6b640 1 --2- 172.21.15.31:0/876036065 >> v2:172.21.15.69:3300/0 conn(0x7f9c6c1544e0 0x7f9c6c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c54003520 con 0x7f9c6c06a6d0 2023-12-22T08:41:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2202500743 0 0) 0x7f9c54003520 con 0x7f9c6c06a6d0 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 >> v2:172.21.15.69:3300/0 conn(0x7f9c6c1544e0 msgr2=0x7f9c6c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 --2- 172.21.15.31:0/876036065 >> v2:172.21.15.69:3300/0 conn(0x7f9c6c1544e0 0x7f9c6c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 >> v1:172.21.15.69:6789/0 conn(0x7f9c6c0ba550 legacy=0x7f9c6c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0c0120 con 0x7f9c6c06a6d0 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f9c60001670 con 0x7f9c6c06a6d0 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c70e6b640 1 --2- 172.21.15.31:0/876036065 >> v2:172.21.15.69:3300/0 conn(0x7f9c6c1544e0 0x7f9c6c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 >> v1:172.21.15.31:6789/0 conn(0x7f9c6c06a6d0 legacy=0x7f9c6c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54003970 0x7f9c54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c540047c0 0x7f9c54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54005180 0x7f9c5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0bb5b0 con 0x7f9c54005180 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5400c0d0 con 0x7f9c54003970 2023-12-22T08:41:11.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.472+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5400c290 con 0x7f9c540047c0 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c70e6b640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54005180 0x7f9c5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c6bfff640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54003970 0x7f9c54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c6b7fe640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c540047c0 0x7f9c54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c70e6b640 1 -- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c540047c0 msgr2=0x7f9c54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c70e6b640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c540047c0 0x7f9c54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c70e6b640 1 -- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54003970 msgr2=0x7f9c54003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c70e6b640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54003970 0x7f9c54003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c70e6b640 1 -- 172.21.15.31:0/876036065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54003520 con 0x7f9c54005180 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c6b7fe640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c540047c0 0x7f9c54004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c70e6b640 1 -- 172.21.15.31:0/876036065 reap_dead start 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.473+0000 7f9c70e6b640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54005180 0x7f9c5400b980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c640073e0 tx=0x7f9c540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6143276cfa9796df server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6402cdc0 con 0x7f9c54005180 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64034440 con 0x7f9c54005180 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c6affd640 1 -- 172.21.15.31:0/876036065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640347d0 con 0x7f9c54005180 2023-12-22T08:41:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c728ce640 1 -- 172.21.15.31:0/876036065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54005180 msgr2=0x7f9c5400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c728ce640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54005180 0x7f9c5400b980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9c640073e0 tx=0x7f9c540057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c728ce640 1 -- 172.21.15.31:0/876036065 shutdown_connections 2023-12-22T08:41:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c728ce640 1 --2- 172.21.15.31:0/876036065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54005180 0x7f9c5400b980 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c728ce640 1 -- 172.21.15.31:0/876036065 >> 172.21.15.31:0/876036065 conn(0x7f9c6c0c0350 msgr2=0x7f9c6c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c728ce640 1 -- 172.21.15.31:0/876036065 shutdown_connections 2023-12-22T08:41:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.474+0000 7f9c728ce640 1 -- 172.21.15.31:0/876036065 wait complete. 2023-12-22T08:41:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.475+0000 7f9c728ce640 1 Processor -- start 2023-12-22T08:41:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.475+0000 7f9c728ce640 1 -- start start 2023-12-22T08:41:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c728ce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54005180 0x7f9c6c1d9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c728ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6c149210 0x7f9c6c1dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c728ce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c6c149ad0 0x7f9c6c1e02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c728ce640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1d9d80 con 0x7f9c6c149210 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c728ce640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1e3550 con 0x7f9c54005180 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c728ce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1e3830 con 0x7f9c6c149ad0 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6c149210 0x7f9c6c1dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6c149210 0x7f9c6c1dfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39854/0 (socket says 172.21.15.31:39854) 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 -- 172.21.15.31:0/2895551360 learned_addr learned my addr 172.21.15.31:0/2895551360 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c70e6b640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c6c149ad0 0x7f9c6c1e02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6bfff640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54005180 0x7f9c6c1d9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 -- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c6c149ad0 msgr2=0x7f9c6c1e02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c6c149ad0 0x7f9c6c1e02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 -- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54005180 msgr2=0x7f9c6c1d9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54005180 0x7f9c6c1d9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 -- 172.21.15.31:0/2895551360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c1e3b10 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.476+0000 7f9c6b7fe640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6c149210 0x7f9c6c1dfd70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c007810 tx=0x7f9c5c00e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.477+0000 7f9c68ff9640 1 -- 172.21.15.31:0/2895551360 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0052e0 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.477+0000 7f9c68ff9640 1 -- 172.21.15.31:0/2895551360 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c005440 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.477+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c1e3df0 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.477+0000 7f9c68ff9640 1 -- 172.21.15.31:0/2895551360 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c003830 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.477+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c0b8c40 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.478+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c073a40 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.478+0000 7f9c68ff9640 1 -- 172.21.15.31:0/2895551360 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c5c003990 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.478+0000 7f9c68ff9640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c5806a430 0x7f9c5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.479+0000 7f9c68ff9640 1 -- 172.21.15.31:0/2895551360 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c5c087f80 con 0x7f9c6c149210 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.479+0000 7f9c6bfff640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c5806a430 0x7f9c5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.479+0000 7f9c6bfff640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c5806a430 0x7f9c5806c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000f60 tx=0x7f9c60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.483+0000 7f9c68ff9640 1 -- 172.21.15.31:0/2895551360 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c5c0bac80 con 0x7f9c6c149210 2023-12-22T08:41:11.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.661+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c6c0a62d0 con 0x7f9c6c149210 2023-12-22T08:41:11.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.662+0000 7f9c68ff9640 1 -- 172.21.15.31:0/2895551360 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f9c5c019090 con 0x7f9c6c149210 2023-12-22T08:41:11.664 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:11.664 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.663+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c5806a430 msgr2=0x7f9c5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.663+0000 7f9c728ce640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c5806a430 0x7f9c5806c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000f60 tx=0x7f9c60009040 comp rx=0 tx=0).stop 2023-12-22T08:41:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.663+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6c149210 msgr2=0x7f9c6c1dfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.663+0000 7f9c728ce640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6c149210 0x7f9c6c1dfd70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c007810 tx=0x7f9c5c00e910 comp rx=0 tx=0).stop 2023-12-22T08:41:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.664+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 shutdown_connections 2023-12-22T08:41:11.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.664+0000 7f9c728ce640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c5806a430 0x7f9c5806c8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.664+0000 7f9c728ce640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c6c149ad0 0x7f9c6c1e02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.664+0000 7f9c728ce640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c6c149210 0x7f9c6c1dfd70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.664+0000 7f9c728ce640 1 --2- 172.21.15.31:0/2895551360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c54005180 0x7f9c6c1d9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.664+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 >> 172.21.15.31:0/2895551360 conn(0x7f9c6c0c0350 msgr2=0x7f9c6c14a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.664+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 shutdown_connections 2023-12-22T08:41:11.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.664+0000 7f9c728ce640 1 -- 172.21.15.31:0/2895551360 wait complete. 2023-12-22T08:41:11.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:11.677 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.783+0000 7fd0f2e51640 1 Processor -- start 2023-12-22T08:41:11.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.783+0000 7fd0f2e51640 1 -- start start 2023-12-22T08:41:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f2e51640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd0ec145020 0x7fd0ec06fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f2e51640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec069d00 0x7fd0ec0b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f2e51640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0ec06a100 0x7fd0ec0b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f2e51640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec145400 con 0x7fd0ec06a100 2023-12-22T08:41:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f2e51640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec071b00 con 0x7fd0ec145020 2023-12-22T08:41:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f2e51640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0a2aa0 con 0x7fd0ec069d00 2023-12-22T08:41:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f13ee640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0ec06a100 0x7fd0ec0b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f13ee640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0ec06a100 0x7fd0ec0b7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39864/0 (socket says 172.21.15.31:39864) 2023-12-22T08:41:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f13ee640 1 -- 172.21.15.31:0/1066253691 learned_addr learned my addr 172.21.15.31:0/1066253691 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f0bed640 1 --2- 172.21.15.31:0/1066253691 >> v2:172.21.15.69:3300/0 conn(0x7fd0ec145020 0x7fd0ec06fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0ebfff640 1 --2- 172.21.15.31:0/1066253691 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec069d00 0x7fd0ec0b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f13ee640 1 -- 172.21.15.31:0/1066253691 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec069d00 msgr2=0x7fd0ec0b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f13ee640 1 --2- 172.21.15.31:0/1066253691 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec069d00 0x7fd0ec0b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f13ee640 1 -- 172.21.15.31:0/1066253691 >> v2:172.21.15.69:3300/0 conn(0x7fd0ec145020 msgr2=0x7fd0ec06fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f13ee640 1 --2- 172.21.15.31:0/1066253691 >> v2:172.21.15.69:3300/0 conn(0x7fd0ec145020 0x7fd0ec06fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.784+0000 7fd0f13ee640 1 -- 172.21.15.31:0/1066253691 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0a24e0 con 0x7fd0ec06a100 2023-12-22T08:41:11.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.785+0000 7fd0f13ee640 1 --2- 172.21.15.31:0/1066253691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec06a100 0x7fd0ec0b7f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec06a7f0 tx=0x7fd0e402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1afc160acc60107 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.785+0000 7fd0eb7fe640 1 -- 172.21.15.31:0/1066253691 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e402cb00 con 0x7fd0ec06a100 2023-12-22T08:41:11.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.785+0000 7fd0eb7fe640 1 -- 172.21.15.31:0/1066253691 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e402cc60 con 0x7fd0ec06a100 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.785+0000 7fd0eb7fe640 1 -- 172.21.15.31:0/1066253691 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40343f0 con 0x7fd0ec06a100 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1066253691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec06a100 msgr2=0x7fd0ec0b7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1066253691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec06a100 0x7fd0ec0b7f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec06a7f0 tx=0x7fd0e402bf60 comp rx=0 tx=0).stop 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1066253691 shutdown_connections 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1066253691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec06a100 0x7fd0ec0b7f50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1066253691 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec069d00 0x7fd0ec0b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1066253691 >> v2:172.21.15.69:3300/0 conn(0x7fd0ec145020 0x7fd0ec06fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1066253691 >> 172.21.15.31:0/1066253691 conn(0x7fd0ec0bd090 msgr2=0x7fd0ec0bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1066253691 shutdown_connections 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.786+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1066253691 wait complete. 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.787+0000 7fd0f2e51640 1 Processor -- start 2023-12-22T08:41:11.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.787+0000 7fd0f2e51640 1 -- start start 2023-12-22T08:41:11.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f2e51640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0ec069d00 0x7fd0ec13b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f2e51640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec06a100 0x7fd0ec1414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f2e51640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145020 0x7fd0ec1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f2e51640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec13bd50 con 0x7fd0ec145020 2023-12-22T08:41:11.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f2e51640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec13ad60 con 0x7fd0ec069d00 2023-12-22T08:41:11.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f2e51640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec13b320 con 0x7fd0ec06a100 2023-12-22T08:41:11.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145020 0x7fd0ec1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145020 0x7fd0ec1419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39880/0 (socket says 172.21.15.31:39880) 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 -- 172.21.15.31:0/1995550268 learned_addr learned my addr 172.21.15.31:0/1995550268 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f0bed640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0ec069d00 0x7fd0ec13b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0ebfff640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec06a100 0x7fd0ec1414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 -- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec06a100 msgr2=0x7fd0ec1414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec06a100 0x7fd0ec1414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 -- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0ec069d00 msgr2=0x7fd0ec13b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0ec069d00 0x7fd0ec13b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 -- 172.21.15.31:0/1995550268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4009b30 con 0x7fd0ec145020 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.788+0000 7fd0f13ee640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145020 0x7fd0ec1419f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4036040 tx=0x7fd0e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.789+0000 7fd0e97fa640 1 -- 172.21.15.31:0/1995550268 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4007e70 con 0x7fd0ec145020 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.789+0000 7fd0e97fa640 1 -- 172.21.15.31:0/1995550268 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e4009510 con 0x7fd0ec145020 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.789+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec13d2e0 con 0x7fd0ec145020 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.789+0000 7fd0e97fa640 1 -- 172.21.15.31:0/1995550268 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e403e690 con 0x7fd0ec145020 2023-12-22T08:41:11.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.789+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec13afb0 con 0x7fd0ec145020 2023-12-22T08:41:11.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.790+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec13cf20 con 0x7fd0ec145020 2023-12-22T08:41:11.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.790+0000 7fd0e97fa640 1 -- 172.21.15.31:0/1995550268 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd0e403e7f0 con 0x7fd0ec145020 2023-12-22T08:41:11.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.791+0000 7fd0e97fa640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a460 0x7fd0d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:11.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.791+0000 7fd0e97fa640 1 -- 172.21.15.31:0/1995550268 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0e40ab320 con 0x7fd0ec145020 2023-12-22T08:41:11.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.791+0000 7fd0f0bed640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a460 0x7fd0d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:11.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.791+0000 7fd0f0bed640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a460 0x7fd0d806c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009b40 tx=0x7fd0dc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:11.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.795+0000 7fd0e97fa640 1 -- 172.21.15.31:0/1995550268 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0e40769b0 con 0x7fd0ec145020 2023-12-22T08:41:11.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.973+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0ec073a40 con 0x7fd0ec145020 2023-12-22T08:41:11.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.974+0000 7fd0e97fa640 1 -- 172.21.15.31:0/1995550268 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0e4079fd0 con 0x7fd0ec145020 2023-12-22T08:41:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a460 msgr2=0x7fd0d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a460 0x7fd0d806c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009b40 tx=0x7fd0dc009190 comp rx=0 tx=0).stop 2023-12-22T08:41:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145020 msgr2=0x7fd0ec1419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145020 0x7fd0ec1419f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4036040 tx=0x7fd0e4004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 shutdown_connections 2023-12-22T08:41:11.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a460 0x7fd0d806c920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145020 0x7fd0ec1419f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec06a100 0x7fd0ec1414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 --2- 172.21.15.31:0/1995550268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0ec069d00 0x7fd0ec13b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 >> 172.21.15.31:0/1995550268 conn(0x7fd0ec0bd090 msgr2=0x7fd0ec0bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 shutdown_connections 2023-12-22T08:41:11.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:11.976+0000 7fd0f2e51640 1 -- 172.21.15.31:0/1995550268 wait complete. 2023-12-22T08:41:11.989 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:12.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.094+0000 7fa0c76bd640 1 Processor -- start 2023-12-22T08:41:12.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c76bd640 1 -- start start 2023-12-22T08:41:12.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c76bd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0c00b8690 0x7fa0c00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c76bd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa0c00b77d0 0x7fa0c0144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c76bd640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c014ab10 con 0x7fa0c0144bb0 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c76bd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c0145020 con 0x7fa0c00b8690 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c76bd640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c006c2f0 con 0x7fa0c00b77d0 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c5459640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0c00b8690 0x7fa0c00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c5459640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0c00b8690 0x7fa0c00b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39886/0 (socket says 172.21.15.31:39886) 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.095+0000 7fa0c5459640 1 -- 172.21.15.31:0/536864413 learned_addr learned my addr 172.21.15.31:0/536864413 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.096+0000 7fa0c4c58640 1 --2- 172.21.15.31:0/536864413 >> v2:172.21.15.69:3300/0 conn(0x7fa0c00b77d0 0x7fa0c0144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.096+0000 7fa0c5459640 1 -- 172.21.15.31:0/536864413 >> v2:172.21.15.69:3300/0 conn(0x7fa0c00b77d0 msgr2=0x7fa0c0144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:12.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.096+0000 7fa0c5459640 1 --2- 172.21.15.31:0/536864413 >> v2:172.21.15.69:3300/0 conn(0x7fa0c00b77d0 0x7fa0c0144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.096+0000 7fa0c5459640 1 -- 172.21.15.31:0/536864413 >> v1:172.21.15.69:6789/0 conn(0x7fa0c0144bb0 legacy=0x7fa0c014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:12.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.096+0000 7fa0c5459640 1 -- 172.21.15.31:0/536864413 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00ba620 con 0x7fa0c00b8690 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.096+0000 7fa0c5459640 1 --2- 172.21.15.31:0/536864413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c00b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0c006ae90 tx=0x7fa0bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1185b2927bb0ad server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0b7fff640 1 -- 172.21.15.31:0/536864413 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0317e0 con 0x7fa0c00b8690 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0b7fff640 1 -- 172.21.15.31:0/536864413 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc031940 con 0x7fa0c00b8690 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0b7fff640 1 -- 172.21.15.31:0/536864413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc031cd0 con 0x7fa0c00b8690 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0c76bd640 1 -- 172.21.15.31:0/536864413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 msgr2=0x7fa0c00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/536864413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c00b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0c006ae90 tx=0x7fa0bc02b880 comp rx=0 tx=0).stop 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0c76bd640 1 -- 172.21.15.31:0/536864413 shutdown_connections 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/536864413 >> v2:172.21.15.69:3300/0 conn(0x7fa0c00b77d0 0x7fa0c0144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/536864413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c00b8a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0c76bd640 1 -- 172.21.15.31:0/536864413 >> 172.21.15.31:0/536864413 conn(0x7fa0c006b6a0 msgr2=0x7fa0c006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0c76bd640 1 -- 172.21.15.31:0/536864413 shutdown_connections 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.097+0000 7fa0c76bd640 1 -- 172.21.15.31:0/536864413 wait complete. 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.098+0000 7fa0c76bd640 1 Processor -- start 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.098+0000 7fa0c76bd640 1 -- start start 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c76bd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0c00b77d0 0x7fa0c01d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c76bd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c0149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c76bd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0c0144bb0 0x7fa0c01d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c76bd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c01d1330 con 0x7fa0c00b8690 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c76bd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c014a2f0 con 0x7fa0c0144bb0 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c76bd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c01490c0 con 0x7fa0c00b77d0 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c0149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c0149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39896/0 (socket says 172.21.15.31:39896) 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 -- 172.21.15.31:0/485933580 learned_addr learned my addr 172.21.15.31:0/485933580 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c5459640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0c00b77d0 0x7fa0c01d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c5c5a640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0c0144bb0 0x7fa0c01d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 -- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0c00b77d0 msgr2=0x7fa0c01d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0c00b77d0 0x7fa0c01d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 -- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0c0144bb0 msgr2=0x7fa0c01d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0c0144bb0 0x7fa0c01d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 -- 172.21.15.31:0/485933580 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0094d0 con 0x7fa0c00b8690 2023-12-22T08:41:12.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.099+0000 7fa0c4c58640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c0149520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000c7f0 tx=0x7fa0b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.100+0000 7fa0b5ffb640 1 -- 172.21.15.31:0/485933580 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0004220 con 0x7fa0c00b8690 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.100+0000 7fa0b5ffb640 1 -- 172.21.15.31:0/485933580 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b00043a0 con 0x7fa0c00b8690 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.100+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c0148d60 con 0x7fa0c00b8690 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.100+0000 7fa0b5ffb640 1 -- 172.21.15.31:0/485933580 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0007860 con 0x7fa0c00b8690 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.100+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c0149a60 con 0x7fa0c00b8690 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.101+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c0073a40 con 0x7fa0c00b8690 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.101+0000 7fa0b5ffb640 1 -- 172.21.15.31:0/485933580 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa0b0007bd0 con 0x7fa0c00b8690 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.101+0000 7fa0b5ffb640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa0a406a430 0x7fa0a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.102+0000 7fa0b5ffb640 1 -- 172.21.15.31:0/485933580 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0b0088780 con 0x7fa0c00b8690 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.102+0000 7fa0c5459640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa0a406a430 0x7fa0a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.102+0000 7fa0c5459640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa0a406a430 0x7fa0a406c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc036000 tx=0x7fa0bc03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.106+0000 7fa0b5ffb640 1 -- 172.21.15.31:0/485933580 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa0b0053eb0 con 0x7fa0c00b8690 2023-12-22T08:41:12.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.279+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0c0142d80 con 0x7fa0c00b8690 2023-12-22T08:41:12.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.280+0000 7fa0b5ffb640 1 -- 172.21.15.31:0/485933580 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0b001e020 con 0x7fa0c00b8690 2023-12-22T08:41:12.282 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:41:12.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa0a406a430 msgr2=0x7fa0a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa0a406a430 0x7fa0a406c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc036000 tx=0x7fa0bc03d040 comp rx=0 tx=0).stop 2023-12-22T08:41:12.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 msgr2=0x7fa0c0149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c0149520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000c7f0 tx=0x7fa0b000ccb0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 shutdown_connections 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa0a406a430 0x7fa0a406c8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0c0144bb0 0x7fa0c01d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0c00b8690 0x7fa0c0149520 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 --2- 172.21.15.31:0/485933580 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa0c00b77d0 0x7fa0c01d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 >> 172.21.15.31:0/485933580 conn(0x7fa0c006b6a0 msgr2=0x7fa0c006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 shutdown_connections 2023-12-22T08:41:12.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.282+0000 7fa0c76bd640 1 -- 172.21.15.31:0/485933580 wait complete. 2023-12-22T08:41:12.295 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:12.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.401+0000 7f9221df0640 1 Processor -- start 2023-12-22T08:41:12.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.401+0000 7f9221df0640 1 -- start start 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f9221df0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c144d80 0x7f921c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f9221df0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f921c0b77d0 0x7f921c14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f9221df0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c14ab10 con 0x7f921c0b8690 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f9221df0640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c06c2f0 con 0x7f921c0b77d0 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f9221df0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0ba620 con 0x7f921c144d80 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921b7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f921c0b8690 0x7f921c144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41736/0 (socket says 172.21.15.31:41736) 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921b7fe640 1 -- 172.21.15.31:0/3035620560 learned_addr learned my addr 172.21.15.31:0/3035620560 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921affd640 1 --2- 172.21.15.31:0/3035620560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c144d80 0x7f921c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921bfff640 1 --2- 172.21.15.31:0/3035620560 >> v2:172.21.15.69:3300/0 conn(0x7f921c0b77d0 0x7f921c14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921a7fc640 1 -- 172.21.15.31:0/3035620560 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053819554 0 0) 0x7f921c14ab10 con 0x7f921c0b8690 2023-12-22T08:41:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921a7fc640 1 -- 172.21.15.31:0/3035620560 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9204003520 con 0x7f921c0b8690 2023-12-22T08:41:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921a7fc640 1 -- 172.21.15.31:0/3035620560 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 359441085 0 0) 0x7f9204003520 con 0x7f921c0b8690 2023-12-22T08:41:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921affd640 1 -- 172.21.15.31:0/3035620560 >> v2:172.21.15.69:3300/0 conn(0x7f921c0b77d0 msgr2=0x7f921c14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921affd640 1 --2- 172.21.15.31:0/3035620560 >> v2:172.21.15.69:3300/0 conn(0x7f921c0b77d0 0x7f921c14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921affd640 1 -- 172.21.15.31:0/3035620560 >> v1:172.21.15.31:6789/0 conn(0x7f921c0b8690 legacy=0x7f921c144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.402+0000 7f921affd640 1 -- 172.21.15.31:0/3035620560 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0b9e60 con 0x7f921c144d80 2023-12-22T08:41:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.403+0000 7f921affd640 1 --2- 172.21.15.31:0/3035620560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c144d80 0x7f921c0b8a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92100097a0 tx=0x7f921002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3250270d0f27a7aa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.403+0000 7f921a7fc640 1 -- 172.21.15.31:0/3035620560 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c001670 con 0x7f921c144d80 2023-12-22T08:41:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.403+0000 7f921a7fc640 1 -- 172.21.15.31:0/3035620560 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921002e050 con 0x7f921c144d80 2023-12-22T08:41:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.403+0000 7f921a7fc640 1 -- 172.21.15.31:0/3035620560 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210030710 con 0x7f921c144d80 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.404+0000 7f9221df0640 1 -- 172.21.15.31:0/3035620560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c144d80 msgr2=0x7f921c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.404+0000 7f9221df0640 1 --2- 172.21.15.31:0/3035620560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c144d80 0x7f921c0b8a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92100097a0 tx=0x7f921002b710 comp rx=0 tx=0).stop 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.404+0000 7f9221df0640 1 -- 172.21.15.31:0/3035620560 shutdown_connections 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.404+0000 7f9221df0640 1 --2- 172.21.15.31:0/3035620560 >> v2:172.21.15.69:3300/0 conn(0x7f921c0b77d0 0x7f921c14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.404+0000 7f9221df0640 1 --2- 172.21.15.31:0/3035620560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c144d80 0x7f921c0b8a70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.404+0000 7f9221df0640 1 -- 172.21.15.31:0/3035620560 >> 172.21.15.31:0/3035620560 conn(0x7f921c06b6a0 msgr2=0x7f921c06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.404+0000 7f9221df0640 1 -- 172.21.15.31:0/3035620560 shutdown_connections 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.404+0000 7f9221df0640 1 -- 172.21.15.31:0/3035620560 wait complete. 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.405+0000 7f9221df0640 1 Processor -- start 2023-12-22T08:41:12.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.405+0000 7f9221df0640 1 -- start start 2023-12-22T08:41:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9221df0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c0b77d0 0x7f921c13c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9221df0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f921c0b8690 0x7f921c148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9221df0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c144d80 0x7f921c149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9221df0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c13caa0 con 0x7f921c144d80 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9221df0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c14a140 con 0x7f921c0b8690 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9221df0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c148ba0 con 0x7f921c0b77d0 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c144d80 0x7f921c149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c144d80 0x7f921c149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39908/0 (socket says 172.21.15.31:39908) 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 -- 172.21.15.31:0/3417233876 learned_addr learned my addr 172.21.15.31:0/3417233876 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921b7fe640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c0b77d0 0x7f921c13c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921affd640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f921c0b8690 0x7f921c148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 -- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c0b77d0 msgr2=0x7f921c13c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c0b77d0 0x7f921c13c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 -- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f921c0b8690 msgr2=0x7f921c148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f921c0b8690 0x7f921c148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 -- 172.21.15.31:0/3417233876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9210009400 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921affd640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f921c0b8690 0x7f921c148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f921bfff640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c144d80 0x7f921c149200 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f921400ebe0 tx=0x7f921400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9203fff640 1 -- 172.21.15.31:0/3417233876 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921400ccc0 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9203fff640 1 -- 172.21.15.31:0/3417233876 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921400f040 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c147650 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.406+0000 7f9203fff640 1 -- 172.21.15.31:0/3417233876 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92140146c0 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.407+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c1472e0 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.408+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c073a40 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.408+0000 7f9203fff640 1 -- 172.21.15.31:0/3417233876 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9214014820 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.408+0000 7f9203fff640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f920806a430 0x7f920806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.408+0000 7f9203fff640 1 -- 172.21.15.31:0/3417233876 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9214089570 con 0x7f921c144d80 2023-12-22T08:41:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.408+0000 7f921b7fe640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f920806a430 0x7f920806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.409+0000 7f921b7fe640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f920806a430 0x7f920806c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f920c006b50 tx=0x7f920c001dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.412+0000 7f9203fff640 1 -- 172.21.15.31:0/3417233876 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9214054b60 con 0x7f921c144d80 2023-12-22T08:41:12.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.588+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f921c148de0 con 0x7f921c144d80 2023-12-22T08:41:12.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.589+0000 7f9203fff640 1 -- 172.21.15.31:0/3417233876 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9214058180 con 0x7f921c144d80 2023-12-22T08:41:12.591 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:41:12.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f920806a430 msgr2=0x7f920806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f920806a430 0x7f920806c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f920c006b50 tx=0x7f920c001dc0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c144d80 msgr2=0x7f921c149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c144d80 0x7f921c149200 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f921400ebe0 tx=0x7f921400c490 comp rx=0 tx=0).stop 2023-12-22T08:41:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 shutdown_connections 2023-12-22T08:41:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f920806a430 0x7f920806c8f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f921c144d80 0x7f921c149200 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f921c0b8690 0x7f921c148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 --2- 172.21.15.31:0/3417233876 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f921c0b77d0 0x7f921c13c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 >> 172.21.15.31:0/3417233876 conn(0x7f921c06b6a0 msgr2=0x7f921c14afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 shutdown_connections 2023-12-22T08:41:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.591+0000 7f9221df0640 1 -- 172.21.15.31:0/3417233876 wait complete. 2023-12-22T08:41:12.604 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:41:12.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.708+0000 7fae82a17640 1 Processor -- start 2023-12-22T08:41:12.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.708+0000 7fae82a17640 1 -- start start 2023-12-22T08:41:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae82a17640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fae7c0b79f0 0x7fae7c0bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae82a17640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae7c14aa00 0x7fae7c0b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae82a17640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c0bacc0 con 0x7fae7c140ef0 2023-12-22T08:41:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae82a17640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0bbca0 con 0x7fae7c14aa00 2023-12-22T08:41:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae82a17640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0bbe60 con 0x7fae7c0b79f0 2023-12-22T08:41:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae7b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fae7c14aa00 0x7fae7c0b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae80fb4640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fae7c140ef0 0x7fae7c141380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41748/0 (socket says 172.21.15.31:41748) 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae80fb4640 1 -- 172.21.15.31:0/2398903317 learned_addr learned my addr 172.21.15.31:0/2398903317 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae7bfff640 1 --2- 172.21.15.31:0/2398903317 >> v2:172.21.15.69:3300/0 conn(0x7fae7c0b79f0 0x7fae7c0bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae7b7fe640 1 -- 172.21.15.31:0/2398903317 >> v2:172.21.15.69:3300/0 conn(0x7fae7c0b79f0 msgr2=0x7fae7c0bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae7b7fe640 1 --2- 172.21.15.31:0/2398903317 >> v2:172.21.15.69:3300/0 conn(0x7fae7c0b79f0 0x7fae7c0bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae7b7fe640 1 -- 172.21.15.31:0/2398903317 >> v1:172.21.15.31:6789/0 conn(0x7fae7c140ef0 legacy=0x7fae7c141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae7b7fe640 1 -- 172.21.15.31:0/2398903317 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0b8bc0 con 0x7fae7c14aa00 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.709+0000 7fae7affd640 1 -- 172.21.15.31:0/2398903317 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277686615 0 0) 0x7fae7c0bacc0 con 0x7fae7c140ef0 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.710+0000 7fae7b7fe640 1 --2- 172.21.15.31:0/2398903317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c14aa00 0x7fae7c0b83a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0bbdf0 tx=0x7fae6c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11cc22fa9b1d737 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.710+0000 7fae7affd640 1 -- 172.21.15.31:0/2398903317 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c030610 con 0x7fae7c14aa00 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.710+0000 7fae7affd640 1 -- 172.21.15.31:0/2398903317 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c030770 con 0x7fae7c14aa00 2023-12-22T08:41:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.710+0000 7fae7affd640 1 -- 172.21.15.31:0/2398903317 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c030b00 con 0x7fae7c14aa00 2023-12-22T08:41:12.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.710+0000 7fae82a17640 1 -- 172.21.15.31:0/2398903317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c14aa00 msgr2=0x7fae7c0b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.710+0000 7fae82a17640 1 --2- 172.21.15.31:0/2398903317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c14aa00 0x7fae7c0b83a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0bbdf0 tx=0x7fae6c02b960 comp rx=0 tx=0).stop 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.711+0000 7fae82a17640 1 -- 172.21.15.31:0/2398903317 shutdown_connections 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.711+0000 7fae82a17640 1 --2- 172.21.15.31:0/2398903317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c14aa00 0x7fae7c0b83a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.711+0000 7fae82a17640 1 --2- 172.21.15.31:0/2398903317 >> v2:172.21.15.69:3300/0 conn(0x7fae7c0b79f0 0x7fae7c0bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.711+0000 7fae82a17640 1 -- 172.21.15.31:0/2398903317 >> 172.21.15.31:0/2398903317 conn(0x7fae7c0c0340 msgr2=0x7fae7c0c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.711+0000 7fae82a17640 1 -- 172.21.15.31:0/2398903317 shutdown_connections 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.711+0000 7fae82a17640 1 -- 172.21.15.31:0/2398903317 wait complete. 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.712+0000 7fae82a17640 1 Processor -- start 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.712+0000 7fae82a17640 1 -- start start 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.712+0000 7fae82a17640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c0b79f0 0x7fae7c13bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.712+0000 7fae82a17640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fae7c140ef0 0x7fae7c145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.712+0000 7fae82a17640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae7c14aa00 0x7fae7c1e2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.712+0000 7fae82a17640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c13c160 con 0x7fae7c0b79f0 2023-12-22T08:41:12.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.712+0000 7fae82a17640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c147f30 con 0x7fae7c14aa00 2023-12-22T08:41:12.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.712+0000 7fae82a17640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c147060 con 0x7fae7c140ef0 2023-12-22T08:41:12.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c0b79f0 0x7fae7c13bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c0b79f0 0x7fae7c13bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39918/0 (socket says 172.21.15.31:39918) 2023-12-22T08:41:12.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 -- 172.21.15.31:0/3199112754 learned_addr learned my addr 172.21.15.31:0/3199112754 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:12.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae80fb4640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae7c14aa00 0x7fae7c1e2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 -- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fae7c140ef0 msgr2=0x7fae7c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7b7fe640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fae7c140ef0 0x7fae7c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fae7c140ef0 0x7fae7c145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 -- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae7c14aa00 msgr2=0x7fae7c1e2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae7c14aa00 0x7fae7c1e2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 -- 172.21.15.31:0/3199112754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c009400 con 0x7fae7c0b79f0 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae80fb4640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae7c14aa00 0x7fae7c1e2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7b7fe640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fae7c140ef0 0x7fae7c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae7bfff640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c0b79f0 0x7fae7c13bc20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae7000d800 tx=0x7fae7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae78ff9640 1 -- 172.21.15.31:0/3199112754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7000b660 con 0x7fae7c0b79f0 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae78ff9640 1 -- 172.21.15.31:0/3199112754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7000b7c0 con 0x7fae7c0b79f0 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c147600 con 0x7fae7c0b79f0 2023-12-22T08:41:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae78ff9640 1 -- 172.21.15.31:0/3199112754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7000bb50 con 0x7fae7c0b79f0 2023-12-22T08:41:12.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.713+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c147bc0 con 0x7fae7c0b79f0 2023-12-22T08:41:12.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.714+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c073a40 con 0x7fae7c0b79f0 2023-12-22T08:41:12.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.715+0000 7fae78ff9640 1 -- 172.21.15.31:0/3199112754 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae7000bcb0 con 0x7fae7c0b79f0 2023-12-22T08:41:12.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.715+0000 7fae78ff9640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fae6806a430 0x7fae6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:12.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.715+0000 7fae78ff9640 1 -- 172.21.15.31:0/3199112754 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae70088d70 con 0x7fae7c0b79f0 2023-12-22T08:41:12.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.715+0000 7fae7b7fe640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fae6806a430 0x7fae6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:12.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.716+0000 7fae7b7fe640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fae6806a430 0x7fae6806c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae6c036000 tx=0x7fae6c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:12.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.719+0000 7fae78ff9640 1 -- 172.21.15.31:0/3199112754 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fae700543f0 con 0x7fae7c0b79f0 2023-12-22T08:41:12.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.906+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae7c14aff0 con 0x7fae7c0b79f0 2023-12-22T08:41:12.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.907+0000 7fae78ff9640 1 -- 172.21.15.31:0/3199112754 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae70057a10 con 0x7fae7c0b79f0 2023-12-22T08:41:12.909 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fae6806a430 msgr2=0x7fae6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fae6806a430 0x7fae6806c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae6c036000 tx=0x7fae6c03b040 comp rx=0 tx=0).stop 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c0b79f0 msgr2=0x7fae7c13bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c0b79f0 0x7fae7c13bc20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae7000d800 tx=0x7fae7000dcc0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 shutdown_connections 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fae6806a430 0x7fae6806c8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae7c14aa00 0x7fae7c1e2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fae7c140ef0 0x7fae7c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 --2- 172.21.15.31:0/3199112754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae7c0b79f0 0x7fae7c13bc20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:12.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.908+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 >> 172.21.15.31:0/3199112754 conn(0x7fae7c0c0340 msgr2=0x7fae7c13fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:12.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.909+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 shutdown_connections 2023-12-22T08:41:12.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:12.909+0000 7fae82a17640 1 -- 172.21.15.31:0/3199112754 wait complete. 2023-12-22T08:41:12.921 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:41:12.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:12.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-22T08:41:13.038 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-12-22T08:41:13.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:13.038 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:41:13.103 INFO:tasks.cephfs.cephfs_test_case:[] 2023-12-22T08:41:13.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:13.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.208+0000 7fef3870a640 1 Processor -- start 2023-12-22T08:41:13.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.208+0000 7fef3870a640 1 -- start start 2023-12-22T08:41:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef3870a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fef3006a6d0 0x7fef3014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef3870a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300bb310 con 0x7fef3014b1f0 2023-12-22T08:41:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef3870a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300bf960 con 0x7fef300ba550 2023-12-22T08:41:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef3870a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef300bb5b0 con 0x7fef3006a6d0 2023-12-22T08:41:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef364a6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fef3006a6d0 0x7fef3014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef35ca5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fef3014b1f0 0x7fef300b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41758/0 (socket says 172.21.15.31:41758) 2023-12-22T08:41:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef35ca5640 1 -- 172.21.15.31:0/219311963 learned_addr learned my addr 172.21.15.31:0/219311963 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef364a6640 1 -- 172.21.15.31:0/219311963 >> v1:172.21.15.69:6789/0 conn(0x7fef300ba550 legacy=0x7fef301554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef364a6640 1 -- 172.21.15.31:0/219311963 >> v1:172.21.15.31:6789/0 conn(0x7fef3014b1f0 legacy=0x7fef300b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef364a6640 1 -- 172.21.15.31:0/219311963 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300c0120 con 0x7fef3006a6d0 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.209+0000 7fef354a4640 1 -- 172.21.15.31:0/219311963 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513011832 0 0) 0x7fef300bb310 con 0x7fef3014b1f0 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.210+0000 7fef364a6640 1 --2- 172.21.15.31:0/219311963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef3006a6d0 0x7fef3014acb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0097a0 tx=0x7fef2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1cdaff246be119 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.210+0000 7fef354a4640 1 -- 172.21.15.31:0/219311963 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c031830 con 0x7fef3006a6d0 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.210+0000 7fef354a4640 1 -- 172.21.15.31:0/219311963 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c031990 con 0x7fef3006a6d0 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.210+0000 7fef354a4640 1 -- 172.21.15.31:0/219311963 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c031d20 con 0x7fef3006a6d0 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.210+0000 7fef3870a640 1 -- 172.21.15.31:0/219311963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef3006a6d0 msgr2=0x7fef3014acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.210+0000 7fef3870a640 1 --2- 172.21.15.31:0/219311963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef3006a6d0 0x7fef3014acb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0097a0 tx=0x7fef2c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.210+0000 7fef3870a640 1 -- 172.21.15.31:0/219311963 shutdown_connections 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.210+0000 7fef3870a640 1 --2- 172.21.15.31:0/219311963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef3006a6d0 0x7fef3014acb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.211+0000 7fef3870a640 1 -- 172.21.15.31:0/219311963 >> 172.21.15.31:0/219311963 conn(0x7fef300c0350 msgr2=0x7fef300c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:13.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.211+0000 7fef3870a640 1 -- 172.21.15.31:0/219311963 shutdown_connections 2023-12-22T08:41:13.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.211+0000 7fef3870a640 1 -- 172.21.15.31:0/219311963 wait complete. 2023-12-22T08:41:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef3870a640 1 Processor -- start 2023-12-22T08:41:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef3870a640 1 -- start start 2023-12-22T08:41:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef3870a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3006a6d0 0x7fef301472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef3870a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300ba550 0x7fef3014cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef3870a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef3014b1f0 0x7fef3014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef3870a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3014f110 con 0x7fef300ba550 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef3870a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300b3af0 con 0x7fef3006a6d0 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef3870a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3014e460 con 0x7fef3014b1f0 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef35ca5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300ba550 0x7fef3014cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef35ca5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300ba550 0x7fef3014cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39938/0 (socket says 172.21.15.31:39938) 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef35ca5640 1 -- 172.21.15.31:0/2045756408 learned_addr learned my addr 172.21.15.31:0/2045756408 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef36ca7640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef3014b1f0 0x7fef3014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.212+0000 7fef364a6640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3006a6d0 0x7fef301472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef35ca5640 1 -- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef3014b1f0 msgr2=0x7fef3014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef35ca5640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef3014b1f0 0x7fef3014ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef35ca5640 1 -- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3006a6d0 msgr2=0x7fef301472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef35ca5640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3006a6d0 0x7fef301472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef35ca5640 1 -- 172.21.15.31:0/2045756408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c009400 con 0x7fef300ba550 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef35ca5640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300ba550 0x7fef3014cec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c4b0 tx=0x7fef2000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef26ffd640 1 -- 172.21.15.31:0/2045756408 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200074e0 con 0x7fef300ba550 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef26ffd640 1 -- 172.21.15.31:0/2045756408 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20007660 con 0x7fef300ba550 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef300a5610 con 0x7fef300ba550 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef26ffd640 1 -- 172.21.15.31:0/2045756408 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20004a20 con 0x7fef300ba550 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.213+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef300a5bd0 con 0x7fef300ba550 2023-12-22T08:41:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.214+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef30073a40 con 0x7fef300ba550 2023-12-22T08:41:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.214+0000 7fef26ffd640 1 -- 172.21.15.31:0/2045756408 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef20004b80 con 0x7fef300ba550 2023-12-22T08:41:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.215+0000 7fef26ffd640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fef1406a430 0x7fef1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.215+0000 7fef26ffd640 1 -- 172.21.15.31:0/2045756408 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef20087e00 con 0x7fef300ba550 2023-12-22T08:41:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.215+0000 7fef364a6640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fef1406a430 0x7fef1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.216+0000 7fef364a6640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fef1406a430 0x7fef1406c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fef2c036000 tx=0x7fef2c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.219+0000 7fef26ffd640 1 -- 172.21.15.31:0/2045756408 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fef200534b0 con 0x7fef300ba550 2023-12-22T08:41:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.432+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef300a62d0 con 0x7fef300ba550 2023-12-22T08:41:13.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.433+0000 7fef26ffd640 1 -- 172.21.15.31:0/2045756408 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7fef20018090 con 0x7fef300ba550 2023-12-22T08:41:13.436 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:13.436 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:40:45.862817+0000","modified":"2023-12-22T08:40:48.867080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:41:13.436 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2023-12-22T08:41:13.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fef1406a430 msgr2=0x7fef1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fef1406a430 0x7fef1406c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fef2c036000 tx=0x7fef2c03c040 comp rx=0 tx=0).stop 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300ba550 msgr2=0x7fef3014cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300ba550 0x7fef3014cec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c4b0 tx=0x7fef2000c970 comp rx=0 tx=0).stop 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 shutdown_connections 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fef1406a430 0x7fef1406c8f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef3014b1f0 0x7fef3014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef300ba550 0x7fef3014cec0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 --2- 172.21.15.31:0/2045756408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3006a6d0 0x7fef301472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 >> 172.21.15.31:0/2045756408 conn(0x7fef300c0350 msgr2=0x7fef300b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 shutdown_connections 2023-12-22T08:41:13.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.435+0000 7fef3870a640 1 -- 172.21.15.31:0/2045756408 wait complete. 2023-12-22T08:41:13.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:13.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.552+0000 7f44d3b47640 1 Processor -- start 2023-12-22T08:41:13.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d3b47640 1 -- start start 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d3b47640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f44cc0ba550 0x7f44cc0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d3b47640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba000 0x7f44cc1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d3b47640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44cc0bb310 con 0x7f44cc06a6d0 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d3b47640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44cc0bf960 con 0x7f44cc0ba550 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d3b47640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0bb5b0 con 0x7f44cc0ba000 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d10e2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f44cc0ba550 0x7f44cc0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d10e2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f44cc0ba550 0x7f44cc0b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39948/0 (socket says 172.21.15.31:39948) 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.553+0000 7f44d10e2640 1 -- 172.21.15.31:0/1015764279 learned_addr learned my addr 172.21.15.31:0/1015764279 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.554+0000 7f44d20e4640 1 --2- 172.21.15.31:0/1015764279 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba000 0x7f44cc1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.554+0000 7f44d10e2640 1 -- 172.21.15.31:0/1015764279 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba000 msgr2=0x7f44cc1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:13.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.554+0000 7f44d10e2640 1 --2- 172.21.15.31:0/1015764279 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba000 0x7f44cc1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.554+0000 7f44d10e2640 1 -- 172.21.15.31:0/1015764279 >> v1:172.21.15.69:6789/0 conn(0x7f44cc06a6d0 legacy=0x7f44cc14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:13.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.554+0000 7f44d10e2640 1 -- 172.21.15.31:0/1015764279 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc0c0120 con 0x7f44cc0ba550 2023-12-22T08:41:13.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.554+0000 7f44d10e2640 1 --2- 172.21.15.31:0/1015764279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc0ba550 0x7f44cc0b9ac0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009870 tx=0x7f44bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999e329c5ba31fdb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d08e1640 1 -- 172.21.15.31:0/1015764279 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc030840 con 0x7f44cc0ba550 2023-12-22T08:41:13.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d08e1640 1 -- 172.21.15.31:0/1015764279 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc0309a0 con 0x7f44cc0ba550 2023-12-22T08:41:13.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d08e1640 1 -- 172.21.15.31:0/1015764279 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc030d30 con 0x7f44cc0ba550 2023-12-22T08:41:13.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d3b47640 1 -- 172.21.15.31:0/1015764279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc0ba550 msgr2=0x7f44cc0b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d3b47640 1 --2- 172.21.15.31:0/1015764279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc0ba550 0x7f44cc0b9ac0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009870 tx=0x7f44bc02b980 comp rx=0 tx=0).stop 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d3b47640 1 -- 172.21.15.31:0/1015764279 shutdown_connections 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d3b47640 1 --2- 172.21.15.31:0/1015764279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc0ba550 0x7f44cc0b9ac0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d3b47640 1 --2- 172.21.15.31:0/1015764279 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba000 0x7f44cc1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d3b47640 1 -- 172.21.15.31:0/1015764279 >> 172.21.15.31:0/1015764279 conn(0x7f44cc0c0350 msgr2=0x7f44cc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d3b47640 1 -- 172.21.15.31:0/1015764279 shutdown_connections 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.555+0000 7f44d3b47640 1 -- 172.21.15.31:0/1015764279 wait complete. 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.556+0000 7f44d3b47640 1 Processor -- start 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.556+0000 7f44d3b47640 1 -- start start 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d3b47640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc06a6d0 0x7f44cc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d3b47640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44cc0ba000 0x7f44cc0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d3b47640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba550 0x7f44cc1e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d3b47640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc14e930 con 0x7f44cc06a6d0 2023-12-22T08:41:13.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d3b47640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc099770 con 0x7f44cc0ba000 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d3b47640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc0b60a0 con 0x7f44cc0ba550 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc06a6d0 0x7f44cc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc06a6d0 0x7f44cc14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39964/0 (socket says 172.21.15.31:39964) 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 -- 172.21.15.31:0/2187777676 learned_addr learned my addr 172.21.15.31:0/2187777676 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d20e4640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba550 0x7f44cc1e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d10e2640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44cc0ba000 0x7f44cc0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 -- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba550 msgr2=0x7f44cc1e36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba550 0x7f44cc1e36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 -- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44cc0ba000 msgr2=0x7f44cc0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44cc0ba000 0x7f44cc0b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 -- 172.21.15.31:0/2187777676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0094d0 con 0x7f44cc06a6d0 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.557+0000 7f44d18e3640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc06a6d0 0x7f44cc14e3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c480 tx=0x7f44c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.558+0000 7f44c27fc640 1 -- 172.21.15.31:0/2187777676 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c40052d0 con 0x7f44cc06a6d0 2023-12-22T08:41:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.558+0000 7f44c27fc640 1 -- 172.21.15.31:0/2187777676 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c4005430 con 0x7f44cc06a6d0 2023-12-22T08:41:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.558+0000 7f44c27fc640 1 -- 172.21.15.31:0/2187777676 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4012870 con 0x7f44cc06a6d0 2023-12-22T08:41:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.558+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc09a180 con 0x7f44cc06a6d0 2023-12-22T08:41:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.558+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc099980 con 0x7f44cc06a6d0 2023-12-22T08:41:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.559+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44cc073a40 con 0x7f44cc06a6d0 2023-12-22T08:41:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.559+0000 7f44c27fc640 1 -- 172.21.15.31:0/2187777676 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f44c40129d0 con 0x7f44cc06a6d0 2023-12-22T08:41:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.560+0000 7f44c27fc640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f44b006a430 0x7f44b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.560+0000 7f44c27fc640 1 -- 172.21.15.31:0/2187777676 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44c40883a0 con 0x7f44cc06a6d0 2023-12-22T08:41:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.560+0000 7f44d10e2640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f44b006a430 0x7f44b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.560+0000 7f44d10e2640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f44b006a430 0x7f44b006c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44bc036000 tx=0x7f44bc03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.564+0000 7f44c27fc640 1 -- 172.21.15.31:0/2187777676 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f44c4053a20 con 0x7f44cc06a6d0 2023-12-22T08:41:13.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.740+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44cc0a62d0 con 0x7f44cc06a6d0 2023-12-22T08:41:13.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.741+0000 7f44c27fc640 1 -- 172.21.15.31:0/2187777676 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f44c4057040 con 0x7f44cc06a6d0 2023-12-22T08:41:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:13.746 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:13.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f44b006a430 msgr2=0x7f44b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f44b006a430 0x7f44b006c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44bc036000 tx=0x7f44bc03b040 comp rx=0 tx=0).stop 2023-12-22T08:41:13.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc06a6d0 msgr2=0x7f44cc14e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc06a6d0 0x7f44cc14e3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c480 tx=0x7f44c400c940 comp rx=0 tx=0).stop 2023-12-22T08:41:13.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 shutdown_connections 2023-12-22T08:41:13.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f44b006a430 0x7f44b006c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f44cc0ba550 0x7f44cc1e36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44cc0ba000 0x7f44cc0b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 --2- 172.21.15.31:0/2187777676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44cc06a6d0 0x7f44cc14e3f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 >> 172.21.15.31:0/2187777676 conn(0x7f44cc0c0350 msgr2=0x7f44cc0c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:13.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 shutdown_connections 2023-12-22T08:41:13.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.743+0000 7f44d3b47640 1 -- 172.21.15.31:0/2187777676 wait complete. 2023-12-22T08:41:13.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:40:44.006324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:40:44.843421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:13.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:13.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.864+0000 7fd0f2038640 1 Processor -- start 2023-12-22T08:41:13.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.864+0000 7fd0f2038640 1 -- start start 2023-12-22T08:41:13.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0f2038640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec071150 0x7fd0ec0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0f2038640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd0ec071880 0x7fd0ec1489f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0f2038640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec0b5fd0 con 0x7fd0ec148f30 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0f2038640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0b6200 con 0x7fd0ec071880 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0f2038640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0b8020 con 0x7fd0ec071150 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0ebfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd0ec148f30 0x7fd0ec0b4a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41768/0 (socket says 172.21.15.31:41768) 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0ebfff640 1 -- 172.21.15.31:0/4192030620 learned_addr learned my addr 172.21.15.31:0/4192030620 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0eb7fe640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec071150 0x7fd0ec0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0eaffd640 1 --2- 172.21.15.31:0/4192030620 >> v2:172.21.15.69:3300/0 conn(0x7fd0ec071880 0x7fd0ec1489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679846034 0 0) 0x7fd0ec0b5fd0 con 0x7fd0ec148f30 2023-12-22T08:41:13.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.865+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0d4003520 con 0x7fd0ec148f30 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1451785176 0 0) 0x7fd0d4003520 con 0x7fd0ec148f30 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec071150 msgr2=0x7fd0ec0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec071150 0x7fd0ec0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 >> v2:172.21.15.69:3300/0 conn(0x7fd0ec071880 msgr2=0x7fd0ec1489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 --2- 172.21.15.31:0/4192030620 >> v2:172.21.15.69:3300/0 conn(0x7fd0ec071880 0x7fd0ec1489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0b76c0 con 0x7fd0ec148f30 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7fd0e40019f0 con 0x7fd0ec148f30 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 >> v1:172.21.15.31:6789/0 conn(0x7fd0ec148f30 legacy=0x7fd0ec0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec071150 0x7fd0d4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d4003ef0 0x7fd0d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4004d00 0x7fd0d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0b6200 con 0x7fd0d4003ef0 2023-12-22T08:41:13.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0b8020 con 0x7fd0d4004d00 2023-12-22T08:41:13.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d400b9b0 con 0x7fd0ec071150 2023-12-22T08:41:13.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0eaffd640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d4003ef0 0x7fd0d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0eb7fe640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec071150 0x7fd0d4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0ebfff640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4004d00 0x7fd0d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0eaffd640 1 -- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec071150 msgr2=0x7fd0d4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:13.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0eaffd640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec071150 0x7fd0d4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0eaffd640 1 -- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4004d00 msgr2=0x7fd0d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:13.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0eaffd640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4004d00 0x7fd0d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.866+0000 7fd0eaffd640 1 -- 172.21.15.31:0/4192030620 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4003520 con 0x7fd0d4003ef0 2023-12-22T08:41:13.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.867+0000 7fd0eaffd640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d4003ef0 0x7fd0d40047c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009ac0 tx=0x7fd0d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a6ed148b93ea5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.867+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e002c710 con 0x7fd0d4003ef0 2023-12-22T08:41:13.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.867+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e002c870 con 0x7fd0d4003ef0 2023-12-22T08:41:13.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.867+0000 7fd0ea7fc640 1 -- 172.21.15.31:0/4192030620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e002cc00 con 0x7fd0d4003ef0 2023-12-22T08:41:13.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.868+0000 7fd0f2038640 1 -- 172.21.15.31:0/4192030620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d4003ef0 msgr2=0x7fd0d40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.868+0000 7fd0f2038640 1 --2- 172.21.15.31:0/4192030620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d4003ef0 0x7fd0d40047c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009ac0 tx=0x7fd0d40057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.868+0000 7fd0ebfff640 1 -- 172.21.15.31:0/4192030620 reap_dead start 2023-12-22T08:41:13.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.868+0000 7fd0f2038640 1 -- 172.21.15.31:0/4192030620 shutdown_connections 2023-12-22T08:41:13.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.868+0000 7fd0f2038640 1 -- 172.21.15.31:0/4192030620 >> 172.21.15.31:0/4192030620 conn(0x7fd0ec0be1d0 msgr2=0x7fd0ec0be5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:13.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.868+0000 7fd0f2038640 1 -- 172.21.15.31:0/4192030620 shutdown_connections 2023-12-22T08:41:13.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.868+0000 7fd0f2038640 1 -- 172.21.15.31:0/4192030620 wait complete. 2023-12-22T08:41:13.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.869+0000 7fd0f2038640 1 Processor -- start 2023-12-22T08:41:13.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.869+0000 7fd0f2038640 1 -- start start 2023-12-22T08:41:13.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0f2038640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4003ef0 0x7fd0ec1436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0f2038640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec144880 0x7fd0ec1458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0f2038640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145de0 0x7fd0ec0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0f2038640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec143c10 con 0x7fd0ec145de0 2023-12-22T08:41:13.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0f2038640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec1451b0 con 0x7fd0d4003ef0 2023-12-22T08:41:13.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0f2038640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec146270 con 0x7fd0ec144880 2023-12-22T08:41:13.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145de0 0x7fd0ec0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145de0 0x7fd0ec0b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39980/0 (socket says 172.21.15.31:39980) 2023-12-22T08:41:13.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 -- 172.21.15.31:0/2548761900 learned_addr learned my addr 172.21.15.31:0/2548761900 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:13.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0eaffd640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec144880 0x7fd0ec1458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0eb7fe640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4003ef0 0x7fd0ec1436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 -- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec144880 msgr2=0x7fd0ec1458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec144880 0x7fd0ec1458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 -- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4003ef0 msgr2=0x7fd0ec1436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:13.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4003ef0 0x7fd0ec1436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:13.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 -- 172.21.15.31:0/2548761900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec1e4250 con 0x7fd0ec145de0 2023-12-22T08:41:13.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0ebfff640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145de0 0x7fd0ec0b4940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0b7f20 tx=0x7fd0e4007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0d3fff640 1 -- 172.21.15.31:0/2548761900 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e400ab10 con 0x7fd0ec145de0 2023-12-22T08:41:13.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0d3fff640 1 -- 172.21.15.31:0/2548761900 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e400ac70 con 0x7fd0ec145de0 2023-12-22T08:41:13.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec1453c0 con 0x7fd0ec145de0 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0d3fff640 1 -- 172.21.15.31:0/2548761900 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40133f0 con 0x7fd0ec145de0 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.870+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec1e3c90 con 0x7fd0ec145de0 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.871+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec0b7c20 con 0x7fd0ec145de0 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.872+0000 7fd0d3fff640 1 -- 172.21.15.31:0/2548761900 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd0e4013550 con 0x7fd0ec145de0 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.872+0000 7fd0d3fff640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a430 0x7fd0d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.872+0000 7fd0d3fff640 1 -- 172.21.15.31:0/2548761900 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0e4088f90 con 0x7fd0ec145de0 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.872+0000 7fd0eb7fe640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a430 0x7fd0d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.873+0000 7fd0eb7fe640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a430 0x7fd0d806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009a60 tx=0x7fd0dc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:13.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:13.876+0000 7fd0d3fff640 1 -- 172.21.15.31:0/2548761900 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0ec0b7c20 con 0x7fd0ec145de0 2023-12-22T08:41:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.050+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0ec0b7c20 con 0x7fd0ec145de0 2023-12-22T08:41:14.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.051+0000 7fd0d3fff640 1 -- 172.21.15.31:0/2548761900 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0ec0b7c20 con 0x7fd0ec145de0 2023-12-22T08:41:14.053 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a430 msgr2=0x7fd0d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a430 0x7fd0d806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009a60 tx=0x7fd0dc009190 comp rx=0 tx=0).stop 2023-12-22T08:41:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145de0 msgr2=0x7fd0ec0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145de0 0x7fd0ec0b4940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0b7f20 tx=0x7fd0e4007b10 comp rx=0 tx=0).stop 2023-12-22T08:41:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 shutdown_connections 2023-12-22T08:41:14.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd0d806a430 0x7fd0d806c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0ec145de0 0x7fd0ec0b4940 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0ec144880 0x7fd0ec1458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 --2- 172.21.15.31:0/2548761900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0d4003ef0 0x7fd0ec1436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 >> 172.21.15.31:0/2548761900 conn(0x7fd0ec0be1d0 msgr2=0x7fd0ec0bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 shutdown_connections 2023-12-22T08:41:14.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.053+0000 7fd0f2038640 1 -- 172.21.15.31:0/2548761900 wait complete. 2023-12-22T08:41:14.066 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:14.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.171+0000 7f17972db640 1 Processor -- start 2023-12-22T08:41:14.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.171+0000 7f17972db640 1 -- start start 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f17972db640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f179006ccc0 0x7f17900b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f17972db640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f17901337f0 0x7f1790144990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f17972db640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 0x7f179014b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f17972db640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17900b2860 con 0x7f179006ccc0 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f17972db640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17900b2ba0 con 0x7f17901337f0 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f17972db640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17900b18b0 con 0x7f1790144ed0 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1795077640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f179006ccc0 0x7f17900b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1795077640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f179006ccc0 0x7f17900b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39994/0 (socket says 172.21.15.31:39994) 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1795077640 1 -- 172.21.15.31:0/1838098377 learned_addr learned my addr 172.21.15.31:0/1838098377 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1795878640 1 --2- 172.21.15.31:0/1838098377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 0x7f179014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1794876640 1 --2- 172.21.15.31:0/1838098377 >> v2:172.21.15.69:3300/0 conn(0x7f17901337f0 0x7f1790144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1795077640 1 -- 172.21.15.31:0/1838098377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 msgr2=0x7f179014b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:14.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1795077640 1 --2- 172.21.15.31:0/1838098377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 0x7f179014b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1795077640 1 -- 172.21.15.31:0/1838098377 >> v2:172.21.15.69:3300/0 conn(0x7f17901337f0 msgr2=0x7f1790144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:14.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.172+0000 7f1795077640 1 --2- 172.21.15.31:0/1838098377 >> v2:172.21.15.69:3300/0 conn(0x7f17901337f0 0x7f1790144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.173+0000 7f1795077640 1 -- 172.21.15.31:0/1838098377 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17900b1d70 con 0x7f179006ccc0 2023-12-22T08:41:14.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.173+0000 7f1794876640 1 --2- 172.21.15.31:0/1838098377 >> v2:172.21.15.69:3300/0 conn(0x7f17901337f0 0x7f1790144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:14.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.173+0000 7f1795077640 1 --2- 172.21.15.31:0/1838098377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179006ccc0 0x7f17900b1370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f179006b8d0 tx=0x7f178002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b161f2e2659ce01d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.173+0000 7f178ffff640 1 -- 172.21.15.31:0/1838098377 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178002c9e0 con 0x7f179006ccc0 2023-12-22T08:41:14.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.173+0000 7f178ffff640 1 -- 172.21.15.31:0/1838098377 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178002cb40 con 0x7f179006ccc0 2023-12-22T08:41:14.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.173+0000 7f178ffff640 1 -- 172.21.15.31:0/1838098377 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17800343f0 con 0x7f179006ccc0 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 -- 172.21.15.31:0/1838098377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179006ccc0 msgr2=0x7f17900b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 --2- 172.21.15.31:0/1838098377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179006ccc0 0x7f17900b1370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f179006b8d0 tx=0x7f178002be40 comp rx=0 tx=0).stop 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 -- 172.21.15.31:0/1838098377 shutdown_connections 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 --2- 172.21.15.31:0/1838098377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 0x7f179014b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 --2- 172.21.15.31:0/1838098377 >> v2:172.21.15.69:3300/0 conn(0x7f17901337f0 0x7f1790144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 --2- 172.21.15.31:0/1838098377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179006ccc0 0x7f17900b1370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 -- 172.21.15.31:0/1838098377 >> 172.21.15.31:0/1838098377 conn(0x7f17900bca80 msgr2=0x7f17900b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 -- 172.21.15.31:0/1838098377 shutdown_connections 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.174+0000 7f17972db640 1 -- 172.21.15.31:0/1838098377 wait complete. 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.175+0000 7f17972db640 1 Processor -- start 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.175+0000 7f17972db640 1 -- start start 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f17972db640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f179006ccc0 0x7f17900b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f17972db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17901337f0 0x7f17900b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f17972db640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 0x7f17901e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f17972db640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17900b49b0 con 0x7f17901337f0 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f17972db640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17900b3c30 con 0x7f179006ccc0 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f17972db640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17900a15f0 con 0x7f1790144ed0 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17901337f0 0x7f17900b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17901337f0 0x7f17900b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40010/0 (socket says 172.21.15.31:40010) 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 -- 172.21.15.31:0/919481930 learned_addr learned my addr 172.21.15.31:0/919481930 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1795878640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 0x7f17901e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1795077640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f179006ccc0 0x7f17900b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 -- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 msgr2=0x7f17901e36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 0x7f17901e36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 -- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f179006ccc0 msgr2=0x7f17900b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f179006ccc0 0x7f17900b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 -- 172.21.15.31:0/919481930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780009b30 con 0x7f17901337f0 2023-12-22T08:41:14.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1795077640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f179006ccc0 0x7f17900b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:14.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.176+0000 7f1794876640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17901337f0 0x7f17900b78d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f178400e7e0 tx=0x7f178400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.177+0000 7f178dffb640 1 -- 172.21.15.31:0/919481930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784004030 con 0x7f17901337f0 2023-12-22T08:41:14.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.177+0000 7f178dffb640 1 -- 172.21.15.31:0/919481930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1784004190 con 0x7f17901337f0 2023-12-22T08:41:14.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.177+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17900b38c0 con 0x7f17901337f0 2023-12-22T08:41:14.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.177+0000 7f178dffb640 1 -- 172.21.15.31:0/919481930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784004520 con 0x7f17901337f0 2023-12-22T08:41:14.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.177+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179009faa0 con 0x7f17901337f0 2023-12-22T08:41:14.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.178+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1790073a40 con 0x7f17901337f0 2023-12-22T08:41:14.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.178+0000 7f178dffb640 1 -- 172.21.15.31:0/919481930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f178400c6d0 con 0x7f17901337f0 2023-12-22T08:41:14.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.179+0000 7f178dffb640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f177c06a430 0x7f177c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.179+0000 7f178dffb640 1 -- 172.21.15.31:0/919481930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1784088470 con 0x7f17901337f0 2023-12-22T08:41:14.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.179+0000 7f1795077640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f177c06a430 0x7f177c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.179+0000 7f1795077640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f177c06a430 0x7f177c06c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1780035000 tx=0x7f1780030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.183+0000 7f178dffb640 1 -- 172.21.15.31:0/919481930 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1784053ba0 con 0x7f17901337f0 2023-12-22T08:41:14.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.357+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17900a17b0 con 0x7f17901337f0 2023-12-22T08:41:14.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.358+0000 7f178dffb640 1 -- 172.21.15.31:0/919481930 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17840571c0 con 0x7f17901337f0 2023-12-22T08:41:14.360 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f177c06a430 msgr2=0x7f177c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f177c06a430 0x7f177c06c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1780035000 tx=0x7f1780030000 comp rx=0 tx=0).stop 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17901337f0 msgr2=0x7f17900b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17901337f0 0x7f17900b78d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f178400e7e0 tx=0x7f178400eca0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 shutdown_connections 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f177c06a430 0x7f177c06c8f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1790144ed0 0x7f17901e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17901337f0 0x7f17900b78d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 --2- 172.21.15.31:0/919481930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f179006ccc0 0x7f17900b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 >> 172.21.15.31:0/919481930 conn(0x7f17900bca80 msgr2=0x7f17901498e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 shutdown_connections 2023-12-22T08:41:14.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.360+0000 7f17972db640 1 -- 172.21.15.31:0/919481930 wait complete. 2023-12-22T08:41:14.373 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:14.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.479+0000 7fee26aa1640 1 Processor -- start 2023-12-22T08:41:14.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.479+0000 7fee26aa1640 1 -- start start 2023-12-22T08:41:14.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee26aa1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fee20144d80 0x7fee200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee26aa1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2014ab10 con 0x7fee200b77d0 2023-12-22T08:41:14.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee26aa1640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2006c2f0 con 0x7fee200b8690 2023-12-22T08:41:14.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee26aa1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200ba620 con 0x7fee20144d80 2023-12-22T08:41:14.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee2503e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fee200b77d0 0x7fee2014afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41782/0 (socket says 172.21.15.31:41782) 2023-12-22T08:41:14.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee2503e640 1 -- 172.21.15.31:0/3170580550 learned_addr learned my addr 172.21.15.31:0/3170580550 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:14.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee1ffff640 1 --2- 172.21.15.31:0/3170580550 >> v2:172.21.15.69:3300/0 conn(0x7fee20144d80 0x7fee200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654751001 0 0) 0x7fee2014ab10 con 0x7fee200b77d0 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.480+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee0c003520 con 0x7fee200b77d0 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083105882 0 0) 0x7fee0c003520 con 0x7fee200b77d0 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 >> v2:172.21.15.69:3300/0 conn(0x7fee20144d80 msgr2=0x7fee200b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 --2- 172.21.15.31:0/3170580550 >> v2:172.21.15.69:3300/0 conn(0x7fee20144d80 0x7fee200b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 >> v1:172.21.15.69:6789/0 conn(0x7fee200b8690 legacy=0x7fee20144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200b9e60 con 0x7fee200b77d0 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7fee08001670 con 0x7fee200b77d0 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 >> v1:172.21.15.31:6789/0 conn(0x7fee200b77d0 legacy=0x7fee2014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c003970 0x7fee0c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee0c004370 0x7fee0c004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee0c0050e0 0x7fee0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200ba620 con 0x7fee0c0050e0 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c00c020 con 0x7fee0c003970 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c00c1e0 con 0x7fee0c004370 2023-12-22T08:41:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee2483d640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c003970 0x7fee0c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee2503e640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee0c0050e0 0x7fee0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee1ffff640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee0c004370 0x7fee0c004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee2503e640 1 -- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee0c004370 msgr2=0x7fee0c004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee2503e640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee0c004370 0x7fee0c004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee2503e640 1 -- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c003970 msgr2=0x7fee0c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee2503e640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c003970 0x7fee0c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee2503e640 1 -- 172.21.15.31:0/3170580550 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c003520 con 0x7fee0c0050e0 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.481+0000 7fee2483d640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c003970 0x7fee0c003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.482+0000 7fee2503e640 1 -- 172.21.15.31:0/3170580550 reap_dead start 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.482+0000 7fee2503e640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee0c0050e0 0x7fee0c00b980 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee200b91d0 tx=0x7fee0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14690e65a8f9fc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.482+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08005ad0 con 0x7fee0c0050e0 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.482+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08005c50 con 0x7fee0c0050e0 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.482+0000 7fee1f7fe640 1 -- 172.21.15.31:0/3170580550 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0802c890 con 0x7fee0c0050e0 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.483+0000 7fee26aa1640 1 -- 172.21.15.31:0/3170580550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee0c0050e0 msgr2=0x7fee0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.483+0000 7fee26aa1640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee0c0050e0 0x7fee0c00b980 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee200b91d0 tx=0x7fee0c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.483+0000 7fee26aa1640 1 -- 172.21.15.31:0/3170580550 shutdown_connections 2023-12-22T08:41:14.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.483+0000 7fee26aa1640 1 --2- 172.21.15.31:0/3170580550 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee0c0050e0 0x7fee0c00b980 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.483+0000 7fee26aa1640 1 -- 172.21.15.31:0/3170580550 >> 172.21.15.31:0/3170580550 conn(0x7fee2006b6a0 msgr2=0x7fee2006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.483+0000 7fee26aa1640 1 -- 172.21.15.31:0/3170580550 shutdown_connections 2023-12-22T08:41:14.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.483+0000 7fee26aa1640 1 -- 172.21.15.31:0/3170580550 wait complete. 2023-12-22T08:41:14.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.484+0000 7fee26aa1640 1 Processor -- start 2023-12-22T08:41:14.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.484+0000 7fee26aa1640 1 -- start start 2023-12-22T08:41:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.484+0000 7fee26aa1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c0050e0 0x7fee20140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.484+0000 7fee26aa1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee200be200 0x7fee200be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.484+0000 7fee26aa1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee20136b90 0x7fee20137010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.484+0000 7fee26aa1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2013f520 con 0x7fee200be200 2023-12-22T08:41:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.484+0000 7fee26aa1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee20140e80 con 0x7fee0c0050e0 2023-12-22T08:41:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.484+0000 7fee26aa1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2013f1b0 con 0x7fee20136b90 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee200be200 0x7fee200be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee200be200 0x7fee200be680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40028/0 (socket says 172.21.15.31:40028) 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 -- 172.21.15.31:0/965468160 learned_addr learned my addr 172.21.15.31:0/965468160 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee2503e640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee20136b90 0x7fee20137010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 -- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee20136b90 msgr2=0x7fee20137010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee20136b90 0x7fee20137010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee2483d640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c0050e0 0x7fee20140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 -- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c0050e0 msgr2=0x7fee20140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c0050e0 0x7fee20140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 -- 172.21.15.31:0/965468160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200bebc0 con 0x7fee200be200 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1ffff640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee200be200 0x7fee200be680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fee10011940 tx=0x7fee10011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1d7fa640 1 -- 172.21.15.31:0/965468160 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1000faf0 con 0x7fee200be200 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1d7fa640 1 -- 172.21.15.31:0/965468160 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000fc50 con 0x7fee200be200 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee20141060 con 0x7fee200be200 2023-12-22T08:41:14.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee1d7fa640 1 -- 172.21.15.31:0/965468160 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10014440 con 0x7fee200be200 2023-12-22T08:41:14.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.485+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee20137550 con 0x7fee200be200 2023-12-22T08:41:14.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.486+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2013f660 con 0x7fee200be200 2023-12-22T08:41:14.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.487+0000 7fee1d7fa640 1 -- 172.21.15.31:0/965468160 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee100145a0 con 0x7fee200be200 2023-12-22T08:41:14.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.487+0000 7fee1d7fa640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee0006a430 0x7fee0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.487+0000 7fee1d7fa640 1 -- 172.21.15.31:0/965468160 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee100890b0 con 0x7fee200be200 2023-12-22T08:41:14.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.487+0000 7fee2483d640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee0006a430 0x7fee0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.488+0000 7fee2483d640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee0006a430 0x7fee0006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fee180020e0 tx=0x7fee18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.491+0000 7fee1d7fa640 1 -- 172.21.15.31:0/965468160 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee2013f660 con 0x7fee200be200 2023-12-22T08:41:14.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.667+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee2013f660 con 0x7fee200be200 2023-12-22T08:41:14.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.667+0000 7fee1d7fa640 1 -- 172.21.15.31:0/965468160 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee2013f660 con 0x7fee200be200 2023-12-22T08:41:14.670 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee0006a430 msgr2=0x7fee0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee0006a430 0x7fee0006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fee180020e0 tx=0x7fee18009040 comp rx=0 tx=0).stop 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee200be200 msgr2=0x7fee200be680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee200be200 0x7fee200be680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fee10011940 tx=0x7fee10011e00 comp rx=0 tx=0).stop 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 shutdown_connections 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee0006a430 0x7fee0006c8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee20136b90 0x7fee20137010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee200be200 0x7fee200be680 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 --2- 172.21.15.31:0/965468160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee0c0050e0 0x7fee20140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 >> 172.21.15.31:0/965468160 conn(0x7fee2006b6a0 msgr2=0x7fee200b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 shutdown_connections 2023-12-22T08:41:14.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.669+0000 7fee26aa1640 1 -- 172.21.15.31:0/965468160 wait complete. 2023-12-22T08:41:14.682 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:14.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.785+0000 7f76b4038640 1 Processor -- start 2023-12-22T08:41:14.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b4038640 1 -- start start 2023-12-22T08:41:14.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b4038640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac06a6d0 0x7f76ac14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b4038640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f76ac0ba550 0x7f76ac1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b4038640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ac0bb310 con 0x7f76ac14b1f0 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b4038640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ac0bf960 con 0x7f76ac0ba550 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b4038640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac0bb5b0 con 0x7f76ac06a6d0 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b15d3640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f76ac14b1f0 0x7f76ac0b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36340/0 (socket says 172.21.15.31:36340) 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b15d3640 1 -- 172.21.15.31:0/2221292814 learned_addr learned my addr 172.21.15.31:0/2221292814 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b1dd4640 1 --2- 172.21.15.31:0/2221292814 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac06a6d0 0x7f76ac14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.786+0000 7f76b25d5640 1 --2- 172.21.15.31:0/2221292814 >> v2:172.21.15.69:3300/0 conn(0x7f76ac0ba550 0x7f76ac1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.787+0000 7f76b0dd2640 1 -- 172.21.15.31:0/2221292814 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555699246 0 0) 0x7f76ac0bb310 con 0x7f76ac14b1f0 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.787+0000 7f76b0dd2640 1 -- 172.21.15.31:0/2221292814 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7694003520 con 0x7f76ac14b1f0 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.787+0000 7f76b25d5640 1 -- 172.21.15.31:0/2221292814 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac06a6d0 msgr2=0x7f76ac14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.787+0000 7f76b25d5640 1 --2- 172.21.15.31:0/2221292814 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac06a6d0 0x7f76ac14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.787+0000 7f76b25d5640 1 -- 172.21.15.31:0/2221292814 >> v1:172.21.15.31:6789/0 conn(0x7f76ac14b1f0 legacy=0x7f76ac0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.787+0000 7f76b0dd2640 1 -- 172.21.15.31:0/2221292814 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 899892054 0 0) 0x7f7694003520 con 0x7f76ac14b1f0 2023-12-22T08:41:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.787+0000 7f76b25d5640 1 -- 172.21.15.31:0/2221292814 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0c0120 con 0x7f76ac0ba550 2023-12-22T08:41:14.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b25d5640 1 --2- 172.21.15.31:0/2221292814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac0ba550 0x7f76ac1554e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097a0 tx=0x7f76a402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7714ef08229b2f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b0dd2640 1 -- 172.21.15.31:0/2221292814 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0001670 con 0x7f76ac0ba550 2023-12-22T08:41:14.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b0dd2640 1 -- 172.21.15.31:0/2221292814 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a402e050 con 0x7f76ac0ba550 2023-12-22T08:41:14.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b0dd2640 1 -- 172.21.15.31:0/2221292814 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4030730 con 0x7f76ac0ba550 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b4038640 1 -- 172.21.15.31:0/2221292814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac0ba550 msgr2=0x7f76ac1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b4038640 1 --2- 172.21.15.31:0/2221292814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac0ba550 0x7f76ac1554e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097a0 tx=0x7f76a402b790 comp rx=0 tx=0).stop 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b4038640 1 -- 172.21.15.31:0/2221292814 shutdown_connections 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b4038640 1 --2- 172.21.15.31:0/2221292814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac0ba550 0x7f76ac1554e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b4038640 1 --2- 172.21.15.31:0/2221292814 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac06a6d0 0x7f76ac14acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b4038640 1 -- 172.21.15.31:0/2221292814 >> 172.21.15.31:0/2221292814 conn(0x7f76ac0c0350 msgr2=0x7f76ac0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b4038640 1 -- 172.21.15.31:0/2221292814 shutdown_connections 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.788+0000 7f76b4038640 1 -- 172.21.15.31:0/2221292814 wait complete. 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.789+0000 7f76b4038640 1 Processor -- start 2023-12-22T08:41:14.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b4038640 1 -- start start 2023-12-22T08:41:14.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b4038640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac06a6d0 0x7f76ac0a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b4038640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76ac0ba550 0x7f76ac1e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b4038640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac14b1f0 0x7f76ac09a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b4038640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac0a5cb0 con 0x7f76ac0ba550 2023-12-22T08:41:14.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b4038640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac099e50 con 0x7f76ac06a6d0 2023-12-22T08:41:14.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b4038640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac146ec0 con 0x7f76ac14b1f0 2023-12-22T08:41:14.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b15d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76ac0ba550 0x7f76ac1e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b15d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76ac0ba550 0x7f76ac1e3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54254/0 (socket says 172.21.15.31:54254) 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b15d3640 1 -- 172.21.15.31:0/4033726085 learned_addr learned my addr 172.21.15.31:0/4033726085 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b1dd4640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac06a6d0 0x7f76ac0a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.790+0000 7f76b25d5640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac14b1f0 0x7f76ac09a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b15d3640 1 -- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac14b1f0 msgr2=0x7f76ac09a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b15d3640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac14b1f0 0x7f76ac09a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b15d3640 1 -- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac06a6d0 msgr2=0x7f76ac0a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b15d3640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac06a6d0 0x7f76ac0a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b15d3640 1 -- 172.21.15.31:0/4033726085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009400 con 0x7f76ac0ba550 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b1dd4640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac06a6d0 0x7f76ac0a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b15d3640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76ac0ba550 0x7f76ac1e3c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c750 tx=0x7f76a000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76aa7fc640 1 -- 172.21.15.31:0/4033726085 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0005ad0 con 0x7f76ac0ba550 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76aa7fc640 1 -- 172.21.15.31:0/4033726085 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a0005c30 con 0x7f76ac0ba550 2023-12-22T08:41:14.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac09a320 con 0x7f76ac0ba550 2023-12-22T08:41:14.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76aa7fc640 1 -- 172.21.15.31:0/4033726085 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0007070 con 0x7f76ac0ba550 2023-12-22T08:41:14.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.791+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac1e3480 con 0x7f76ac0ba550 2023-12-22T08:41:14.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.792+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac073a40 con 0x7f76ac0ba550 2023-12-22T08:41:14.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.792+0000 7f76aa7fc640 1 -- 172.21.15.31:0/4033726085 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76a00071d0 con 0x7f76ac0ba550 2023-12-22T08:41:14.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.793+0000 7f76aa7fc640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f769806a430 0x7f769806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:14.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.793+0000 7f76aa7fc640 1 -- 172.21.15.31:0/4033726085 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76a0088620 con 0x7f76ac0ba550 2023-12-22T08:41:14.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.793+0000 7f76b1dd4640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f769806a430 0x7f769806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:14.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.794+0000 7f76b1dd4640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f769806a430 0x7f769806c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f769c0074c0 tx=0x7f769c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:14.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:14.797+0000 7f76aa7fc640 1 -- 172.21.15.31:0/4033726085 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f76a0053c20 con 0x7f76ac0ba550 2023-12-22T08:41:15.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.010+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76ac0a62d0 con 0x7f76ac0ba550 2023-12-22T08:41:15.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.010+0000 7f76aa7fc640 1 -- 172.21.15.31:0/4033726085 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f76a0057240 con 0x7f76ac0ba550 2023-12-22T08:41:15.013 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:15.013 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:40:45.862817+0000","modified":"2023-12-22T08:40:48.867080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:41:15.013 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2023-12-22T08:41:15.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f769806a430 msgr2=0x7f769806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f769806a430 0x7f769806c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f769c0074c0 tx=0x7f769c00b040 comp rx=0 tx=0).stop 2023-12-22T08:41:15.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76ac0ba550 msgr2=0x7f76ac1e3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76ac0ba550 0x7f76ac1e3c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c750 tx=0x7f76a000cc10 comp rx=0 tx=0).stop 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 shutdown_connections 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f769806a430 0x7f769806c8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f76ac14b1f0 0x7f76ac09a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76ac0ba550 0x7f76ac1e3c80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 --2- 172.21.15.31:0/4033726085 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f76ac06a6d0 0x7f76ac0a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 >> 172.21.15.31:0/4033726085 conn(0x7f76ac0c0350 msgr2=0x7f76ac0bea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 shutdown_connections 2023-12-22T08:41:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.012+0000 7f76b4038640 1 -- 172.21.15.31:0/4033726085 wait complete. 2023-12-22T08:41:15.025 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:15.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.128+0000 7f553434e640 1 Processor -- start 2023-12-22T08:41:15.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.128+0000 7f553434e640 1 -- start start 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f553434e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f552c0bfad0 0x7f552c148140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f553434e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f552c148680 0x7f552c14af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f553434e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c09fab0 con 0x7f552c14b450 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f553434e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0bae90 con 0x7f552c148680 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f553434e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0bb170 con 0x7f552c0bfad0 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55328eb640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f552c14b450 0x7f552c14e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36346/0 (socket says 172.21.15.31:36346) 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55318e9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f552c148680 0x7f552c14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55328eb640 1 -- 172.21.15.31:0/3158011967 learned_addr learned my addr 172.21.15.31:0/3158011967 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:15.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55320ea640 1 --2- 172.21.15.31:0/3158011967 >> v2:172.21.15.69:3300/0 conn(0x7f552c0bfad0 0x7f552c148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55318e9640 1 -- 172.21.15.31:0/3158011967 >> v2:172.21.15.69:3300/0 conn(0x7f552c0bfad0 msgr2=0x7f552c148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:15.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55318e9640 1 --2- 172.21.15.31:0/3158011967 >> v2:172.21.15.69:3300/0 conn(0x7f552c0bfad0 0x7f552c148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55318e9640 1 -- 172.21.15.31:0/3158011967 >> v1:172.21.15.31:6789/0 conn(0x7f552c14b450 legacy=0x7f552c14e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55318e9640 1 -- 172.21.15.31:0/3158011967 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0bb450 con 0x7f552c148680 2023-12-22T08:41:15.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.129+0000 7f55310e8640 1 -- 172.21.15.31:0/3158011967 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163587109 0 0) 0x7f552c09fab0 con 0x7f552c14b450 2023-12-22T08:41:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.130+0000 7f55318e9640 1 --2- 172.21.15.31:0/3158011967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c148680 0x7f552c14af10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f552c08a260 tx=0x7f552002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a1e3e5f06dfa01 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.130+0000 7f55310e8640 1 -- 172.21.15.31:0/3158011967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552002e070 con 0x7f552c148680 2023-12-22T08:41:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.130+0000 7f55310e8640 1 -- 172.21.15.31:0/3158011967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55200315a0 con 0x7f552c148680 2023-12-22T08:41:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.130+0000 7f55310e8640 1 -- 172.21.15.31:0/3158011967 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520031930 con 0x7f552c148680 2023-12-22T08:41:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.131+0000 7f553434e640 1 -- 172.21.15.31:0/3158011967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c148680 msgr2=0x7f552c14af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.131+0000 7f553434e640 1 --2- 172.21.15.31:0/3158011967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c148680 0x7f552c14af10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f552c08a260 tx=0x7f552002b840 comp rx=0 tx=0).stop 2023-12-22T08:41:15.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.131+0000 7f553434e640 1 -- 172.21.15.31:0/3158011967 shutdown_connections 2023-12-22T08:41:15.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.131+0000 7f553434e640 1 --2- 172.21.15.31:0/3158011967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c148680 0x7f552c14af10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.131+0000 7f553434e640 1 --2- 172.21.15.31:0/3158011967 >> v2:172.21.15.69:3300/0 conn(0x7f552c0bfad0 0x7f552c148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.131+0000 7f553434e640 1 -- 172.21.15.31:0/3158011967 >> 172.21.15.31:0/3158011967 conn(0x7f552c0c0370 msgr2=0x7f552c0c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:15.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.131+0000 7f553434e640 1 -- 172.21.15.31:0/3158011967 shutdown_connections 2023-12-22T08:41:15.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.131+0000 7f553434e640 1 -- 172.21.15.31:0/3158011967 wait complete. 2023-12-22T08:41:15.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.132+0000 7f553434e640 1 Processor -- start 2023-12-22T08:41:15.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.132+0000 7f553434e640 1 -- start start 2023-12-22T08:41:15.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f553434e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c0bfad0 0x7f552c14df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f553434e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f552c148680 0x7f552c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f553434e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f552c14b450 0x7f552c0a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f553434e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c14d530 con 0x7f552c0bfad0 2023-12-22T08:41:15.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f553434e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0a5b10 con 0x7f552c148680 2023-12-22T08:41:15.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f553434e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0b43f0 con 0x7f552c14b450 2023-12-22T08:41:15.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c0bfad0 0x7f552c14df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c0bfad0 0x7f552c14df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54280/0 (socket says 172.21.15.31:54280) 2023-12-22T08:41:15.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 -- 172.21.15.31:0/664850199 learned_addr learned my addr 172.21.15.31:0/664850199 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55318e9640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f552c148680 0x7f552c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55328eb640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f552c14b450 0x7f552c0a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 -- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f552c14b450 msgr2=0x7f552c0a55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f552c14b450 0x7f552c0a55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 -- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f552c148680 msgr2=0x7f552c14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f552c148680 0x7f552c14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 -- 172.21.15.31:0/664850199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520009400 con 0x7f552c0bfad0 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55318e9640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f552c148680 0x7f552c14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:15.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f55320ea640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c0bfad0 0x7f552c14df10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f552400d800 tx=0x7f552400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f552affd640 1 -- 172.21.15.31:0/664850199 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400b6c0 con 0x7f552c0bfad0 2023-12-22T08:41:15.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f552affd640 1 -- 172.21.15.31:0/664850199 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552400b820 con 0x7f552c0bfad0 2023-12-22T08:41:15.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c0b4040 con 0x7f552c0bfad0 2023-12-22T08:41:15.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f552affd640 1 -- 172.21.15.31:0/664850199 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400bbb0 con 0x7f552c0bfad0 2023-12-22T08:41:15.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.133+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c14d9f0 con 0x7f552c0bfad0 2023-12-22T08:41:15.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.134+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c14db80 con 0x7f552c0bfad0 2023-12-22T08:41:15.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.135+0000 7f552affd640 1 -- 172.21.15.31:0/664850199 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f552400bd10 con 0x7f552c0bfad0 2023-12-22T08:41:15.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.135+0000 7f552affd640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f551806a430 0x7f551806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.135+0000 7f552affd640 1 -- 172.21.15.31:0/664850199 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5524088dd0 con 0x7f552c0bfad0 2023-12-22T08:41:15.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.135+0000 7f55318e9640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f551806a430 0x7f551806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.136+0000 7f55318e9640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f551806a430 0x7f551806c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5520036000 tx=0x7f552003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.139+0000 7f552affd640 1 -- 172.21.15.31:0/664850199 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5524054450 con 0x7f552c0bfad0 2023-12-22T08:41:15.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.315+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f552c073a40 con 0x7f552c0bfad0 2023-12-22T08:41:15.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.316+0000 7f552affd640 1 -- 172.21.15.31:0/664850199 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f5524057a70 con 0x7f552c0bfad0 2023-12-22T08:41:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:15.319 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f551806a430 msgr2=0x7f551806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f551806a430 0x7f551806c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5520036000 tx=0x7f552003d040 comp rx=0 tx=0).stop 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c0bfad0 msgr2=0x7f552c14df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c0bfad0 0x7f552c14df10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f552400d800 tx=0x7f552400dcc0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 shutdown_connections 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f551806a430 0x7f551806c8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f552c14b450 0x7f552c0a55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f552c148680 0x7f552c14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 --2- 172.21.15.31:0/664850199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f552c0bfad0 0x7f552c14df10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 >> 172.21.15.31:0/664850199 conn(0x7f552c0c0370 msgr2=0x7f552c0a0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:15.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 shutdown_connections 2023-12-22T08:41:15.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.318+0000 7f553434e640 1 -- 172.21.15.31:0/664850199 wait complete. 2023-12-22T08:41:15.331 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:41:15.332 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:15.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc280851640 1 Processor -- start 2023-12-22T08:41:15.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc280851640 1 -- start start 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc280851640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc27c1544e0 0x7fc27c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc280851640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c0bb310 con 0x7fc27c0ba550 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc280851640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c0bf960 con 0x7fc27c06a6d0 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc280851640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c0bb5b0 con 0x7fc27c1544e0 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc27ad9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc27c1544e0 0x7fc27c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc273fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc27c0ba550 0x7fc27c0b9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36362/0 (socket says 172.21.15.31:36362) 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.435+0000 7fc273fff640 1 -- 172.21.15.31:0/2117155400 learned_addr learned my addr 172.21.15.31:0/2117155400 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.436+0000 7fc27ad9d640 1 -- 172.21.15.31:0/2117155400 >> v1:172.21.15.69:6789/0 conn(0x7fc27c06a6d0 legacy=0x7fc27c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.436+0000 7fc27ad9d640 1 -- 172.21.15.31:0/2117155400 >> v1:172.21.15.31:6789/0 conn(0x7fc27c0ba550 legacy=0x7fc27c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.436+0000 7fc27ad9d640 1 -- 172.21.15.31:0/2117155400 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c0c0120 con 0x7fc27c1544e0 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.436+0000 7fc27ad9d640 1 --2- 172.21.15.31:0/2117155400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c1544e0 0x7fc27c1568d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc274009d90 tx=0x7fc27402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2bc429340b11cb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc279d9b640 1 -- 172.21.15.31:0/2117155400 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27402cc60 con 0x7fc27c1544e0 2023-12-22T08:41:15.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc279d9b640 1 -- 172.21.15.31:0/2117155400 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27402cdc0 con 0x7fc27c1544e0 2023-12-22T08:41:15.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc279d9b640 1 -- 172.21.15.31:0/2117155400 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274034660 con 0x7fc27c1544e0 2023-12-22T08:41:15.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc280851640 1 -- 172.21.15.31:0/2117155400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c1544e0 msgr2=0x7fc27c1568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc280851640 1 --2- 172.21.15.31:0/2117155400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c1544e0 0x7fc27c1568d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc274009d90 tx=0x7fc27402beb0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc280851640 1 -- 172.21.15.31:0/2117155400 shutdown_connections 2023-12-22T08:41:15.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc280851640 1 --2- 172.21.15.31:0/2117155400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c1544e0 0x7fc27c1568d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc280851640 1 -- 172.21.15.31:0/2117155400 >> 172.21.15.31:0/2117155400 conn(0x7fc27c0c0350 msgr2=0x7fc27c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:15.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc280851640 1 -- 172.21.15.31:0/2117155400 shutdown_connections 2023-12-22T08:41:15.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.437+0000 7fc280851640 1 -- 172.21.15.31:0/2117155400 wait complete. 2023-12-22T08:41:15.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.438+0000 7fc280851640 1 Processor -- start 2023-12-22T08:41:15.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.438+0000 7fc280851640 1 -- start start 2023-12-22T08:41:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc280851640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c06a6d0 0x7fc27c1e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc280851640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc27c0ba550 0x7fc27c0a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc280851640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc27c1544e0 0x7fc27c0a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc280851640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c1e3aa0 con 0x7fc27c06a6d0 2023-12-22T08:41:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc280851640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0a5ad0 con 0x7fc27c1544e0 2023-12-22T08:41:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc280851640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0a3970 con 0x7fc27c0ba550 2023-12-22T08:41:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c06a6d0 0x7fc27c1e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c06a6d0 0x7fc27c1e3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54296/0 (socket says 172.21.15.31:54296) 2023-12-22T08:41:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27a59c640 1 -- 172.21.15.31:0/4052599036 learned_addr learned my addr 172.21.15.31:0/4052599036 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc273fff640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc27c0ba550 0x7fc27c0a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27ad9d640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc27c1544e0 0x7fc27c0a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27a59c640 1 -- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc27c0ba550 msgr2=0x7fc27c0a4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27a59c640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc27c0ba550 0x7fc27c0a4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27a59c640 1 -- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc27c1544e0 msgr2=0x7fc27c0a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27a59c640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc27c1544e0 0x7fc27c0a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27a59c640 1 -- 172.21.15.31:0/4052599036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274009a70 con 0x7fc27c06a6d0 2023-12-22T08:41:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.439+0000 7fc27ad9d640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc27c1544e0 0x7fc27c0a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.440+0000 7fc27a59c640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c06a6d0 0x7fc27c1e3560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c460 tx=0x7fc26c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.440+0000 7fc272ffd640 1 -- 172.21.15.31:0/4052599036 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c012830 con 0x7fc27c06a6d0 2023-12-22T08:41:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.440+0000 7fc272ffd640 1 -- 172.21.15.31:0/4052599036 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c0129d0 con 0x7fc27c06a6d0 2023-12-22T08:41:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.440+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c0a33b0 con 0x7fc27c06a6d0 2023-12-22T08:41:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.440+0000 7fc272ffd640 1 -- 172.21.15.31:0/4052599036 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c012d80 con 0x7fc27c06a6d0 2023-12-22T08:41:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.440+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c0b9430 con 0x7fc27c06a6d0 2023-12-22T08:41:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.441+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c073a40 con 0x7fc27c06a6d0 2023-12-22T08:41:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.441+0000 7fc272ffd640 1 -- 172.21.15.31:0/4052599036 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc26c01a3b0 con 0x7fc27c06a6d0 2023-12-22T08:41:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.442+0000 7fc272ffd640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc25c06a430 0x7fc25c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.442+0000 7fc272ffd640 1 -- 172.21.15.31:0/4052599036 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc26c088500 con 0x7fc27c06a6d0 2023-12-22T08:41:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.442+0000 7fc273fff640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc25c06a430 0x7fc25c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.442+0000 7fc273fff640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc25c06a430 0x7fc25c06c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0bff20 tx=0x7fc264009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.446+0000 7fc272ffd640 1 -- 172.21.15.31:0/4052599036 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc26c053b80 con 0x7fc27c06a6d0 2023-12-22T08:41:15.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.658+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc27c0a3db0 con 0x7fc27c06a6d0 2023-12-22T08:41:15.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.658+0000 7fc272ffd640 1 -- 172.21.15.31:0/4052599036 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7fc26c0571a0 con 0x7fc27c06a6d0 2023-12-22T08:41:15.661 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:15.661 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:40:45.862817+0000","modified":"2023-12-22T08:40:48.867080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:41:15.661 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2023-12-22T08:41:15.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc25c06a430 msgr2=0x7fc25c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc25c06a430 0x7fc25c06c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0bff20 tx=0x7fc264009040 comp rx=0 tx=0).stop 2023-12-22T08:41:15.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c06a6d0 msgr2=0x7fc27c1e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c06a6d0 0x7fc27c1e3560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00c460 tx=0x7fc26c00c920 comp rx=0 tx=0).stop 2023-12-22T08:41:15.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 shutdown_connections 2023-12-22T08:41:15.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc25c06a430 0x7fc25c06c8f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc27c1544e0 0x7fc27c0a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc27c0ba550 0x7fc27c0a4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.660+0000 7fc280851640 1 --2- 172.21.15.31:0/4052599036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc27c06a6d0 0x7fc27c1e3560 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.661+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 >> 172.21.15.31:0/4052599036 conn(0x7fc27c0c0350 msgr2=0x7fc27c0be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:15.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.661+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 shutdown_connections 2023-12-22T08:41:15.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.661+0000 7fc280851640 1 -- 172.21.15.31:0/4052599036 wait complete. 2023-12-22T08:41:15.674 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:15.728 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:15.731 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:15.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:15.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.777+0000 7f7dd768b640 1 Processor -- start 2023-12-22T08:41:15.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.777+0000 7f7dd768b640 1 -- start start 2023-12-22T08:41:15.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dd768b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7dd00b7ea0 0x7f7dd00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dd768b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd00b4230 con 0x7f7dd00b7130 2023-12-22T08:41:15.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dd768b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd00711c0 con 0x7f7dd00b8280 2023-12-22T08:41:15.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dd768b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd00714a0 con 0x7f7dd00b7ea0 2023-12-22T08:41:15.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dd4c26640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7dd00b7130 0x7f7dd0142910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36368/0 (socket says 172.21.15.31:36368) 2023-12-22T08:41:15.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dd4c26640 1 -- 172.21.15.31:0/3894448386 learned_addr learned my addr 172.21.15.31:0/3894448386 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:15.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dd5427640 1 --2- 172.21.15.31:0/3894448386 >> v2:172.21.15.69:3300/0 conn(0x7f7dd00b7ea0 0x7f7dd00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dc7fff640 1 -- 172.21.15.31:0/3894448386 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353737892 0 0) 0x7f7dd00b4230 con 0x7f7dd00b7130 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.778+0000 7f7dc7fff640 1 -- 172.21.15.31:0/3894448386 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dbc003520 con 0x7f7dd00b7130 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.779+0000 7f7dc7fff640 1 -- 172.21.15.31:0/3894448386 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23507825 0 0) 0x7f7dd00711c0 con 0x7f7dd00b8280 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.779+0000 7f7dc7fff640 1 -- 172.21.15.31:0/3894448386 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd00b4230 con 0x7f7dd00b8280 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.779+0000 7f7dc7fff640 1 -- 172.21.15.31:0/3894448386 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 936961614 0 0) 0x7f7dbc003520 con 0x7f7dd00b7130 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.779+0000 7f7dd5427640 1 -- 172.21.15.31:0/3894448386 >> v1:172.21.15.69:6789/0 conn(0x7f7dd00b8280 legacy=0x7f7dd00b89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.779+0000 7f7dd5427640 1 -- 172.21.15.31:0/3894448386 >> v1:172.21.15.31:6789/0 conn(0x7f7dd00b7130 legacy=0x7f7dd0142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.779+0000 7f7dd5427640 1 -- 172.21.15.31:0/3894448386 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0071780 con 0x7f7dd00b7ea0 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.779+0000 7f7dd5427640 1 --2- 172.21.15.31:0/3894448386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7ea0 0x7f7dd00b6bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0097a0 tx=0x7f7dcc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca5d02501726eea server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dc7fff640 1 -- 172.21.15.31:0/3894448386 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0001670 con 0x7f7dd00b7ea0 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dc7fff640 1 -- 172.21.15.31:0/3894448386 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc031590 con 0x7f7dd00b7ea0 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dc7fff640 1 -- 172.21.15.31:0/3894448386 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc031920 con 0x7f7dd00b7ea0 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dd768b640 1 -- 172.21.15.31:0/3894448386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7ea0 msgr2=0x7f7dd00b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dd768b640 1 --2- 172.21.15.31:0/3894448386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7ea0 0x7f7dd00b6bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0097a0 tx=0x7f7dcc02b8b0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dd768b640 1 -- 172.21.15.31:0/3894448386 shutdown_connections 2023-12-22T08:41:15.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dd768b640 1 --2- 172.21.15.31:0/3894448386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7ea0 0x7f7dd00b6bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dd768b640 1 -- 172.21.15.31:0/3894448386 >> 172.21.15.31:0/3894448386 conn(0x7f7dd00bd060 msgr2=0x7f7dd00bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:15.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dd768b640 1 -- 172.21.15.31:0/3894448386 shutdown_connections 2023-12-22T08:41:15.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.780+0000 7f7dd768b640 1 -- 172.21.15.31:0/3894448386 wait complete. 2023-12-22T08:41:15.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.782+0000 7f7dd768b640 1 Processor -- start 2023-12-22T08:41:15.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.782+0000 7f7dd768b640 1 -- start start 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.782+0000 7f7dd768b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7130 0x7f7dd01d1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.782+0000 7f7dd768b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7dd00b7ea0 0x7f7dd01e0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.782+0000 7f7dd768b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd00b8280 0x7f7dd01e1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.782+0000 7f7dd768b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd01d4750 con 0x7f7dd00b8280 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.782+0000 7f7dd768b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd01d1e00 con 0x7f7dd00b7130 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.782+0000 7f7dd768b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd01dde30 con 0x7f7dd00b7ea0 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd00b8280 0x7f7dd01e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd00b8280 0x7f7dd01e1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54304/0 (socket says 172.21.15.31:54304) 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 -- 172.21.15.31:0/303605441 learned_addr learned my addr 172.21.15.31:0/303605441 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5427640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7130 0x7f7dd01d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd4c26640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7dd00b7ea0 0x7f7dd01e0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 -- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7dd00b7ea0 msgr2=0x7f7dd01e0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7dd00b7ea0 0x7f7dd01e0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 -- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7130 msgr2=0x7f7dd01d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7130 0x7f7dd01d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 -- 172.21.15.31:0/303605441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc009400 con 0x7f7dd00b8280 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd4c26640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7dd00b7ea0 0x7f7dd01e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd5c28640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd00b8280 0x7f7dd01e1340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800c6e0 tx=0x7f7dc800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dc5ffb640 1 -- 172.21.15.31:0/303605441 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8003b70 con 0x7f7dd00b8280 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dc5ffb640 1 -- 172.21.15.31:0/303605441 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8003cd0 con 0x7f7dd00b8280 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd01de110 con 0x7f7dd00b8280 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dc5ffb640 1 -- 172.21.15.31:0/303605441 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80052d0 con 0x7f7dd00b8280 2023-12-22T08:41:15.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.783+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd01d1ab0 con 0x7f7dd00b8280 2023-12-22T08:41:15.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.784+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd01de630 con 0x7f7dd00b8280 2023-12-22T08:41:15.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.785+0000 7f7dc5ffb640 1 -- 172.21.15.31:0/303605441 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7dc8005430 con 0x7f7dd00b8280 2023-12-22T08:41:15.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.785+0000 7f7dc5ffb640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7db406a460 0x7f7db406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:15.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.785+0000 7f7dc5ffb640 1 -- 172.21.15.31:0/303605441 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc8088730 con 0x7f7dd00b8280 2023-12-22T08:41:15.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.785+0000 7f7dd5427640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7db406a460 0x7f7db406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:15.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.786+0000 7f7dd5427640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7db406a460 0x7f7db406c920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc036000 tx=0x7f7dcc03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:15.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:15.789+0000 7f7dc5ffb640 1 -- 172.21.15.31:0/303605441 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7dd01de630 con 0x7f7dd00b8280 2023-12-22T08:41:16.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.000+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dd01de630 con 0x7f7dd00b8280 2023-12-22T08:41:16.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.001+0000 7f7dc5ffb640 1 -- 172.21.15.31:0/303605441 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f7dd01de630 con 0x7f7dd00b8280 2023-12-22T08:41:16.004 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:16.004 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/800532638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":800532638},{"type":"v1","addr":"172.21.15.69:6835","nonce":800532638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3037217296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3037217296},{"type":"v1","addr":"172.21.15.31:6834","nonce":3037217296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:40:45.862817+0000","modified":"2023-12-22T08:40:48.867080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1404772098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1404772098},{"type":"v1","addr":"172.21.15.31:6835","nonce":1404772098}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-22T08:41:16.004 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2023-12-22T08:41:16.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7db406a460 msgr2=0x7f7db406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7db406a460 0x7f7db406c920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc036000 tx=0x7f7dcc03d040 comp rx=0 tx=0).stop 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd00b8280 msgr2=0x7f7dd01e1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd00b8280 0x7f7dd01e1340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800c6e0 tx=0x7f7dc800cba0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 shutdown_connections 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7db406a460 0x7f7db406c920 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dd00b8280 0x7f7dd01e1340 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7dd00b7ea0 0x7f7dd01e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 --2- 172.21.15.31:0/303605441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dd00b7130 0x7f7dd01d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 >> 172.21.15.31:0/303605441 conn(0x7f7dd00bd060 msgr2=0x7f7dd00bb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 shutdown_connections 2023-12-22T08:41:16.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.003+0000 7f7dd768b640 1 -- 172.21.15.31:0/303605441 wait complete. 2023-12-22T08:41:16.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:16.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.159+0000 7fdcd430a640 1 Processor -- start 2023-12-22T08:41:16.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.159+0000 7fdcd430a640 1 -- start start 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd430a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdccc0ba550 0x7fdccc0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd430a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0bb310 con 0x7fdccc06a6d0 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd430a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0bf960 con 0x7fdccc0ba000 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd430a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc0bb5b0 con 0x7fdccc0ba550 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd18a5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdccc0ba550 0x7fdccc0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd20a6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdccc06a6d0 0x7fdccc14acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36378/0 (socket says 172.21.15.31:36378) 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd20a6640 1 -- 172.21.15.31:0/2231311083 learned_addr learned my addr 172.21.15.31:0/2231311083 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd18a5640 1 -- 172.21.15.31:0/2231311083 >> v1:172.21.15.69:6789/0 conn(0x7fdccc0ba000 legacy=0x7fdccc1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd18a5640 1 -- 172.21.15.31:0/2231311083 >> v1:172.21.15.31:6789/0 conn(0x7fdccc06a6d0 legacy=0x7fdccc14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.160+0000 7fdcd18a5640 1 -- 172.21.15.31:0/2231311083 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0c0120 con 0x7fdccc0ba550 2023-12-22T08:41:16.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.161+0000 7fdcd18a5640 1 --2- 172.21.15.31:0/2231311083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc0ba550 0x7fdccc0b9ac0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00097a0 tx=0x7fdcc002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00f1e86810057c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.161+0000 7fdcd10a4640 1 -- 172.21.15.31:0/2231311083 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0030610 con 0x7fdccc0ba550 2023-12-22T08:41:16.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.161+0000 7fdcd10a4640 1 -- 172.21.15.31:0/2231311083 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc0030770 con 0x7fdccc0ba550 2023-12-22T08:41:16.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.161+0000 7fdcd10a4640 1 -- 172.21.15.31:0/2231311083 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0030b00 con 0x7fdccc0ba550 2023-12-22T08:41:16.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.162+0000 7fdcd430a640 1 -- 172.21.15.31:0/2231311083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc0ba550 msgr2=0x7fdccc0b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.162+0000 7fdcd430a640 1 --2- 172.21.15.31:0/2231311083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc0ba550 0x7fdccc0b9ac0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00097a0 tx=0x7fdcc002b960 comp rx=0 tx=0).stop 2023-12-22T08:41:16.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.162+0000 7fdcd430a640 1 -- 172.21.15.31:0/2231311083 shutdown_connections 2023-12-22T08:41:16.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.162+0000 7fdcd430a640 1 --2- 172.21.15.31:0/2231311083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc0ba550 0x7fdccc0b9ac0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.162+0000 7fdcd430a640 1 -- 172.21.15.31:0/2231311083 >> 172.21.15.31:0/2231311083 conn(0x7fdccc0c0350 msgr2=0x7fdccc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:16.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.162+0000 7fdcd430a640 1 -- 172.21.15.31:0/2231311083 shutdown_connections 2023-12-22T08:41:16.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.162+0000 7fdcd430a640 1 -- 172.21.15.31:0/2231311083 wait complete. 2023-12-22T08:41:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.163+0000 7fdcd430a640 1 Processor -- start 2023-12-22T08:41:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.163+0000 7fdcd430a640 1 -- start start 2023-12-22T08:41:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.163+0000 7fdcd430a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc06a6d0 0x7fdccc14e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.163+0000 7fdcd430a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdccc0ba000 0x7fdccc0b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.163+0000 7fdcd430a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdccc0ba550 0x7fdccc1e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.163+0000 7fdcd430a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc14eed0 con 0x7fdccc06a6d0 2023-12-22T08:41:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.163+0000 7fdcd430a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc1d4320 con 0x7fdccc0ba000 2023-12-22T08:41:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.163+0000 7fdcd430a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b6d30 con 0x7fdccc0ba550 2023-12-22T08:41:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc06a6d0 0x7fdccc14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc06a6d0 0x7fdccc14e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54334/0 (socket says 172.21.15.31:54334) 2023-12-22T08:41:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 -- 172.21.15.31:0/3169481823 learned_addr learned my addr 172.21.15.31:0/3169481823 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd18a5640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdccc0ba000 0x7fdccc0b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd28a7640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdccc0ba550 0x7fdccc1e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 -- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdccc0ba550 msgr2=0x7fdccc1e3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdccc0ba550 0x7fdccc1e3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 -- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdccc0ba000 msgr2=0x7fdccc0b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdccc0ba000 0x7fdccc0b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 -- 172.21.15.31:0/3169481823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc0009400 con 0x7fdccc06a6d0 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd28a7640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdccc0ba550 0x7fdccc1e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd20a6640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc06a6d0 0x7fdccc14e990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c4a0 tx=0x7fdcc400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdccaffd640 1 -- 172.21.15.31:0/3169481823 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4005ce0 con 0x7fdccc06a6d0 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdccaffd640 1 -- 172.21.15.31:0/3169481823 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4005e40 con 0x7fdccc06a6d0 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc0b6fc0 con 0x7fdccc06a6d0 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdccaffd640 1 -- 172.21.15.31:0/3169481823 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4007270 con 0x7fdccc06a6d0 2023-12-22T08:41:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.164+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc1d4060 con 0x7fdccc06a6d0 2023-12-22T08:41:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.165+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc073a40 con 0x7fdccc06a6d0 2023-12-22T08:41:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.166+0000 7fdccaffd640 1 -- 172.21.15.31:0/3169481823 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdcc4007490 con 0x7fdccc06a6d0 2023-12-22T08:41:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.166+0000 7fdccaffd640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcb806a430 0x7fdcb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.166+0000 7fdccaffd640 1 -- 172.21.15.31:0/3169481823 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcc4087d40 con 0x7fdccc06a6d0 2023-12-22T08:41:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.166+0000 7fdcd18a5640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcb806a430 0x7fdcb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.167+0000 7fdcd18a5640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcb806a430 0x7fdcb806c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0036000 tx=0x7fdcc003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.170+0000 7fdccaffd640 1 -- 172.21.15.31:0/3169481823 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdcc4053470 con 0x7fdccc06a6d0 2023-12-22T08:41:16.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.345+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdccc14b390 con 0x7fdccc06a6d0 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.346+0000 7fdccaffd640 1 -- 172.21.15.31:0/3169481823 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fdcc4017090 con 0x7fdccc06a6d0 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:16.349 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:40:46.864135+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:40:44.006324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-22T08:40:44.843421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:16.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.348+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcb806a430 msgr2=0x7fdcb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.348+0000 7fdcd430a640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcb806a430 0x7fdcb806c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0036000 tx=0x7fdcc003b040 comp rx=0 tx=0).stop 2023-12-22T08:41:16.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.348+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc06a6d0 msgr2=0x7fdccc14e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.348+0000 7fdcd430a640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc06a6d0 0x7fdccc14e990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c4a0 tx=0x7fdcc400c960 comp rx=0 tx=0).stop 2023-12-22T08:41:16.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.349+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 shutdown_connections 2023-12-22T08:41:16.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.349+0000 7fdcd430a640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdcb806a430 0x7fdcb806c8f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.349+0000 7fdcd430a640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdccc0ba550 0x7fdccc1e3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.349+0000 7fdcd430a640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdccc0ba000 0x7fdccc0b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.349+0000 7fdcd430a640 1 --2- 172.21.15.31:0/3169481823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdccc06a6d0 0x7fdccc14e990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.349+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 >> 172.21.15.31:0/3169481823 conn(0x7fdccc0c0350 msgr2=0x7fdccc09fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.349+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 shutdown_connections 2023-12-22T08:41:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.349+0000 7fdcd430a640 1 -- 172.21.15.31:0/3169481823 wait complete. 2023-12-22T08:41:16.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T08:41:16.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.466+0000 7fe5a6881640 1 Processor -- start 2023-12-22T08:41:16.469 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.466+0000 7fe5a6881640 1 -- start start 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe5a6881640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5a00b9350 0x7fe5a00b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe5a6881640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe5a014bef0 0x7fe5a00b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe5a6881640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a0143120 con 0x7fe5a00b3890 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe5a6881640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00b4e40 con 0x7fe5a00b9350 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe5a6881640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00b4050 con 0x7fe5a014bef0 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe59ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5a00b9350 0x7fe5a00b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe59ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5a00b9350 0x7fe5a00b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54336/0 (socket says 172.21.15.31:54336) 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe59ffff640 1 -- 172.21.15.31:0/1663474441 learned_addr learned my addr 172.21.15.31:0/1663474441 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe59f7fe640 1 --2- 172.21.15.31:0/1663474441 >> v2:172.21.15.69:3300/0 conn(0x7fe5a014bef0 0x7fe5a00b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe59ffff640 1 -- 172.21.15.31:0/1663474441 >> v2:172.21.15.69:3300/0 conn(0x7fe5a014bef0 msgr2=0x7fe5a00b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe59ffff640 1 --2- 172.21.15.31:0/1663474441 >> v2:172.21.15.69:3300/0 conn(0x7fe5a014bef0 0x7fe5a00b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe59ffff640 1 -- 172.21.15.31:0/1663474441 >> v1:172.21.15.69:6789/0 conn(0x7fe5a00b3890 legacy=0x7fe5a00b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.467+0000 7fe59ffff640 1 -- 172.21.15.31:0/1663474441 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a014c360 con 0x7fe5a00b9350 2023-12-22T08:41:16.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.468+0000 7fe59ffff640 1 --2- 172.21.15.31:0/1663474441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b9350 0x7fe5a00b5f50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00b8340 tx=0x7fe59402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3892ee678bd72c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.468+0000 7fe59effd640 1 -- 172.21.15.31:0/1663474441 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594030860 con 0x7fe5a00b9350 2023-12-22T08:41:16.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.468+0000 7fe59effd640 1 -- 172.21.15.31:0/1663474441 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5940309c0 con 0x7fe5a00b9350 2023-12-22T08:41:16.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.468+0000 7fe59effd640 1 -- 172.21.15.31:0/1663474441 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594030d50 con 0x7fe5a00b9350 2023-12-22T08:41:16.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.469+0000 7fe5a6881640 1 -- 172.21.15.31:0/1663474441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b9350 msgr2=0x7fe5a00b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.469+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1663474441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b9350 0x7fe5a00b5f50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00b8340 tx=0x7fe59402b9a0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.469+0000 7fe5a6881640 1 -- 172.21.15.31:0/1663474441 shutdown_connections 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.469+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1663474441 >> v2:172.21.15.69:3300/0 conn(0x7fe5a014bef0 0x7fe5a00b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.469+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1663474441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b9350 0x7fe5a00b5f50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.469+0000 7fe5a6881640 1 -- 172.21.15.31:0/1663474441 >> 172.21.15.31:0/1663474441 conn(0x7fe5a00bc560 msgr2=0x7fe5a00b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.469+0000 7fe5a6881640 1 -- 172.21.15.31:0/1663474441 shutdown_connections 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.469+0000 7fe5a6881640 1 -- 172.21.15.31:0/1663474441 wait complete. 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.470+0000 7fe5a6881640 1 Processor -- start 2023-12-22T08:41:16.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.470+0000 7fe5a6881640 1 -- start start 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe5a6881640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b3890 0x7fe5a0146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe5a6881640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe5a00b9350 0x7fe5a013dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe5a6881640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5a014bef0 0x7fe5a0144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe5a6881640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a01e1dc0 con 0x7fe5a00b3890 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe5a6881640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a013e020 con 0x7fe5a014bef0 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe5a6881640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a01e12c0 con 0x7fe5a00b9350 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b3890 0x7fe5a0146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b3890 0x7fe5a0146a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54344/0 (socket says 172.21.15.31:54344) 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 -- 172.21.15.31:0/1333432640 learned_addr learned my addr 172.21.15.31:0/1333432640 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe5a4e1e640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5a014bef0 0x7fe5a0144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59f7fe640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe5a00b9350 0x7fe5a013dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 -- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe5a00b9350 msgr2=0x7fe5a013dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe5a00b9350 0x7fe5a013dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 -- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5a014bef0 msgr2=0x7fe5a0144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5a014bef0 0x7fe5a0144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 -- 172.21.15.31:0/1333432640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940094d0 con 0x7fe5a00b3890 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.471+0000 7fe59ffff640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b3890 0x7fe5a0146a10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe59402b9e0 tx=0x7fe594004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.472+0000 7fe59cff9640 1 -- 172.21.15.31:0/1333432640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594039c90 con 0x7fe5a00b3890 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.472+0000 7fe59cff9640 1 -- 172.21.15.31:0/1333432640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594039e10 con 0x7fe5a00b3890 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.472+0000 7fe59cff9640 1 -- 172.21.15.31:0/1333432640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594043640 con 0x7fe5a00b3890 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.472+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a0147120 con 0x7fe5a00b3890 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.472+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a01e1800 con 0x7fe5a00b3890 2023-12-22T08:41:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.472+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a0066630 con 0x7fe5a00b3890 2023-12-22T08:41:16.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.473+0000 7fe59cff9640 1 -- 172.21.15.31:0/1333432640 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe5940437a0 con 0x7fe5a00b3890 2023-12-22T08:41:16.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.473+0000 7fe59cff9640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe58c06a4b0 0x7fe58c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.473+0000 7fe59cff9640 1 -- 172.21.15.31:0/1333432640 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe59403e070 con 0x7fe5a00b3890 2023-12-22T08:41:16.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.473+0000 7fe59f7fe640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe58c06a4b0 0x7fe58c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.474+0000 7fe59f7fe640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe58c06a4b0 0x7fe58c06c970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0146460 tx=0x7fe590009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.478+0000 7fe59cff9640 1 -- 172.21.15.31:0/1333432640 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe594076f70 con 0x7fe5a00b3890 2023-12-22T08:41:16.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.691+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe5a0073a40 con 0x7fe5a00b3890 2023-12-22T08:41:16.694 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-12-22T08:41:16.692+0000 7ff944aa9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T08:41:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.697+0000 7fe59cff9640 1 -- 172.21.15.31:0/1333432640 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe59407a590 con 0x7fe5a00b3890 2023-12-22T08:41:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T08:41:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.699+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe58c06a4b0 msgr2=0x7fe58c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.699+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe58c06a4b0 0x7fe58c06c970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0146460 tx=0x7fe590009190 comp rx=0 tx=0).stop 2023-12-22T08:41:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.699+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b3890 msgr2=0x7fe5a0146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.699+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b3890 0x7fe5a0146a10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe59402b9e0 tx=0x7fe594004730 comp rx=0 tx=0).stop 2023-12-22T08:41:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.700+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 shutdown_connections 2023-12-22T08:41:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.700+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe58c06a4b0 0x7fe58c06c970 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.700+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5a014bef0 0x7fe5a0144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.700+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe5a00b9350 0x7fe5a013dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.700+0000 7fe5a6881640 1 --2- 172.21.15.31:0/1333432640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a00b3890 0x7fe5a0146a10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.700+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 >> 172.21.15.31:0/1333432640 conn(0x7fe5a00bc560 msgr2=0x7fe5a00b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.700+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 shutdown_connections 2023-12-22T08:41:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.700+0000 7fe5a6881640 1 -- 172.21.15.31:0/1333432640 wait complete. 2023-12-22T08:41:16.703 INFO:tasks.ceph.mds.a.smithi031.stderr: -4850> 2023-12-22T08:40:46.538+0000 7ff5b3bc6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:41:16.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T08:41:16.732 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-12-22T08:41:16.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.819+0000 7f73cbf8b640 1 Processor -- start 2023-12-22T08:41:16.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.819+0000 7f73cbf8b640 1 -- start start 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73cbf8b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f73c40b8040 0x7f73c40bc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73cbf8b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c414ac30 con 0x7f73c4144dd0 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73cbf8b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c40b9370 con 0x7f73c414b0c0 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73cbf8b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c40c0f30 con 0x7f73c40b8040 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c9d27640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f73c4144dd0 0x7f73c40b8c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36390/0 (socket says 172.21.15.31:36390) 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c9d27640 1 -- 172.21.15.31:0/1101975213 learned_addr learned my addr 172.21.15.31:0/1101975213 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c9526640 1 --2- 172.21.15.31:0/1101975213 >> v2:172.21.15.69:3300/0 conn(0x7f73c40b8040 0x7f73c40bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c8d25640 1 -- 172.21.15.31:0/1101975213 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634005111 0 0) 0x7f73c414ac30 con 0x7f73c4144dd0 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c8d25640 1 -- 172.21.15.31:0/1101975213 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b0003520 con 0x7f73c4144dd0 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c9526640 1 -- 172.21.15.31:0/1101975213 >> v1:172.21.15.69:6789/0 conn(0x7f73c414b0c0 legacy=0x7f73c4155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c8d25640 1 -- 172.21.15.31:0/1101975213 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604317710 0 0) 0x7f73c40b9370 con 0x7f73c414b0c0 2023-12-22T08:41:16.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c9526640 1 -- 172.21.15.31:0/1101975213 >> v1:172.21.15.31:6789/0 conn(0x7f73c4144dd0 legacy=0x7f73c40b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.820+0000 7f73c9526640 1 -- 172.21.15.31:0/1101975213 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40b77d0 con 0x7f73c40b8040 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.821+0000 7f73c9526640 1 --2- 172.21.15.31:0/1101975213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 0x7f73c40bc700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f73b40097a0 tx=0x7f73b402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e94c9747a1a40ca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.821+0000 7f73c8d25640 1 -- 172.21.15.31:0/1101975213 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4031830 con 0x7f73c40b8040 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.821+0000 7f73c8d25640 1 -- 172.21.15.31:0/1101975213 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b4031990 con 0x7f73c40b8040 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.821+0000 7f73c8d25640 1 -- 172.21.15.31:0/1101975213 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4031d20 con 0x7f73c40b8040 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.822+0000 7f73cbf8b640 1 -- 172.21.15.31:0/1101975213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 msgr2=0x7f73c40bc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.822+0000 7f73cbf8b640 1 --2- 172.21.15.31:0/1101975213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 0x7f73c40bc700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f73b40097a0 tx=0x7f73b402b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.822+0000 7f73cbf8b640 1 -- 172.21.15.31:0/1101975213 shutdown_connections 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.822+0000 7f73cbf8b640 1 --2- 172.21.15.31:0/1101975213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 0x7f73c40bc700 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.822+0000 7f73cbf8b640 1 -- 172.21.15.31:0/1101975213 >> 172.21.15.31:0/1101975213 conn(0x7f73c40c03d0 msgr2=0x7f73c40c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:16.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.822+0000 7f73cbf8b640 1 -- 172.21.15.31:0/1101975213 shutdown_connections 2023-12-22T08:41:16.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.822+0000 7f73cbf8b640 1 -- 172.21.15.31:0/1101975213 wait complete. 2023-12-22T08:41:16.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73cbf8b640 1 Processor -- start 2023-12-22T08:41:16.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73cbf8b640 1 -- start start 2023-12-22T08:41:16.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73cbf8b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 0x7f73c41e28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73cbf8b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f73c4144dd0 0x7f73c40b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73cbf8b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73c414b0c0 0x7f73c40b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73cbf8b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c414c440 con 0x7f73c414b0c0 2023-12-22T08:41:16.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73cbf8b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c4147f60 con 0x7f73c40b8040 2023-12-22T08:41:16.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73cbf8b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c414bc50 con 0x7f73c4144dd0 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.823+0000 7f73ca528640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73c414b0c0 0x7f73c40b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ca528640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73c414b0c0 0x7f73c40b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54354/0 (socket says 172.21.15.31:54354) 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ca528640 1 -- 172.21.15.31:0/673777609 learned_addr learned my addr 172.21.15.31:0/673777609 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73c9d27640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 0x7f73c41e28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73c9526640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f73c4144dd0 0x7f73c40b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ca528640 1 -- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f73c4144dd0 msgr2=0x7f73c40b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ca528640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f73c4144dd0 0x7f73c40b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ca528640 1 -- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 msgr2=0x7f73c41e28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ca528640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 0x7f73c41e28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ca528640 1 -- 172.21.15.31:0/673777609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4009400 con 0x7f73c414b0c0 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ca528640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73c414b0c0 0x7f73c40b5cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f73bc001560 tx=0x7f73bc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ba7fc640 1 -- 172.21.15.31:0/673777609 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc003da0 con 0x7f73c414b0c0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ba7fc640 1 -- 172.21.15.31:0/673777609 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc005070 con 0x7f73c414b0c0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c4148200 con 0x7f73c414b0c0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73ba7fc640 1 -- 172.21.15.31:0/673777609 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc005420 con 0x7f73c414b0c0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.824+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c41e2e10 con 0x7f73c414b0c0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.825+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c4073a40 con 0x7f73c414b0c0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.826+0000 7f73ba7fc640 1 -- 172.21.15.31:0/673777609 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f73bc005580 con 0x7f73c414b0c0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.826+0000 7f73ba7fc640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f73a806a430 0x7f73a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.826+0000 7f73ba7fc640 1 -- 172.21.15.31:0/673777609 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f73bc088170 con 0x7f73c414b0c0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.826+0000 7f73c9d27640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f73a806a430 0x7f73a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:16.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.827+0000 7f73c9d27640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f73a806a430 0x7f73a806c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73c0005880 tx=0x7f73c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:16.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:16.830+0000 7f73ba7fc640 1 -- 172.21.15.31:0/673777609 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f73bc0537b0 con 0x7f73c414b0c0 2023-12-22T08:41:17.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.044+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f73c41464d0 con 0x7f73c414b0c0 2023-12-22T08:41:17.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.699+0000 7f73ba7fc640 1 -- 172.21.15.31:0/673777609 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f73bc056dd0 con 0x7f73c414b0c0 2023-12-22T08:41:17.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f73a806a430 msgr2=0x7f73a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f73a806a430 0x7f73a806c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73c0005880 tx=0x7f73c0009040 comp rx=0 tx=0).stop 2023-12-22T08:41:17.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73c414b0c0 msgr2=0x7f73c40b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73c414b0c0 0x7f73c40b5cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f73bc001560 tx=0x7f73bc00cc70 comp rx=0 tx=0).stop 2023-12-22T08:41:17.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 shutdown_connections 2023-12-22T08:41:17.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f73a806a430 0x7f73a806c8f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73c414b0c0 0x7f73c40b5cc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f73c4144dd0 0x7f73c40b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 --2- 172.21.15.31:0/673777609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73c40b8040 0x7f73c41e28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.702+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 >> 172.21.15.31:0/673777609 conn(0x7f73c40c03d0 msgr2=0x7f73c41443d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:17.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.703+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 shutdown_connections 2023-12-22T08:41:17.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.703+0000 7f73cbf8b640 1 -- 172.21.15.31:0/673777609 wait complete. 2023-12-22T08:41:17.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T08:41:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.874+0000 7f4d51eec640 1 Processor -- start 2023-12-22T08:41:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.874+0000 7f4d51eec640 1 -- start start 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.874+0000 7f4d51eec640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.874+0000 7f4d51eec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d4c06cae0 0x7f4d4c147e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.874+0000 7f4d51eec640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d4c1483d0 0x7f4d4c14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.874+0000 7f4d51eec640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c147a00 con 0x7f4d4c06cae0 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.874+0000 7f4d51eec640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c1420b0 con 0x7f4d4c1483d0 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.874+0000 7f4d51eec640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c071cb0 con 0x7f4d4c141cd0 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4affd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d4c06cae0 0x7f4d4c147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4b7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4bfff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d4c1483d0 0x7f4d4c14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4b7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c06c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:53918/0 (socket says 172.21.15.31:53918) 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4b7fe640 1 -- 172.21.15.31:0/2465471718 learned_addr learned my addr 172.21.15.31:0/2465471718 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4bfff640 1 -- 172.21.15.31:0/2465471718 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 msgr2=0x7f4d4c06c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4bfff640 1 --2- 172.21.15.31:0/2465471718 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c06c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4bfff640 1 -- 172.21.15.31:0/2465471718 >> v2:172.21.15.31:3300/0 conn(0x7f4d4c06cae0 msgr2=0x7f4d4c147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:17.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4bfff640 1 --2- 172.21.15.31:0/2465471718 >> v2:172.21.15.31:3300/0 conn(0x7f4d4c06cae0 0x7f4d4c147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4bfff640 1 -- 172.21.15.31:0/2465471718 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0b8100 con 0x7f4d4c1483d0 2023-12-22T08:41:17.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.875+0000 7f4d4affd640 1 --2- 172.21.15.31:0/2465471718 >> v2:172.21.15.31:3300/0 conn(0x7f4d4c06cae0 0x7f4d4c147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:17.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.876+0000 7f4d4bfff640 1 --2- 172.21.15.31:0/2465471718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c14ae70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c071bd0 tx=0x7f4d4402bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1944f72998a481f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.876+0000 7f4d4a7fc640 1 -- 172.21.15.31:0/2465471718 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4402cb40 con 0x7f4d4c1483d0 2023-12-22T08:41:17.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.876+0000 7f4d4a7fc640 1 -- 172.21.15.31:0/2465471718 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4402cca0 con 0x7f4d4c1483d0 2023-12-22T08:41:17.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.876+0000 7f4d4a7fc640 1 -- 172.21.15.31:0/2465471718 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44034660 con 0x7f4d4c1483d0 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 -- 172.21.15.31:0/2465471718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c1483d0 msgr2=0x7f4d4c14ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2465471718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c14ae70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c071bd0 tx=0x7f4d4402bd90 comp rx=0 tx=0).stop 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 -- 172.21.15.31:0/2465471718 shutdown_connections 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2465471718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c14ae70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2465471718 >> v2:172.21.15.31:3300/0 conn(0x7f4d4c06cae0 0x7f4d4c147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2465471718 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c06c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 -- 172.21.15.31:0/2465471718 >> 172.21.15.31:0/2465471718 conn(0x7f4d4c0b8a00 msgr2=0x7f4d4c0b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 -- 172.21.15.31:0/2465471718 shutdown_connections 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.877+0000 7f4d51eec640 1 -- 172.21.15.31:0/2465471718 wait complete. 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.878+0000 7f4d51eec640 1 Processor -- start 2023-12-22T08:41:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.878+0000 7f4d51eec640 1 -- start start 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d51eec640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cae0 0x7f4d4c0bb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d51eec640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c13bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d51eec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d51eec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c147750 con 0x7f4d4c1483d0 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d51eec640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c145910 con 0x7f4d4c06cae0 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d51eec640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c13df40 con 0x7f4d4c141cd0 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c1463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54370/0 (socket says 172.21.15.31:54370) 2023-12-22T08:41:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 -- 172.21.15.31:0/2697787310 learned_addr learned my addr 172.21.15.31:0/2697787310 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4affd640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c13bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4b7fe640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cae0 0x7f4d4c0bb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 -- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 msgr2=0x7f4d4c13bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c13bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 -- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cae0 msgr2=0x7f4d4c0bb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cae0 0x7f4d4c0bb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 -- 172.21.15.31:0/2697787310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40009400 con 0x7f4d4c1483d0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d4bfff640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c1463c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009e80 tx=0x7f4d44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.879+0000 7f4d33fff640 1 -- 172.21.15.31:0/2697787310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44040650 con 0x7f4d4c1483d0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.880+0000 7f4d33fff640 1 -- 172.21.15.31:0/2697787310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d440407b0 con 0x7f4d4c1483d0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.880+0000 7f4d33fff640 1 -- 172.21.15.31:0/2697787310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44040b60 con 0x7f4d4c1483d0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.880+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d44009a70 con 0x7f4d4c1483d0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.880+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c147470 con 0x7f4d4c1483d0 2023-12-22T08:41:17.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.881+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c145770 con 0x7f4d4c1483d0 2023-12-22T08:41:17.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.881+0000 7f4d33fff640 1 -- 172.21.15.31:0/2697787310 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d44040cc0 con 0x7f4d4c1483d0 2023-12-22T08:41:17.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.882+0000 7f4d33fff640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4d3806a430 0x7f4d3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:17.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.882+0000 7f4d33fff640 1 -- 172.21.15.31:0/2697787310 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4d440ab4b0 con 0x7f4d4c1483d0 2023-12-22T08:41:17.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.882+0000 7f4d4b7fe640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4d3806a430 0x7f4d3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:17.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.882+0000 7f4d4b7fe640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4d3806a430 0x7f4d3806c8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009b50 tx=0x7f4d3c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:17.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:17.886+0000 7f4d33fff640 1 -- 172.21.15.31:0/2697787310 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4d4c145770 con 0x7f4d4c1483d0 2023-12-22T08:41:18.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.063+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d4c145770 con 0x7f4d4c1483d0 2023-12-22T08:41:18.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.704+0000 7f4d33fff640 1 -- 172.21.15.31:0/2697787310 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4d4c145770 con 0x7f4d4c1483d0 2023-12-22T08:41:18.707 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-12-22T08:41:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4d3806a430 msgr2=0x7f4d3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4d3806a430 0x7f4d3806c8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009b50 tx=0x7f4d3c009240 comp rx=0 tx=0).stop 2023-12-22T08:41:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c1483d0 msgr2=0x7f4d4c1463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c1463c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009e80 tx=0x7f4d44004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 shutdown_connections 2023-12-22T08:41:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f4d3806a430 0x7f4d3806c8f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d4c1483d0 0x7f4d4c1463c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d4c141cd0 0x7f4d4c13bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 --2- 172.21.15.31:0/2697787310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cae0 0x7f4d4c0bb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.709+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 >> 172.21.15.31:0/2697787310 conn(0x7f4d4c0b8a00 msgr2=0x7f4d4c06b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:18.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.710+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 shutdown_connections 2023-12-22T08:41:18.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.710+0000 7f4d51eec640 1 -- 172.21.15.31:0/2697787310 wait complete. 2023-12-22T08:41:18.728 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T08:41:18.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.841+0000 7f0b73841640 1 Processor -- start 2023-12-22T08:41:18.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.842+0000 7f0b73841640 1 -- start start 2023-12-22T08:41:18.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.842+0000 7f0b73841640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c142f20 0x7f0b6c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.842+0000 7f0b73841640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0b6c0b94b0 0x7f0b6c153280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.842+0000 7f0b73841640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c1498f0 con 0x7f0b6c0a0cc0 2023-12-22T08:41:18.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.842+0000 7f0b73841640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b37e0 con 0x7f0b6c0b94b0 2023-12-22T08:41:18.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.842+0000 7f0b73841640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c148fc0 con 0x7f0b6c142f20 2023-12-22T08:41:18.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.842+0000 7f0b70ddc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0b6c0a0cc0 0x7f0b6c0b8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36406/0 (socket says 172.21.15.31:36406) 2023-12-22T08:41:18.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.842+0000 7f0b70ddc640 1 -- 172.21.15.31:0/827215549 learned_addr learned my addr 172.21.15.31:0/827215549 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:18.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b715dd640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c142f20 0x7f0b6c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b71dde640 1 --2- 172.21.15.31:0/827215549 >> v2:172.21.15.69:3300/0 conn(0x7f0b6c0b94b0 0x7f0b6c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780542338 0 0) 0x7f0b6c1498f0 con 0x7f0b6c0a0cc0 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b58003520 con 0x7f0b6c0a0cc0 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2511552947 0 0) 0x7f0b58003520 con 0x7f0b6c0a0cc0 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c142f20 msgr2=0x7f0b6c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c142f20 0x7f0b6c0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 >> v2:172.21.15.69:3300/0 conn(0x7f0b6c0b94b0 msgr2=0x7f0b6c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 --2- 172.21.15.31:0/827215549 >> v2:172.21.15.69:3300/0 conn(0x7f0b6c0b94b0 0x7f0b6c153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c1492a0 con 0x7f0b6c0a0cc0 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f0b5c001670 con 0x7f0b6c0a0cc0 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 >> v1:172.21.15.31:6789/0 conn(0x7f0b6c0a0cc0 legacy=0x7f0b6c0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b58003970 0x7f0b58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c142f20 0x7f0b58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b37e0 con 0x7f0b580047c0 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c148fc0 con 0x7f0b58003970 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58009970 con 0x7f0b6c142f20 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b70ddc640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b715dd640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b58003970 0x7f0b58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b71dde640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c142f20 0x7f0b58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b70ddc640 1 -- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c142f20 msgr2=0x7f0b58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b70ddc640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c142f20 0x7f0b58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b70ddc640 1 -- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b58003970 msgr2=0x7f0b58003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b70ddc640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b58003970 0x7f0b58003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.843+0000 7f0b70ddc640 1 -- 172.21.15.31:0/827215549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58003520 con 0x7f0b580047c0 2023-12-22T08:41:18.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.844+0000 7f0b70ddc640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b58004c40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0a1100 tx=0x7f0b580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434d0a78e0a1fbf6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.844+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c005ad0 con 0x7f0b580047c0 2023-12-22T08:41:18.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.844+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c005c30 con 0x7f0b580047c0 2023-12-22T08:41:18.851 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.844+0000 7f0b63fff640 1 -- 172.21.15.31:0/827215549 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c02c8b0 con 0x7f0b580047c0 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.845+0000 7f0b73841640 1 -- 172.21.15.31:0/827215549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 msgr2=0x7f0b58004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.845+0000 7f0b73841640 1 --2- 172.21.15.31:0/827215549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b58004c40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0a1100 tx=0x7f0b580057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.845+0000 7f0b71dde640 1 -- 172.21.15.31:0/827215549 reap_dead start 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.845+0000 7f0b73841640 1 -- 172.21.15.31:0/827215549 shutdown_connections 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.845+0000 7f0b73841640 1 -- 172.21.15.31:0/827215549 >> 172.21.15.31:0/827215549 conn(0x7f0b6c0be1e0 msgr2=0x7f0b6c0be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.845+0000 7f0b73841640 1 -- 172.21.15.31:0/827215549 shutdown_connections 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.845+0000 7f0b73841640 1 -- 172.21.15.31:0/827215549 wait complete. 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.846+0000 7f0b73841640 1 Processor -- start 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.846+0000 7f0b73841640 1 -- start start 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b73841640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b6c0a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b73841640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b6c0bd690 0x7f0b6c1394a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b73841640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c1399e0 0x7f0b6c1db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.852 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b73841640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c139e90 con 0x7f0b580047c0 2023-12-22T08:41:18.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b73841640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1def00 con 0x7f0b6c0bd690 2023-12-22T08:41:18.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b73841640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1df1e0 con 0x7f0b6c1399e0 2023-12-22T08:41:18.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b6c0a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b6c0a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54384/0 (socket says 172.21.15.31:54384) 2023-12-22T08:41:18.853 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 -- 172.21.15.31:0/2346784011 learned_addr learned my addr 172.21.15.31:0/2346784011 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b71dde640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c1399e0 0x7f0b6c1db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b70ddc640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b6c0bd690 0x7f0b6c1394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 -- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c1399e0 msgr2=0x7f0b6c1db9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c1399e0 0x7f0b6c1db9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 -- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b6c0bd690 msgr2=0x7f0b6c1394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b6c0bd690 0x7f0b6c1394a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 -- 172.21.15.31:0/2346784011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c1df4c0 con 0x7f0b580047c0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.847+0000 7f0b715dd640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b6c0a1bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b680118e0 tx=0x7f0b68011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.848+0000 7f0b61ffb640 1 -- 172.21.15.31:0/2346784011 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800faf0 con 0x7f0b580047c0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.848+0000 7f0b61ffb640 1 -- 172.21.15.31:0/2346784011 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800fc50 con 0x7f0b580047c0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.848+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c1df7a0 con 0x7f0b580047c0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.848+0000 7f0b61ffb640 1 -- 172.21.15.31:0/2346784011 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68014440 con 0x7f0b580047c0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.848+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c0bdad0 con 0x7f0b580047c0 2023-12-22T08:41:18.854 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.849+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c066e90 con 0x7f0b580047c0 2023-12-22T08:41:18.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.849+0000 7f0b61ffb640 1 -- 172.21.15.31:0/2346784011 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0b680145a0 con 0x7f0b580047c0 2023-12-22T08:41:18.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.850+0000 7f0b61ffb640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0b5006a460 0x7f0b5006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:18.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.850+0000 7f0b61ffb640 1 -- 172.21.15.31:0/2346784011 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0b68088fa0 con 0x7f0b580047c0 2023-12-22T08:41:18.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.850+0000 7f0b70ddc640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0b5006a460 0x7f0b5006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:18.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.850+0000 7f0b70ddc640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0b5006a460 0x7f0b5006c920 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c034000 tx=0x7f0b5c037040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:18.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:18.854+0000 7f0b61ffb640 1 -- 172.21.15.31:0/2346784011 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0b680bbc80 con 0x7f0b580047c0 2023-12-22T08:41:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.029+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0b6c073a40 con 0x7f0b580047c0 2023-12-22T08:41:19.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.714+0000 7f0b61ffb640 1 -- 172.21.15.31:0/2346784011 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0b680546f0 con 0x7f0b580047c0 2023-12-22T08:41:19.717 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0b5006a460 msgr2=0x7f0b5006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0b5006a460 0x7f0b5006c920 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c034000 tx=0x7f0b5c037040 comp rx=0 tx=0).stop 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 msgr2=0x7f0b6c0a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b6c0a1bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b680118e0 tx=0x7f0b68011da0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 shutdown_connections 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f0b5006a460 0x7f0b5006c920 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c034000 tx=0x7f0b5c037040 comp rx=0 tx=0).stop 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0b6c1399e0 0x7f0b6c1db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b6c0bd690 0x7f0b6c1394a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 --2- 172.21.15.31:0/2346784011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b580047c0 0x7f0b6c0a1bc0 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b680118e0 tx=0x7f0b68011da0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 >> 172.21.15.31:0/2346784011 conn(0x7f0b6c0be1e0 msgr2=0x7f0b6c141b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.720+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 shutdown_connections 2023-12-22T08:41:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.721+0000 7f0b73841640 1 -- 172.21.15.31:0/2346784011 wait complete. 2023-12-22T08:41:19.740 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T08:41:19.740 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T08:41:19.740 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:41:19.740 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:19.741 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T08:41:19.741 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T08:41:19.741 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:41:19.741 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:19.741 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T08:41:19.741 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T08:41:19.742 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:41:19.742 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:41:19.751 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:41:19.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T08:41:19.752 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:41:19.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T08:41:19.754 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:41:19.754 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T08:41:19.795 INFO:tasks.ceph.mds.a:Started 2023-12-22T08:41:19.795 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:19.796 INFO:tasks.ceph.mds.c:Started 2023-12-22T08:41:19.796 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:19.797 INFO:tasks.ceph.mds.b:Started 2023-12-22T08:41:19.797 DEBUG:teuthology.parallel:result is None 2023-12-22T08:41:19.797 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-22T08:41:19.879 INFO:tasks.ceph.mds.b.smithi069.stdout:starting mds.b at 2023-12-22T08:41:19.881 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-12-22T08:41:19.881 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-12-22T08:41:19.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.916+0000 7fb5c5241640 1 Processor -- start 2023-12-22T08:41:19.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.916+0000 7fb5c5241640 1 -- start start 2023-12-22T08:41:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5c5241640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb5c0071170 0x7fb5c00b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5c5241640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb5c00b7fe0 0x7fb5c014e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5c5241640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c014eba0 0x7fb5c014ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5c5241640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c014f050 con 0x7fb5c00b7fe0 2023-12-22T08:41:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5c5241640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c014e1d0 con 0x7fb5c0071170 2023-12-22T08:41:19.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5c5241640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c006cbc0 con 0x7fb5c014eba0 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5b659c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb5c00b7fe0 0x7fb5c014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bed9d640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb5c0071170 0x7fb5c00b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bf59e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c014eba0 0x7fb5c014ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5b659c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb5c00b7fe0 0x7fb5c014e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54424/0 (socket says 172.21.15.31:54424) 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bf59e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c014eba0 0x7fb5c014ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:53986/0 (socket says 172.21.15.31:53986) 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bf59e640 1 -- 172.21.15.31:0/932191725 learned_addr learned my addr 172.21.15.31:0/932191725 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bed9d640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb5c0071170 0x7fb5c00b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:58256/0 (socket says 172.21.15.31:58256) 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bf59e640 1 -- 172.21.15.31:0/932191725 >> v2:172.21.15.69:3300/0 conn(0x7fb5c0071170 msgr2=0x7fb5c00b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bf59e640 1 --2- 172.21.15.31:0/932191725 >> v2:172.21.15.69:3300/0 conn(0x7fb5c0071170 0x7fb5c00b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bf59e640 1 -- 172.21.15.31:0/932191725 >> v2:172.21.15.31:3300/0 conn(0x7fb5c00b7fe0 msgr2=0x7fb5c014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bf59e640 1 --2- 172.21.15.31:0/932191725 >> v2:172.21.15.31:3300/0 conn(0x7fb5c00b7fe0 0x7fb5c014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.917+0000 7fb5bf59e640 1 -- 172.21.15.31:0/932191725 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c006b0e0 con 0x7fb5c014eba0 2023-12-22T08:41:19.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.918+0000 7fb5bf59e640 1 --2- 172.21.15.31:0/932191725 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c014eba0 0x7fb5c014ab60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb5c006ac50 tx=0x7fb5b802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f2fae796a2c2c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:19.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.921+0000 7fb5be59c640 1 -- 172.21.15.31:0/932191725 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b802ca70 con 0x7fb5c014eba0 2023-12-22T08:41:19.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.921+0000 7fb5be59c640 1 -- 172.21.15.31:0/932191725 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b802cbd0 con 0x7fb5c014eba0 2023-12-22T08:41:19.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.921+0000 7fb5be59c640 1 -- 172.21.15.31:0/932191725 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b80343f0 con 0x7fb5c014eba0 2023-12-22T08:41:19.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 -- 172.21.15.31:0/932191725 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c014eba0 msgr2=0x7fb5c014ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 --2- 172.21.15.31:0/932191725 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c014eba0 0x7fb5c014ab60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb5c006ac50 tx=0x7fb5b802bed0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 -- 172.21.15.31:0/932191725 shutdown_connections 2023-12-22T08:41:19.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 --2- 172.21.15.31:0/932191725 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c014eba0 0x7fb5c014ab60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 --2- 172.21.15.31:0/932191725 >> v2:172.21.15.31:3300/0 conn(0x7fb5c00b7fe0 0x7fb5c014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 --2- 172.21.15.31:0/932191725 >> v2:172.21.15.69:3300/0 conn(0x7fb5c0071170 0x7fb5c00b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 -- 172.21.15.31:0/932191725 >> 172.21.15.31:0/932191725 conn(0x7fb5c00be1d0 msgr2=0x7fb5c00be5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:19.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 -- 172.21.15.31:0/932191725 shutdown_connections 2023-12-22T08:41:19.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.922+0000 7fb5c5241640 1 -- 172.21.15.31:0/932191725 wait complete. 2023-12-22T08:41:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.923+0000 7fb5c5241640 1 Processor -- start 2023-12-22T08:41:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.923+0000 7fb5c5241640 1 -- start start 2023-12-22T08:41:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5c5241640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c0071170 0x7fb5c0146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5c5241640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00b7fe0 0x7fb5c01e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5c5241640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5c014eba0 0x7fb5c01405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5c5241640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0149f10 con 0x7fb5c014eba0 2023-12-22T08:41:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5c5241640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0148b00 con 0x7fb5c00b7fe0 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5c5241640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c014ca80 con 0x7fb5c0071170 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5c014eba0 0x7fb5c01405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5c014eba0 0x7fb5c01405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54442/0 (socket says 172.21.15.31:54442) 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 -- 172.21.15.31:0/3064312194 learned_addr learned my addr 172.21.15.31:0/3064312194 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bed9d640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c0071170 0x7fb5c0146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5b659c640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00b7fe0 0x7fb5c01e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 -- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c0071170 msgr2=0x7fb5c0146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c0071170 0x7fb5c0146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 -- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00b7fe0 msgr2=0x7fb5c01e2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00b7fe0 0x7fb5c01e2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 -- 172.21.15.31:0/3064312194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8009b30 con 0x7fb5c014eba0 2023-12-22T08:41:19.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.924+0000 7fb5bf59e640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5c014eba0 0x7fb5c01405a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009f40 tx=0x7fb5b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.925+0000 7fb5b7fff640 1 -- 172.21.15.31:0/3064312194 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8040670 con 0x7fb5c014eba0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.925+0000 7fb5b7fff640 1 -- 172.21.15.31:0/3064312194 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b80407d0 con 0x7fb5c014eba0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.925+0000 7fb5b7fff640 1 -- 172.21.15.31:0/3064312194 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8040b80 con 0x7fb5c014eba0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.925+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c014cd60 con 0x7fb5c014eba0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.925+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c0148de0 con 0x7fb5c014eba0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.926+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c0073a40 con 0x7fb5c014eba0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.926+0000 7fb5b7fff640 1 -- 172.21.15.31:0/3064312194 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb5b8040ce0 con 0x7fb5c014eba0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.926+0000 7fb5b7fff640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb5a006a430 0x7fb5a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.927+0000 7fb5b7fff640 1 -- 172.21.15.31:0/3064312194 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5b80ab430 con 0x7fb5c014eba0 2023-12-22T08:41:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.927+0000 7fb5bed9d640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb5a006a430 0x7fb5a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.927+0000 7fb5bed9d640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb5a006a430 0x7fb5a006c8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009a20 tx=0x7fb5b0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:19.931+0000 7fb5b7fff640 1 -- 172.21.15.31:0/3064312194 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb5b8076dc0 con 0x7fb5c014eba0 2023-12-22T08:41:20.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.122+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb5c00bbaa0 con 0x7fb5c014eba0 2023-12-22T08:41:20.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.926+0000 7fb5b7fff640 1 -- 172.21.15.31:0/3064312194 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb5b8009510 con 0x7fb5c014eba0 2023-12-22T08:41:20.929 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb5a006a430 msgr2=0x7fb5a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb5a006a430 0x7fb5a006c8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009a20 tx=0x7fb5b0009190 comp rx=0 tx=0).stop 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5c014eba0 msgr2=0x7fb5c01405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5c014eba0 0x7fb5c01405a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009f40 tx=0x7fb5b8004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 shutdown_connections 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fb5a006a430 0x7fb5a006c8f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5c014eba0 0x7fb5c01405a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00b7fe0 0x7fb5c01e2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 --2- 172.21.15.31:0/3064312194 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5c0071170 0x7fb5c0146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 >> 172.21.15.31:0/3064312194 conn(0x7fb5c00be1d0 msgr2=0x7fb5c00bbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:20.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 shutdown_connections 2023-12-22T08:41:20.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:20.929+0000 7fb5c5241640 1 -- 172.21.15.31:0/3064312194 wait complete. 2023-12-22T08:41:20.945 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T08:41:21.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.055+0000 7fac4c5c4640 1 Processor -- start 2023-12-22T08:41:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.055+0000 7fac4c5c4640 1 -- start start 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac4c5c4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac440ba550 0x7fac440b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac4c5c4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac440bb310 con 0x7fac4406a6d0 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac4c5c4640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac440bf960 con 0x7fac440ba000 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac4c5c4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440bb5b0 con 0x7fac440ba550 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac4a360640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fac4406a6d0 0x7fac4414acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36410/0 (socket says 172.21.15.31:36410) 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac4a360640 1 -- 172.21.15.31:0/3497156669 learned_addr learned my addr 172.21.15.31:0/3497156669 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac49b5f640 1 --2- 172.21.15.31:0/3497156669 >> v2:172.21.15.31:3300/0 conn(0x7fac440ba550 0x7fac440b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac4935e640 1 -- 172.21.15.31:0/3497156669 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713079404 0 0) 0x7fac440bb310 con 0x7fac4406a6d0 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac4935e640 1 -- 172.21.15.31:0/3497156669 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac30003520 con 0x7fac4406a6d0 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac49b5f640 1 -- 172.21.15.31:0/3497156669 >> v1:172.21.15.69:6789/0 conn(0x7fac440ba000 legacy=0x7fac441554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac49b5f640 1 -- 172.21.15.31:0/3497156669 >> v1:172.21.15.31:6789/0 conn(0x7fac4406a6d0 legacy=0x7fac4414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.056+0000 7fac49b5f640 1 -- 172.21.15.31:0/3497156669 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440c0120 con 0x7fac440ba550 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.057+0000 7fac49b5f640 1 --2- 172.21.15.31:0/3497156669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac440ba550 0x7fac440b9ac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fac340097a0 tx=0x7fac3402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabd661045fc6cf3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.057+0000 7fac4935e640 1 -- 172.21.15.31:0/3497156669 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34030610 con 0x7fac440ba550 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.057+0000 7fac4935e640 1 -- 172.21.15.31:0/3497156669 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34030770 con 0x7fac440ba550 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.057+0000 7fac4935e640 1 -- 172.21.15.31:0/3497156669 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34030b00 con 0x7fac440ba550 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.058+0000 7fac4c5c4640 1 -- 172.21.15.31:0/3497156669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac440ba550 msgr2=0x7fac440b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.058+0000 7fac4c5c4640 1 --2- 172.21.15.31:0/3497156669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac440ba550 0x7fac440b9ac0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fac340097a0 tx=0x7fac3402b960 comp rx=0 tx=0).stop 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.058+0000 7fac4c5c4640 1 -- 172.21.15.31:0/3497156669 shutdown_connections 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.058+0000 7fac4c5c4640 1 --2- 172.21.15.31:0/3497156669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac440ba550 0x7fac440b9ac0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.058+0000 7fac4c5c4640 1 -- 172.21.15.31:0/3497156669 >> 172.21.15.31:0/3497156669 conn(0x7fac440c0350 msgr2=0x7fac440c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.058+0000 7fac4c5c4640 1 -- 172.21.15.31:0/3497156669 shutdown_connections 2023-12-22T08:41:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.058+0000 7fac4c5c4640 1 -- 172.21.15.31:0/3497156669 wait complete. 2023-12-22T08:41:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.059+0000 7fac4c5c4640 1 Processor -- start 2023-12-22T08:41:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.059+0000 7fac4c5c4640 1 -- start start 2023-12-22T08:41:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4c5c4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4406a6d0 0x7fac440b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4c5c4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac440ba000 0x7fac4414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4c5c4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fac440ba550 0x7fac440b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4c5c4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac440b44a0 con 0x7fac4406a6d0 2023-12-22T08:41:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4c5c4640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac440b4780 con 0x7fac440ba000 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4c5c4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440b4a60 con 0x7fac440ba550 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4406a6d0 0x7fac440b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4406a6d0 0x7fac440b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54450/0 (socket says 172.21.15.31:54450) 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 -- 172.21.15.31:0/309388974 learned_addr learned my addr 172.21.15.31:0/309388974 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac49b5f640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac440ba000 0x7fac4414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4ab61640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fac440ba550 0x7fac440b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 -- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fac440ba550 msgr2=0x7fac440b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fac440ba550 0x7fac440b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 -- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac440ba000 msgr2=0x7fac4414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac440ba000 0x7fac4414e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 -- 172.21.15.31:0/309388974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34009400 con 0x7fac4406a6d0 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4ab61640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fac440ba550 0x7fac440b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4a360640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4406a6d0 0x7fac440b3e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c500 tx=0x7fac4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac3affd640 1 -- 172.21.15.31:0/309388974 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40005ce0 con 0x7fac4406a6d0 2023-12-22T08:41:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac3affd640 1 -- 172.21.15.31:0/309388974 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40005e40 con 0x7fac4406a6d0 2023-12-22T08:41:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.060+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac440b4d40 con 0x7fac4406a6d0 2023-12-22T08:41:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.061+0000 7fac3affd640 1 -- 172.21.15.31:0/309388974 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40007330 con 0x7fac4406a6d0 2023-12-22T08:41:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.061+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4414eb10 con 0x7fac4406a6d0 2023-12-22T08:41:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.062+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac44073a40 con 0x7fac4406a6d0 2023-12-22T08:41:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.062+0000 7fac3affd640 1 -- 172.21.15.31:0/309388974 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fac40007550 con 0x7fac4406a6d0 2023-12-22T08:41:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.062+0000 7fac3affd640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fac2806a430 0x7fac2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.062+0000 7fac3affd640 1 -- 172.21.15.31:0/309388974 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac40087b90 con 0x7fac4406a6d0 2023-12-22T08:41:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.063+0000 7fac49b5f640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fac2806a430 0x7fac2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.063+0000 7fac49b5f640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fac2806a430 0x7fac2806c8f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac34036000 tx=0x7fac3403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.067+0000 7fac3affd640 1 -- 172.21.15.31:0/309388974 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fac400536d0 con 0x7fac4406a6d0 2023-12-22T08:41:21.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.311+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fac440b45e0 con 0x7fac4406a6d0 2023-12-22T08:41:21.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.312+0000 7fac3affd640 1 -- 172.21.15.31:0/309388974 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5491 (secure 0 0 0) 0x7fac440b45e0 con 0x7fac4406a6d0 2023-12-22T08:41:21.314 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:21.314 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:21.314 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBUS4VluohwGxAA9l0mu9Qu9WflbVuQTUFOXA==", 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBUS4VlhbypKBAAYYlRglfH3XaoJFivmxXImQ==", 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.315 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBUS4VlkFl3IxAADjuJaJmvn4B/w4NiOYytng==", 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-12-22T08:41:21.316 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBYS4Vl+XevDRAA4l00XtZM7YHTHcuCNls+aQ==", 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.317 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBbS4Vl7CyfDBAA0arhtS3pCgpnRVwSdoRpbA==", 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBeS4VlfHX1CxAAVfkYlsCz603HDpa1ah+giA==", 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-12-22T08:41:21.318 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBhS4VlFAvnChAAeAVJVTALAUTZ/SnA7Rfvkg==", 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBnS4VlYQAZDhAAqBnHlQirGa3rI6dqIh+9WA==", 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.319 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqS4VlxntiDRAACEtFiOZ36WLlAurFiSBoMg==", 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtS4VlhT/9CxAA0qTCjEZeqkW/9l66toosZA==", 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBwS4VlJB1uCRAABFBgUz2o1EFYZpac987hbA==", 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.321 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBUS4Vlmjv6MhAAb3tw7TH+NUjFZ91G8B4xbQ==", 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTS4VlmmZcKRAAczhpmXqJrh+g6V7/Sugd6Q==", 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mds", 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB1S4Vla4w9KxAArdxr6gqpxH51tfjXkH/xdw==", 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mds" 2023-12-22T08:41:21.323 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mgr", 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB1S4Vln5U9KxAA2IWRPxMy4s/VNxfY9/zAtQ==", 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-osd", 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB1S4VlT509KxAAEHWBDO+n8oA2r+lLM6l5QQ==", 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.324 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-osd" 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd", 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB1S4Vl6aQ9KxAArTcWAzF62q5auoyILZnAmg==", 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB1S4VlZq89KxAA2TKusvfYTO5LHioUnRIohg==", 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-22T08:41:21.325 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rgw", 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB1S4VlWLc9KxAARi77ZWheQV0Md5Ioif9q+g==", 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBUS4VlaUNiFxAAUjWTvHgVgKfGMlRJqne8gw==", 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-12-22T08:41:21.326 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBUS4Vl11+SExAAjvtZTtIUNoWGp6Afd597xw==", 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-12-22T08:41:21.327 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fac2806a430 msgr2=0x7fac2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fac2806a430 0x7fac2806c8f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac34036000 tx=0x7fac3403b040 comp rx=0 tx=0).stop 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4406a6d0 msgr2=0x7fac440b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4406a6d0 0x7fac440b3e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c500 tx=0x7fac4000c9c0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 shutdown_connections 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fac2806a430 0x7fac2806c8f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fac440ba550 0x7fac440b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac440ba000 0x7fac4414e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 --2- 172.21.15.31:0/309388974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4406a6d0 0x7fac440b3e80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 >> 172.21.15.31:0/309388974 conn(0x7fac440c0350 msgr2=0x7fac440a14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:21.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 shutdown_connections 2023-12-22T08:41:21.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.314+0000 7fac4c5c4640 1 -- 172.21.15.31:0/309388974 wait complete. 2023-12-22T08:41:21.330 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-22T08:41:21.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.434+0000 7f90f9026640 1 Processor -- start 2023-12-22T08:41:21.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.434+0000 7f90f9026640 1 -- start start 2023-12-22T08:41:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f9026640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90f406bc30 0x7f90f40b8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f9026640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f409eca0 0x7f90f414e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f9026640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f409d880 con 0x7f90f414e9a0 2023-12-22T08:41:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f9026640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f409cfe0 con 0x7f90f406bc30 2023-12-22T08:41:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f9026640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f409d2c0 con 0x7f90f409eca0 2023-12-22T08:41:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f2d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90f406bc30 0x7f90f40b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f2d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90f406bc30 0x7f90f40b8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54458/0 (socket says 172.21.15.31:54458) 2023-12-22T08:41:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f2d9d640 1 -- 172.21.15.31:0/371582755 learned_addr learned my addr 172.21.15.31:0/371582755 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f259c640 1 --2- 172.21.15.31:0/371582755 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f409eca0 0x7f90f414e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f2d9d640 1 -- 172.21.15.31:0/371582755 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f409eca0 msgr2=0x7f90f414e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f2d9d640 1 --2- 172.21.15.31:0/371582755 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f409eca0 0x7f90f414e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f2d9d640 1 -- 172.21.15.31:0/371582755 >> v1:172.21.15.69:6789/0 conn(0x7f90f414e9a0 legacy=0x7f90f414b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.435+0000 7f90f2d9d640 1 -- 172.21.15.31:0/371582755 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f409d5a0 con 0x7f90f406bc30 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f2d9d640 1 --2- 172.21.15.31:0/371582755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f406bc30 0x7f90f40b8650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009e50 tx=0x7f90ec02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601244659e4960a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f1d9b640 1 -- 172.21.15.31:0/371582755 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec02cb90 con 0x7f90f406bc30 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f1d9b640 1 -- 172.21.15.31:0/371582755 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec02ccf0 con 0x7f90f406bc30 2023-12-22T08:41:21.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f1d9b640 1 -- 172.21.15.31:0/371582755 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec034610 con 0x7f90f406bc30 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f9026640 1 -- 172.21.15.31:0/371582755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f406bc30 msgr2=0x7f90f40b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f9026640 1 --2- 172.21.15.31:0/371582755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f406bc30 0x7f90f40b8650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009e50 tx=0x7f90ec02bff0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f9026640 1 -- 172.21.15.31:0/371582755 shutdown_connections 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f9026640 1 --2- 172.21.15.31:0/371582755 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f409eca0 0x7f90f414e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f9026640 1 --2- 172.21.15.31:0/371582755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f406bc30 0x7f90f40b8650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f9026640 1 -- 172.21.15.31:0/371582755 >> 172.21.15.31:0/371582755 conn(0x7f90f406a580 msgr2=0x7f90f40bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.436+0000 7f90f9026640 1 -- 172.21.15.31:0/371582755 shutdown_connections 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.437+0000 7f90f9026640 1 -- 172.21.15.31:0/371582755 wait complete. 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.438+0000 7f90f9026640 1 Processor -- start 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.438+0000 7f90f9026640 1 -- start start 2023-12-22T08:41:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.438+0000 7f90f9026640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f406bc30 0x7f90f41d6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.438+0000 7f90f9026640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f409eca0 0x7f90f41e2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.438+0000 7f90f9026640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f414e9a0 0x7f90f414c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.438+0000 7f90f9026640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b5870 con 0x7f90f414e9a0 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.438+0000 7f90f9026640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4124260 con 0x7f90f409eca0 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.438+0000 7f90f9026640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40b3b40 con 0x7f90f406bc30 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f414e9a0 0x7f90f414c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f414e9a0 0x7f90f414c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54468/0 (socket says 172.21.15.31:54468) 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 -- 172.21.15.31:0/1675598092 learned_addr learned my addr 172.21.15.31:0/1675598092 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f2d9d640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f406bc30 0x7f90f41d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f259c640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f409eca0 0x7f90f41e2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 -- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f406bc30 msgr2=0x7f90f41d6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f406bc30 0x7f90f41d6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 -- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f409eca0 msgr2=0x7f90f41e2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f409eca0 0x7f90f41e2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 -- 172.21.15.31:0/1675598092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009b30 con 0x7f90f414e9a0 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f259c640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f409eca0 0x7f90f41e2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f2d9d640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f406bc30 0x7f90f41d6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f359e640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f414e9a0 0x7f90f414c070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f90e400c3c0 tx=0x7f90e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90db7fe640 1 -- 172.21.15.31:0/1675598092 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40052d0 con 0x7f90f414e9a0 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90db7fe640 1 -- 172.21.15.31:0/1675598092 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e4005430 con 0x7f90f414e9a0 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f40b3e20 con 0x7f90f414e9a0 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90db7fe640 1 -- 172.21.15.31:0/1675598092 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4003810 con 0x7f90f414e9a0 2023-12-22T08:41:21.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.439+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f40b3580 con 0x7f90f414e9a0 2023-12-22T08:41:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.440+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f40b4340 con 0x7f90f414e9a0 2023-12-22T08:41:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.441+0000 7f90db7fe640 1 -- 172.21.15.31:0/1675598092 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90e4003970 con 0x7f90f414e9a0 2023-12-22T08:41:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.441+0000 7f90db7fe640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f90e006a460 0x7f90e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.441+0000 7f90db7fe640 1 -- 172.21.15.31:0/1675598092 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90e4087a30 con 0x7f90f414e9a0 2023-12-22T08:41:21.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.441+0000 7f90f2d9d640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f90e006a460 0x7f90e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.442+0000 7f90f2d9d640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f90e006a460 0x7f90e006c920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f90ec035000 tx=0x7f90ec030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.445+0000 7f90db7fe640 1 -- 172.21.15.31:0/1675598092 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f90f40b4340 con 0x7f90f414e9a0 2023-12-22T08:41:21.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.690+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f90f40b4340 con 0x7f90f414e9a0 2023-12-22T08:41:21.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.693+0000 7f90db7fe640 1 -- 172.21.15.31:0/1675598092 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f90f40b4340 con 0x7f90f414e9a0 2023-12-22T08:41:21.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f90e006a460 msgr2=0x7f90e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f90e006a460 0x7f90e006c920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f90ec035000 tx=0x7f90ec030000 comp rx=0 tx=0).stop 2023-12-22T08:41:21.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f414e9a0 msgr2=0x7f90f414c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f414e9a0 0x7f90f414c070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f90e400c3c0 tx=0x7f90e400c880 comp rx=0 tx=0).stop 2023-12-22T08:41:21.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 shutdown_connections 2023-12-22T08:41:21.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f90e006a460 0x7f90e006c920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f414e9a0 0x7f90f414c070 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f409eca0 0x7f90f41e2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 --2- 172.21.15.31:0/1675598092 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f90f406bc30 0x7f90f41d6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 >> 172.21.15.31:0/1675598092 conn(0x7f90f406a580 msgr2=0x7f90f40bc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.695+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 shutdown_connections 2023-12-22T08:41:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.696+0000 7f90f9026640 1 -- 172.21.15.31:0/1675598092 wait complete. 2023-12-22T08:41:21.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-22T08:41:21.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.814+0000 7fcbdbc1a640 1 Processor -- start 2023-12-22T08:41:21.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.814+0000 7fcbdbc1a640 1 -- start start 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbdbc1a640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcbd40b7fb0 0x7fcbd40b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbdbc1a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd414ef70 con 0x7fcbd40b8cf0 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbdbc1a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40b6d30 con 0x7fcbd4144dd0 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbdbc1a640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd40b9a20 con 0x7fcbd40b7fb0 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbda1b7640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcbd40b8cf0 0x7fcbd41554c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36418/0 (socket says 172.21.15.31:36418) 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbda1b7640 1 -- 172.21.15.31:0/2172204168 learned_addr learned my addr 172.21.15.31:0/2172204168 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097096866 0 0) 0x7fcbd414ef70 con 0x7fcbd40b8cf0 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc0003520 con 0x7fcbd40b8cf0 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd91b5640 1 --2- 172.21.15.31:0/2172204168 >> v2:172.21.15.69:3300/0 conn(0x7fcbd40b7fb0 0x7fcbd40b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427307098 0 0) 0x7fcbc0003520 con 0x7fcbd40b8cf0 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 >> v2:172.21.15.69:3300/0 conn(0x7fcbd40b7fb0 msgr2=0x7fcbd40b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 --2- 172.21.15.31:0/2172204168 >> v2:172.21.15.69:3300/0 conn(0x7fcbd40b7fb0 0x7fcbd40b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 >> v1:172.21.15.69:6789/0 conn(0x7fcbd4144dd0 legacy=0x7fcbd414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40b9120 con 0x7fcbd40b8cf0 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7fcbcc001670 con 0x7fcbd40b8cf0 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.815+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 >> v1:172.21.15.31:6789/0 conn(0x7fcbd40b8cf0 legacy=0x7fcbd41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbd89b4640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbc0003970 0x7fcbc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbd89b4640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc00047c0 0x7fcbc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbd89b4640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc0005180 0x7fcbc000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc000c080 con 0x7fcbc0005180 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc000c1f0 con 0x7fcbc0003970 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc000c3b0 con 0x7fcbc00047c0 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbda1b7640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc0005180 0x7fcbc000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbd99b6640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbc0003970 0x7fcbc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbd91b5640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc00047c0 0x7fcbc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbda1b7640 1 -- 172.21.15.31:0/2172204168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc00047c0 msgr2=0x7fcbc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbda1b7640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc00047c0 0x7fcbc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbda1b7640 1 -- 172.21.15.31:0/2172204168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbc0003970 msgr2=0x7fcbc0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbda1b7640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbc0003970 0x7fcbc0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.816+0000 7fcbda1b7640 1 -- 172.21.15.31:0/2172204168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0003520 con 0x7fcbc0005180 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbda1b7640 1 -- 172.21.15.31:0/2172204168 reap_dead start 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbda1b7640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc0005180 0x7fcbc000b980 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c240 tx=0x7fcbc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e61e7f622119f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc005ad0 con 0x7fcbc0005180 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc005c70 con 0x7fcbc0005180 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbd89b4640 1 -- 172.21.15.31:0/2172204168 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc02c8b0 con 0x7fcbc0005180 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/2172204168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc0005180 msgr2=0x7fcbc000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbdbc1a640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc0005180 0x7fcbc000b980 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c240 tx=0x7fcbc00057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/2172204168 shutdown_connections 2023-12-22T08:41:21.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbdbc1a640 1 --2- 172.21.15.31:0/2172204168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc0005180 0x7fcbc000b980 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.817+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/2172204168 >> 172.21.15.31:0/2172204168 conn(0x7fcbd40c03d0 msgr2=0x7fcbd40c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:21.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.818+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/2172204168 shutdown_connections 2023-12-22T08:41:21.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.818+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/2172204168 wait complete. 2023-12-22T08:41:21.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbdbc1a640 1 Processor -- start 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbdbc1a640 1 -- start start 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbdbc1a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc0005180 0x7fcbd4144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbdbc1a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd40af9c0 0x7fcbd40afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbdbc1a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbd41dfe50 0x7fcbd41e02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbdbc1a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd41448b0 con 0x7fcbd40af9c0 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbdbc1a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd41dfa20 con 0x7fcbd41dfe50 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbdbc1a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd41e0810 con 0x7fcbc0005180 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbd91b5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd40af9c0 0x7fcbd40afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbd91b5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd40af9c0 0x7fcbd40afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54488/0 (socket says 172.21.15.31:54488) 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbd91b5640 1 -- 172.21.15.31:0/4082268174 learned_addr learned my addr 172.21.15.31:0/4082268174 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbda1b7640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbd41dfe50 0x7fcbd41e02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.819+0000 7fcbd99b6640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc0005180 0x7fcbd4144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbd91b5640 1 -- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc0005180 msgr2=0x7fcbd4144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbd91b5640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc0005180 0x7fcbd4144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbd91b5640 1 -- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbd41dfe50 msgr2=0x7fcbd41e02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbd91b5640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbd41dfe50 0x7fcbd41e02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbd91b5640 1 -- 172.21.15.31:0/4082268174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4148eb0 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbd91b5640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd40af9c0 0x7fcbd40afe20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400b5c0 tx=0x7fcbc400ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbca7fc640 1 -- 172.21.15.31:0/4082268174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4010760 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbca7fc640 1 -- 172.21.15.31:0/4082268174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc40108c0 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd4149150 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbca7fc640 1 -- 172.21.15.31:0/4082268174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4010c50 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.820+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd4149710 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.821+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4149930 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.821+0000 7fcbca7fc640 1 -- 172.21.15.31:0/4082268174 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbc4014430 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.822+0000 7fcbca7fc640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcbb806a430 0x7fcbb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.822+0000 7fcbca7fc640 1 -- 172.21.15.31:0/4082268174 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcbc4088c30 con 0x7fcbd40af9c0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.822+0000 7fcbd99b6640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcbb806a430 0x7fcbb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:21.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.823+0000 7fcbd99b6640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcbb806a430 0x7fcbb806c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0000f80 tx=0x7fcbd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:21.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:21.826+0000 7fcbca7fc640 1 -- 172.21.15.31:0/4082268174 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbc4054450 con 0x7fcbd40af9c0 2023-12-22T08:41:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.069+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fcbd4073a40 con 0x7fcbd40af9c0 2023-12-22T08:41:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.073+0000 7fcbca7fc640 1 -- 172.21.15.31:0/4082268174 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcbc4057a70 con 0x7fcbd40af9c0 2023-12-22T08:41:22.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcbb806a430 msgr2=0x7fcbb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcbb806a430 0x7fcbb806c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0000f80 tx=0x7fcbd0009040 comp rx=0 tx=0).stop 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd40af9c0 msgr2=0x7fcbd40afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd40af9c0 0x7fcbd40afe20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400b5c0 tx=0x7fcbc400ba80 comp rx=0 tx=0).stop 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 shutdown_connections 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fcbb806a430 0x7fcbb806c8f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbd41dfe50 0x7fcbd41e02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbd40af9c0 0x7fcbd40afe20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 --2- 172.21.15.31:0/4082268174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbc0005180 0x7fcbd4144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 >> 172.21.15.31:0/4082268174 conn(0x7fcbd40c03d0 msgr2=0x7fcbd40bb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 shutdown_connections 2023-12-22T08:41:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.075+0000 7fcbdbc1a640 1 -- 172.21.15.31:0/4082268174 wait complete. 2023-12-22T08:41:22.088 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-22T08:41:22.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.192+0000 7fd649a7a640 1 Processor -- start 2023-12-22T08:41:22.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.192+0000 7fd649a7a640 1 -- start start 2023-12-22T08:41:22.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd649a7a640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd644144dd0 0x7fd64414e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd649a7a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64414ef70 con 0x7fd6440b7fb0 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd649a7a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440b6d30 con 0x7fd6440b8ec0 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd649a7a640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6440b9a20 con 0x7fd644144dd0 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd642ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd6440b7fb0 0x7fd6440b87b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36424/0 (socket says 172.21.15.31:36424) 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd642ffd640 1 -- 172.21.15.31:0/4119881443 learned_addr learned my addr 172.21.15.31:0/4119881443 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986718708 0 0) 0x7fd64414ef70 con 0x7fd6440b7fb0 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd6437fe640 1 --2- 172.21.15.31:0/4119881443 >> v2:172.21.15.69:3300/0 conn(0x7fd644144dd0 0x7fd64414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.193+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd62c003520 con 0x7fd6440b7fb0 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2364928530 0 0) 0x7fd62c003520 con 0x7fd6440b7fb0 2023-12-22T08:41:22.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 >> v2:172.21.15.69:3300/0 conn(0x7fd644144dd0 msgr2=0x7fd64414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 --2- 172.21.15.31:0/4119881443 >> v2:172.21.15.69:3300/0 conn(0x7fd644144dd0 0x7fd64414e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 >> v1:172.21.15.69:6789/0 conn(0x7fd6440b8ec0 legacy=0x7fd6441554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440bca70 con 0x7fd6440b7fb0 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7fd638001670 con 0x7fd6440b7fb0 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 >> v1:172.21.15.31:6789/0 conn(0x7fd6440b7fb0 legacy=0x7fd6440b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd62c0039c0 0x7fd62c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd62c0047c0 0x7fd62c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd62c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c00c030 con 0x7fd62c005180 2023-12-22T08:41:22.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c00c1a0 con 0x7fd62c0047c0 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c00c360 con 0x7fd62c0039c0 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd643fff640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd62c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd642ffd640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd62c0047c0 0x7fd62c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd6437fe640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd62c0039c0 0x7fd62c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd643fff640 1 -- 172.21.15.31:0/4119881443 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd62c0039c0 msgr2=0x7fd62c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd643fff640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd62c0039c0 0x7fd62c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd643fff640 1 -- 172.21.15.31:0/4119881443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd62c0047c0 msgr2=0x7fd62c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd643fff640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd62c0047c0 0x7fd62c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.194+0000 7fd643fff640 1 -- 172.21.15.31:0/4119881443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c003520 con 0x7fd62c005180 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.195+0000 7fd643fff640 1 -- 172.21.15.31:0/4119881443 reap_dead start 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.195+0000 7fd643fff640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd62c00b980 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd63c001e50 tx=0x7fd62c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0b54813b8888a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.195+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c003b70 con 0x7fd62c005180 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.195+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c003d10 con 0x7fd62c005180 2023-12-22T08:41:22.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.195+0000 7fd6427fc640 1 -- 172.21.15.31:0/4119881443 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c005310 con 0x7fd62c005180 2023-12-22T08:41:22.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.196+0000 7fd649a7a640 1 -- 172.21.15.31:0/4119881443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 msgr2=0x7fd62c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.196+0000 7fd649a7a640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd62c00b980 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd63c001e50 tx=0x7fd62c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.196+0000 7fd649a7a640 1 -- 172.21.15.31:0/4119881443 shutdown_connections 2023-12-22T08:41:22.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.196+0000 7fd649a7a640 1 --2- 172.21.15.31:0/4119881443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd62c00b980 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.196+0000 7fd649a7a640 1 -- 172.21.15.31:0/4119881443 >> 172.21.15.31:0/4119881443 conn(0x7fd6440c03d0 msgr2=0x7fd6440c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:22.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.196+0000 7fd649a7a640 1 -- 172.21.15.31:0/4119881443 shutdown_connections 2023-12-22T08:41:22.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.196+0000 7fd649a7a640 1 -- 172.21.15.31:0/4119881443 wait complete. 2023-12-22T08:41:22.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.197+0000 7fd649a7a640 1 Processor -- start 2023-12-22T08:41:22.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.197+0000 7fd649a7a640 1 -- start start 2023-12-22T08:41:22.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd649a7a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd64414a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd649a7a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd644148d30 0x7fd64414d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd649a7a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6441dfd40 0x7fd6440aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd649a7a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64414aa10 con 0x7fd62c005180 2023-12-22T08:41:22.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd649a7a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64414d840 con 0x7fd6441dfd40 2023-12-22T08:41:22.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd649a7a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd644149450 con 0x7fd644148d30 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd64414a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd64414a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54516/0 (socket says 172.21.15.31:54516) 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 -- 172.21.15.31:0/4029833501 learned_addr learned my addr 172.21.15.31:0/4029833501 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd643fff640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6441dfd40 0x7fd6440aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd642ffd640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd644148d30 0x7fd64414d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 -- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd644148d30 msgr2=0x7fd64414d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd644148d30 0x7fd64414d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 -- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6441dfd40 msgr2=0x7fd6440aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6441dfd40 0x7fd6440aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 -- 172.21.15.31:0/4029833501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64414a120 con 0x7fd62c005180 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd642ffd640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd644148d30 0x7fd64414d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.198+0000 7fd6437fe640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd64414a4d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd634011910 tx=0x7fd634011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.199+0000 7fd62bfff640 1 -- 172.21.15.31:0/4029833501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63400fa90 con 0x7fd62c005180 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.199+0000 7fd62bfff640 1 -- 172.21.15.31:0/4029833501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63400fbf0 con 0x7fd62c005180 2023-12-22T08:41:22.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.199+0000 7fd62bfff640 1 -- 172.21.15.31:0/4029833501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634014440 con 0x7fd62c005180 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.199+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6440bfe20 con 0x7fd62c005180 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.199+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd644148530 con 0x7fd62c005180 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.200+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd644073a40 con 0x7fd62c005180 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.200+0000 7fd62bfff640 1 -- 172.21.15.31:0/4029833501 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6340145a0 con 0x7fd62c005180 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.201+0000 7fd62bfff640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd63006a480 0x7fd63006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.201+0000 7fd62bfff640 1 -- 172.21.15.31:0/4029833501 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd634088c40 con 0x7fd62c005180 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.201+0000 7fd642ffd640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd63006a480 0x7fd63006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.201+0000 7fd642ffd640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd63006a480 0x7fd63006c940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd638001050 tx=0x7fd638009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.205+0000 7fd62bfff640 1 -- 172.21.15.31:0/4029833501 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6340546f0 con 0x7fd62c005180 2023-12-22T08:41:22.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.446+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd64414e940 con 0x7fd62c005180 2023-12-22T08:41:22.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.450+0000 7fd62bfff640 1 -- 172.21.15.31:0/4029833501 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd634057d10 con 0x7fd62c005180 2023-12-22T08:41:22.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.451+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd63006a480 msgr2=0x7fd63006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.451+0000 7fd649a7a640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd63006a480 0x7fd63006c940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd638001050 tx=0x7fd638009040 comp rx=0 tx=0).stop 2023-12-22T08:41:22.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.451+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 msgr2=0x7fd64414a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.451+0000 7fd649a7a640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd64414a4d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd634011910 tx=0x7fd634011dd0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.452+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 shutdown_connections 2023-12-22T08:41:22.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.452+0000 7fd649a7a640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fd63006a480 0x7fd63006c940 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.452+0000 7fd649a7a640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6441dfd40 0x7fd6440aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.452+0000 7fd649a7a640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd644148d30 0x7fd64414d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.452+0000 7fd649a7a640 1 --2- 172.21.15.31:0/4029833501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c005180 0x7fd64414a4d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.452+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 >> 172.21.15.31:0/4029833501 conn(0x7fd6440c03d0 msgr2=0x7fd6440bf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.452+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 shutdown_connections 2023-12-22T08:41:22.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.452+0000 7fd649a7a640 1 -- 172.21.15.31:0/4029833501 wait complete. 2023-12-22T08:41:22.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-22T08:41:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.569+0000 7fbc6be5f640 1 Processor -- start 2023-12-22T08:41:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.569+0000 7fbc6be5f640 1 -- start start 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6be5f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc640b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6be5f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbc640b8cf0 0x7fbc641554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6be5f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6414ef70 con 0x7fbc64144dd0 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6be5f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc640b9a20 con 0x7fbc640b8cf0 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6be5f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc640b9180 con 0x7fbc640b7fb0 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6a3fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbc640b8cf0 0x7fbc641554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6a3fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbc640b8cf0 0x7fbc641554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54518/0 (socket says 172.21.15.31:54518) 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6a3fc640 1 -- 172.21.15.31:0/1902819707 learned_addr learned my addr 172.21.15.31:0/1902819707 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc693fa640 1 --2- 172.21.15.31:0/1902819707 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc640b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6a3fc640 1 -- 172.21.15.31:0/1902819707 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 msgr2=0x7fbc640b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6a3fc640 1 --2- 172.21.15.31:0/1902819707 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc640b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6a3fc640 1 -- 172.21.15.31:0/1902819707 >> v1:172.21.15.69:6789/0 conn(0x7fbc64144dd0 legacy=0x7fbc6414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.570+0000 7fbc6a3fc640 1 -- 172.21.15.31:0/1902819707 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc640b6d30 con 0x7fbc640b8cf0 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.571+0000 7fbc6a3fc640 1 --2- 172.21.15.31:0/1902819707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641554c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009e50 tx=0x7fbc5c02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de46a6a9e7b89fa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.571+0000 7fbc68bf9640 1 -- 172.21.15.31:0/1902819707 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c02cb90 con 0x7fbc640b8cf0 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.571+0000 7fbc68bf9640 1 -- 172.21.15.31:0/1902819707 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c02ccf0 con 0x7fbc640b8cf0 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.571+0000 7fbc68bf9640 1 -- 172.21.15.31:0/1902819707 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c034610 con 0x7fbc640b8cf0 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.571+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1902819707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 msgr2=0x7fbc641554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.571+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1902819707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641554c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009e50 tx=0x7fbc5c02bff0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.572+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1902819707 shutdown_connections 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.572+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1902819707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641554c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.572+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1902819707 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc640b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.572+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1902819707 >> 172.21.15.31:0/1902819707 conn(0x7fbc640c03d0 msgr2=0x7fbc640c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.572+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1902819707 shutdown_connections 2023-12-22T08:41:22.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.572+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1902819707 wait complete. 2023-12-22T08:41:22.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc6be5f640 1 Processor -- start 2023-12-22T08:41:22.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc6be5f640 1 -- start start 2023-12-22T08:41:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc6be5f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc64145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc6be5f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641d7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc6be5f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc64144dd0 0x7fbc64146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc6be5f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc64145bc0 con 0x7fbc640b8cf0 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc6be5f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc641d6510 con 0x7fbc64144dd0 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc6be5f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc641d7bd0 con 0x7fbc640b7fb0 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc693fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641d7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc693fa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641d7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54534/0 (socket says 172.21.15.31:54534) 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.573+0000 7fbc693fa640 1 -- 172.21.15.31:0/1068494391 learned_addr learned my addr 172.21.15.31:0/1068494391 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc6a3fc640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc64144dd0 0x7fbc64146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc69bfb640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc64145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc693fa640 1 -- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 msgr2=0x7fbc64145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc693fa640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc64145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc693fa640 1 -- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc64144dd0 msgr2=0x7fbc64146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc693fa640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc64144dd0 0x7fbc64146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc693fa640 1 -- 172.21.15.31:0/1068494391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c009b30 con 0x7fbc640b8cf0 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc69bfb640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc64145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc693fa640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641d7200 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400d5f0 tx=0x7fbc5400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc5a7fc640 1 -- 172.21.15.31:0/1068494391 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540125f0 con 0x7fbc640b8cf0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc5a7fc640 1 -- 172.21.15.31:0/1068494391 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54012750 con 0x7fbc640b8cf0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc5a7fc640 1 -- 172.21.15.31:0/1068494391 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54012b00 con 0x7fbc640b8cf0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc641d6720 con 0x7fbc640b8cf0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.574+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc641d7740 con 0x7fbc640b8cf0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.575+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc640ba0c0 con 0x7fbc640b8cf0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.575+0000 7fbc5a7fc640 1 -- 172.21.15.31:0/1068494391 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbc54012c60 con 0x7fbc640b8cf0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.576+0000 7fbc5a7fc640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbc4806a460 0x7fbc4806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.576+0000 7fbc5a7fc640 1 -- 172.21.15.31:0/1068494391 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbc54088920 con 0x7fbc640b8cf0 2023-12-22T08:41:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.576+0000 7fbc69bfb640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbc4806a460 0x7fbc4806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.577+0000 7fbc69bfb640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbc4806a460 0x7fbc4806c920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc60007fd0 tx=0x7fbc60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.580+0000 7fbc5a7fc640 1 -- 172.21.15.31:0/1068494391 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbc540542f0 con 0x7fbc640b8cf0 2023-12-22T08:41:22.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.830+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fbc64073a40 con 0x7fbc640b8cf0 2023-12-22T08:41:22.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.833+0000 7fbc5a7fc640 1 -- 172.21.15.31:0/1068494391 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbc54057910 con 0x7fbc640b8cf0 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbc4806a460 msgr2=0x7fbc4806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbc4806a460 0x7fbc4806c920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc60007fd0 tx=0x7fbc60009040 comp rx=0 tx=0).stop 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 msgr2=0x7fbc641d7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641d7200 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400d5f0 tx=0x7fbc5400dab0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 shutdown_connections 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbc4806a460 0x7fbc4806c920 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc64144dd0 0x7fbc64146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbc640b8cf0 0x7fbc641d7200 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 --2- 172.21.15.31:0/1068494391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc640b7fb0 0x7fbc64145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 >> 172.21.15.31:0/1068494391 conn(0x7fbc640c03d0 msgr2=0x7fbc640b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:22.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 shutdown_connections 2023-12-22T08:41:22.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.835+0000 7fbc6be5f640 1 -- 172.21.15.31:0/1068494391 wait complete. 2023-12-22T08:41:22.848 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-22T08:41:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.952+0000 7f9c5c670640 1 Processor -- start 2023-12-22T08:41:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.952+0000 7f9c5c670640 1 -- start start 2023-12-22T08:41:22.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5c670640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9c540b7fb0 0x7f9c540b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5c670640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c540b8cf0 0x7f9c541554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5c670640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5414ef70 con 0x7f9c54144dd0 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5c670640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c540b9a20 con 0x7f9c540b8cf0 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5c670640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c540b6d30 con 0x7f9c540b7fb0 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5ac0d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c540b8cf0 0x7f9c541554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5ac0d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c540b8cf0 0x7f9c541554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54542/0 (socket says 172.21.15.31:54542) 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5ac0d640 1 -- 172.21.15.31:0/3534704825 learned_addr learned my addr 172.21.15.31:0/3534704825 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c59c0b640 1 --2- 172.21.15.31:0/3534704825 >> v2:172.21.15.69:3300/0 conn(0x7f9c540b7fb0 0x7f9c540b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5ac0d640 1 -- 172.21.15.31:0/3534704825 >> v2:172.21.15.69:3300/0 conn(0x7f9c540b7fb0 msgr2=0x7f9c540b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5ac0d640 1 --2- 172.21.15.31:0/3534704825 >> v2:172.21.15.69:3300/0 conn(0x7f9c540b7fb0 0x7f9c540b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5ac0d640 1 -- 172.21.15.31:0/3534704825 >> v1:172.21.15.69:6789/0 conn(0x7f9c54144dd0 legacy=0x7f9c5414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.953+0000 7f9c5ac0d640 1 -- 172.21.15.31:0/3534704825 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540b9120 con 0x7f9c540b8cf0 2023-12-22T08:41:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.954+0000 7f9c5ac0d640 1 --2- 172.21.15.31:0/3534704825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c541554c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9c540c1130 tx=0x7f9c4c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380e60870f8db8d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.954+0000 7f9c5940a640 1 -- 172.21.15.31:0/3534704825 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c02cbb0 con 0x7f9c540b8cf0 2023-12-22T08:41:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.954+0000 7f9c5940a640 1 -- 172.21.15.31:0/3534704825 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c02cd10 con 0x7f9c540b8cf0 2023-12-22T08:41:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.954+0000 7f9c5940a640 1 -- 172.21.15.31:0/3534704825 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c034610 con 0x7f9c540b8cf0 2023-12-22T08:41:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.955+0000 7f9c5c670640 1 -- 172.21.15.31:0/3534704825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 msgr2=0x7f9c541554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.955+0000 7f9c5c670640 1 --2- 172.21.15.31:0/3534704825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c541554c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9c540c1130 tx=0x7f9c4c02c010 comp rx=0 tx=0).stop 2023-12-22T08:41:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.955+0000 7f9c5c670640 1 -- 172.21.15.31:0/3534704825 shutdown_connections 2023-12-22T08:41:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.955+0000 7f9c5c670640 1 --2- 172.21.15.31:0/3534704825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c541554c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.955+0000 7f9c5c670640 1 --2- 172.21.15.31:0/3534704825 >> v2:172.21.15.69:3300/0 conn(0x7f9c540b7fb0 0x7f9c540b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.955+0000 7f9c5c670640 1 -- 172.21.15.31:0/3534704825 >> 172.21.15.31:0/3534704825 conn(0x7f9c540c03d0 msgr2=0x7f9c540c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.955+0000 7f9c5c670640 1 -- 172.21.15.31:0/3534704825 shutdown_connections 2023-12-22T08:41:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.955+0000 7f9c5c670640 1 -- 172.21.15.31:0/3534704825 wait complete. 2023-12-22T08:41:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c5c670640 1 Processor -- start 2023-12-22T08:41:22.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c5c670640 1 -- start start 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c5c670640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c540b7fb0 0x7f9c54147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c5c670640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c54148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c5c670640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c54144dd0 0x7f9c540afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c5c670640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54149980 con 0x7f9c540b8cf0 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c5c670640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54148090 con 0x7f9c540b7fb0 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c5c670640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5414a640 con 0x7f9c54144dd0 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c59c0b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c54148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c59c0b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c54148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54556/0 (socket says 172.21.15.31:54556) 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.956+0000 7f9c59c0b640 1 -- 172.21.15.31:0/1389965021 learned_addr learned my addr 172.21.15.31:0/1389965021 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c59c0b640 1 -- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c54144dd0 msgr2=0x7f9c540afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c59c0b640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c54144dd0 0x7f9c540afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c59c0b640 1 -- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c540b7fb0 msgr2=0x7f9c54147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c5a40c640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c540b7fb0 0x7f9c54147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c59c0b640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c540b7fb0 0x7f9c54147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c59c0b640 1 -- 172.21.15.31:0/1389965021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009b30 con 0x7f9c540b8cf0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c59c0b640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c54148dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400d800 tx=0x7f9c4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c4affd640 1 -- 172.21.15.31:0/1389965021 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400b6c0 con 0x7f9c540b8cf0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c4affd640 1 -- 172.21.15.31:0/1389965021 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4400b820 con 0x7f9c540b8cf0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5414afe0 con 0x7f9c540b8cf0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c4affd640 1 -- 172.21.15.31:0/1389965021 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400bbb0 con 0x7f9c540b8cf0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.957+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c54144250 con 0x7f9c540b8cf0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.958+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c54066e00 con 0x7f9c540b8cf0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.958+0000 7f9c4affd640 1 -- 172.21.15.31:0/1389965021 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c4400bd10 con 0x7f9c540b8cf0 2023-12-22T08:41:22.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.959+0000 7f9c4affd640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c3806a430 0x7f9c3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:22.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.959+0000 7f9c4affd640 1 -- 172.21.15.31:0/1389965021 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c44088a80 con 0x7f9c540b8cf0 2023-12-22T08:41:22.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.959+0000 7f9c5a40c640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c3806a430 0x7f9c3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:22.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.960+0000 7f9c5a40c640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c3806a430 0x7f9c3806c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c50000f60 tx=0x7f9c50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:22.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:22.963+0000 7f9c4affd640 1 -- 172.21.15.31:0/1389965021 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c44054450 con 0x7f9c540b8cf0 2023-12-22T08:41:23.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.204+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f9c54144410 con 0x7f9c540b8cf0 2023-12-22T08:41:23.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.208+0000 7f9c4affd640 1 -- 172.21.15.31:0/1389965021 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9c44057a70 con 0x7f9c540b8cf0 2023-12-22T08:41:23.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c3806a430 msgr2=0x7f9c3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c3806a430 0x7f9c3806c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c50000f60 tx=0x7f9c50009040 comp rx=0 tx=0).stop 2023-12-22T08:41:23.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 msgr2=0x7f9c54148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c54148dd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400d800 tx=0x7f9c4400dcc0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 shutdown_connections 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9c3806a430 0x7f9c3806c8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c54144dd0 0x7f9c540afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540b8cf0 0x7f9c54148dd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 --2- 172.21.15.31:0/1389965021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c540b7fb0 0x7f9c54147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 >> 172.21.15.31:0/1389965021 conn(0x7f9c540c03d0 msgr2=0x7f9c540b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 shutdown_connections 2023-12-22T08:41:23.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.210+0000 7f9c5c670640 1 -- 172.21.15.31:0/1389965021 wait complete. 2023-12-22T08:41:23.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-22T08:41:23.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.328+0000 7f325fa31640 1 Processor -- start 2023-12-22T08:41:23.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.328+0000 7f325fa31640 1 -- start start 2023-12-22T08:41:23.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325fa31640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f325806ecb0 0x7f3258070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325fa31640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f32580711f0 0x7f3258141760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325fa31640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32580716b0 con 0x7f325806a390 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325fa31640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3258147e40 con 0x7f325806ecb0 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325fa31640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32580b3660 con 0x7f32580711f0 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325cfcc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f325806ecb0 0x7f3258070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325cfcc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f325806ecb0 0x7f3258070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54558/0 (socket says 172.21.15.31:54558) 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325cfcc640 1 -- 172.21.15.31:0/1477988883 learned_addr learned my addr 172.21.15.31:0/1477988883 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325d7cd640 1 --1- 172.21.15.31:0/1477988883 >> v1:172.21.15.31:6789/0 conn(0x7f325806a390 0x7f3258148260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36430/0 (socket says 172.21.15.31:36430) 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325dfce640 1 --2- 172.21.15.31:0/1477988883 >> v2:172.21.15.69:3300/0 conn(0x7f32580711f0 0x7f3258141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325cfcc640 1 -- 172.21.15.31:0/1477988883 >> v2:172.21.15.69:3300/0 conn(0x7f32580711f0 msgr2=0x7f3258141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325cfcc640 1 --2- 172.21.15.31:0/1477988883 >> v2:172.21.15.69:3300/0 conn(0x7f32580711f0 0x7f3258141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325cfcc640 1 -- 172.21.15.31:0/1477988883 >> v1:172.21.15.31:6789/0 conn(0x7f325806a390 legacy=0x7f3258148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f324ffff640 1 -- 172.21.15.31:0/1477988883 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286721881 0 0) 0x7f32580716b0 con 0x7f325806a390 2023-12-22T08:41:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.329+0000 7f325cfcc640 1 -- 172.21.15.31:0/1477988883 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258147a60 con 0x7f325806ecb0 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f325cfcc640 1 --2- 172.21.15.31:0/1477988883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806ecb0 0x7f3258070cb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f32580b80c0 tx=0x7f324802e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d46c7406e6d62e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f324ffff640 1 -- 172.21.15.31:0/1477988883 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248036440 con 0x7f325806ecb0 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f324ffff640 1 -- 172.21.15.31:0/1477988883 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32480365a0 con 0x7f325806ecb0 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f324ffff640 1 -- 172.21.15.31:0/1477988883 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248036930 con 0x7f325806ecb0 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f325fa31640 1 -- 172.21.15.31:0/1477988883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806ecb0 msgr2=0x7f3258070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f325fa31640 1 --2- 172.21.15.31:0/1477988883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806ecb0 0x7f3258070cb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f32580b80c0 tx=0x7f324802e170 comp rx=0 tx=0).stop 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f325fa31640 1 -- 172.21.15.31:0/1477988883 shutdown_connections 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f325fa31640 1 --2- 172.21.15.31:0/1477988883 >> v2:172.21.15.69:3300/0 conn(0x7f32580711f0 0x7f3258141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f325fa31640 1 --2- 172.21.15.31:0/1477988883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806ecb0 0x7f3258070cb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.330+0000 7f325fa31640 1 -- 172.21.15.31:0/1477988883 >> 172.21.15.31:0/1477988883 conn(0x7f32580bc330 msgr2=0x7f32580bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:23.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.331+0000 7f325fa31640 1 -- 172.21.15.31:0/1477988883 shutdown_connections 2023-12-22T08:41:23.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.331+0000 7f325fa31640 1 -- 172.21.15.31:0/1477988883 wait complete. 2023-12-22T08:41:23.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325fa31640 1 Processor -- start 2023-12-22T08:41:23.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325fa31640 1 -- start start 2023-12-22T08:41:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325fa31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806a390 0x7f325813a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325fa31640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f325806ecb0 0x7f325814a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325fa31640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32580711f0 0x7f32581e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325fa31640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325813ab30 con 0x7f325806a390 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325fa31640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3258149bd0 con 0x7f32580711f0 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325fa31640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3258147520 con 0x7f325806ecb0 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325d7cd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806a390 0x7f325813a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325d7cd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806a390 0x7f325813a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54562/0 (socket says 172.21.15.31:54562) 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.332+0000 7f325d7cd640 1 -- 172.21.15.31:0/3401268458 learned_addr learned my addr 172.21.15.31:0/3401268458 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325dfce640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32580711f0 0x7f32581e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325d7cd640 1 -- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f325806ecb0 msgr2=0x7f325814a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325d7cd640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f325806ecb0 0x7f325814a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325d7cd640 1 -- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32580711f0 msgr2=0x7f32581e3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325d7cd640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32580711f0 0x7f32581e3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325d7cd640 1 -- 172.21.15.31:0/3401268458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324800b770 con 0x7f325806a390 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325d7cd640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806a390 0x7f325813a5f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f325400c4d0 tx=0x7f325400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:23.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f324dffb640 1 -- 172.21.15.31:0/3401268458 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32540074e0 con 0x7f325806a390 2023-12-22T08:41:23.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f324dffb640 1 -- 172.21.15.31:0/3401268458 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254007640 con 0x7f325806a390 2023-12-22T08:41:23.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f324dffb640 1 -- 172.21.15.31:0/3401268458 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254004a20 con 0x7f325806a390 2023-12-22T08:41:23.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3258071c60 con 0x7f325806a390 2023-12-22T08:41:23.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.333+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3258149e70 con 0x7f325806a390 2023-12-22T08:41:23.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.334+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325814a060 con 0x7f325806a390 2023-12-22T08:41:23.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.335+0000 7f324dffb640 1 -- 172.21.15.31:0/3401268458 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3254004b80 con 0x7f325806a390 2023-12-22T08:41:23.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.335+0000 7f324dffb640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f323c06a460 0x7f323c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.335+0000 7f324dffb640 1 -- 172.21.15.31:0/3401268458 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3254087740 con 0x7f325806a390 2023-12-22T08:41:23.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.335+0000 7f325cfcc640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f323c06a460 0x7f323c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.336+0000 7f325cfcc640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f323c06a460 0x7f323c06c920 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3248038000 tx=0x7f3248030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:23.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.339+0000 7f324dffb640 1 -- 172.21.15.31:0/3401268458 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3254053110 con 0x7f325806a390 2023-12-22T08:41:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.585+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f3258073a40 con 0x7f325806a390 2023-12-22T08:41:23.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.588+0000 7f324dffb640 1 -- 172.21.15.31:0/3401268458 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f32540180a0 con 0x7f325806a390 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f323c06a460 msgr2=0x7f323c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f323c06a460 0x7f323c06c920 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3248038000 tx=0x7f3248030000 comp rx=0 tx=0).stop 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806a390 msgr2=0x7f325813a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806a390 0x7f325813a5f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f325400c4d0 tx=0x7f325400c990 comp rx=0 tx=0).stop 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 shutdown_connections 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f323c06a460 0x7f323c06c920 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32580711f0 0x7f32581e3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f325806ecb0 0x7f325814a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 --2- 172.21.15.31:0/3401268458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f325806a390 0x7f325813a5f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 >> 172.21.15.31:0/3401268458 conn(0x7f32580bc330 msgr2=0x7f3258070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:23.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 shutdown_connections 2023-12-22T08:41:23.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.590+0000 7f325fa31640 1 -- 172.21.15.31:0/3401268458 wait complete. 2023-12-22T08:41:23.603 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:23.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.706+0000 7fa7f4681640 1 Processor -- start 2023-12-22T08:41:23.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.706+0000 7fa7f4681640 1 -- start start 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f4681640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa7ec142db0 0x7fa7ec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f4681640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06ad10 0x7fa7ec0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f4681640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec0b3d20 con 0x7fa7ec06b150 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f4681640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0b3f70 con 0x7fa7ec142db0 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f4681640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0b4250 con 0x7fa7ec06ad10 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f2c1e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa7ec06b150 0x7fa7ec14bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36444/0 (socket says 172.21.15.31:36444) 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f2c1e640 1 -- 172.21.15.31:0/2102644545 learned_addr learned my addr 172.21.15.31:0/2102644545 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f241d640 1 --2- 172.21.15.31:0/2102644545 >> v2:172.21.15.69:3300/0 conn(0x7fa7ec142db0 0x7fa7ec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f1c1c640 1 --2- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06ad10 0x7fa7ec0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f141b640 1 -- 172.21.15.31:0/2102644545 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751939773 0 0) 0x7fa7ec0b3d20 con 0x7fa7ec06b150 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.707+0000 7fa7f141b640 1 -- 172.21.15.31:0/2102644545 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d4003520 con 0x7fa7ec06b150 2023-12-22T08:41:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.708+0000 7fa7f241d640 1 -- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06ad10 msgr2=0x7fa7ec0b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.708+0000 7fa7f241d640 1 --2- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06ad10 0x7fa7ec0b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.708+0000 7fa7f241d640 1 -- 172.21.15.31:0/2102644545 >> v1:172.21.15.31:6789/0 conn(0x7fa7ec06b150 legacy=0x7fa7ec14bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.708+0000 7fa7f141b640 1 -- 172.21.15.31:0/2102644545 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3336618747 0 0) 0x7fa7d4003520 con 0x7fa7ec06b150 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.708+0000 7fa7f241d640 1 -- 172.21.15.31:0/2102644545 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0b5c80 con 0x7fa7ec142db0 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.708+0000 7fa7f1c1c640 1 --2- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06ad10 0x7fa7ec0b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.708+0000 7fa7f241d640 1 --2- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 0x7fa7ec0b8a20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40097a0 tx=0x7fa7e402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37839e1e65f60c8f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f141b640 1 -- 172.21.15.31:0/2102644545 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc0019f0 con 0x7fa7ec142db0 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f141b640 1 -- 172.21.15.31:0/2102644545 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e402e050 con 0x7fa7ec142db0 2023-12-22T08:41:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f141b640 1 -- 172.21.15.31:0/2102644545 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4030710 con 0x7fa7ec142db0 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f4681640 1 -- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 msgr2=0x7fa7ec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f4681640 1 --2- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 0x7fa7ec0b8a20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40097a0 tx=0x7fa7e402b790 comp rx=0 tx=0).stop 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f4681640 1 -- 172.21.15.31:0/2102644545 shutdown_connections 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f4681640 1 --2- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06ad10 0x7fa7ec0b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f4681640 1 --2- 172.21.15.31:0/2102644545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 0x7fa7ec0b8a20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f4681640 1 -- 172.21.15.31:0/2102644545 >> 172.21.15.31:0/2102644545 conn(0x7fa7ec0b9250 msgr2=0x7fa7ec0b9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f4681640 1 -- 172.21.15.31:0/2102644545 shutdown_connections 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.709+0000 7fa7f4681640 1 -- 172.21.15.31:0/2102644545 wait complete. 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.710+0000 7fa7f4681640 1 Processor -- start 2023-12-22T08:41:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.710+0000 7fa7f4681640 1 -- start start 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f4681640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7ec06ad10 0x7fa7ec144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f4681640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06b150 0x7fa7ec1457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f4681640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 0x7fa7ec1de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f4681640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec1435b0 con 0x7fa7ec06ad10 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f4681640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec143890 con 0x7fa7ec142db0 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f4681640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec143b70 con 0x7fa7ec06b150 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f241d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7ec06ad10 0x7fa7ec144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f241d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7ec06ad10 0x7fa7ec144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54576/0 (socket says 172.21.15.31:54576) 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f241d640 1 -- 172.21.15.31:0/709315623 learned_addr learned my addr 172.21.15.31:0/709315623 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f2c1e640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 0x7fa7ec1de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f241d640 1 -- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06b150 msgr2=0x7fa7ec1457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f241d640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06b150 0x7fa7ec1457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f241d640 1 -- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 msgr2=0x7fa7ec1de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f241d640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 0x7fa7ec1de3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.711+0000 7fa7f241d640 1 -- 172.21.15.31:0/709315623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009400 con 0x7fa7ec06ad10 2023-12-22T08:41:23.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.712+0000 7fa7f241d640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7ec06ad10 0x7fa7ec144670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4000c00 tx=0x7fa7e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:23.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.712+0000 7fa7eaffd640 1 -- 172.21.15.31:0/709315623 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e403c620 con 0x7fa7ec06ad10 2023-12-22T08:41:23.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.712+0000 7fa7eaffd640 1 -- 172.21.15.31:0/709315623 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e403c7a0 con 0x7fa7ec06ad10 2023-12-22T08:41:23.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.712+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e4009400 con 0x7fa7ec06ad10 2023-12-22T08:41:23.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.712+0000 7fa7eaffd640 1 -- 172.21.15.31:0/709315623 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e403cb50 con 0x7fa7ec06ad10 2023-12-22T08:41:23.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.712+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec1405e0 con 0x7fa7ec06ad10 2023-12-22T08:41:23.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.713+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec073a40 con 0x7fa7ec06ad10 2023-12-22T08:41:23.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.713+0000 7fa7eaffd640 1 -- 172.21.15.31:0/709315623 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7e4039070 con 0x7fa7ec06ad10 2023-12-22T08:41:23.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.713+0000 7fa7eaffd640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7d806a430 0x7fa7d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:23.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.714+0000 7fa7eaffd640 1 -- 172.21.15.31:0/709315623 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7e40a9ce0 con 0x7fa7ec06ad10 2023-12-22T08:41:23.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.714+0000 7fa7f1c1c640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7d806a430 0x7fa7d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:23.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.714+0000 7fa7f1c1c640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7d806a430 0x7fa7d806c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0006e80 tx=0x7fa7e0006dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:23.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.718+0000 7fa7eaffd640 1 -- 172.21.15.31:0/709315623 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa7e4075630 con 0x7fa7ec06ad10 2023-12-22T08:41:23.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.895+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7ec1436f0 con 0x7fa7ec06ad10 2023-12-22T08:41:23.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.896+0000 7fa7eaffd640 1 -- 172.21.15.31:0/709315623 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12437 (secure 0 0 0) 0x7fa7ec1436f0 con 0x7fa7ec06ad10 2023-12-22T08:41:23.898 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:23.898 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:41:20.924015+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:23.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.897+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7d806a430 msgr2=0x7fa7d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.897+0000 7fa7f4681640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7d806a430 0x7fa7d806c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0006e80 tx=0x7fa7e0006dd0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.897+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7ec06ad10 msgr2=0x7fa7ec144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:23.900 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.897+0000 7fa7f4681640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7ec06ad10 0x7fa7ec144670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4000c00 tx=0x7fa7e40046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.898+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 shutdown_connections 2023-12-22T08:41:23.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.898+0000 7fa7f4681640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa7d806a430 0x7fa7d806c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.898+0000 7fa7f4681640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7ec142db0 0x7fa7ec1de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.898+0000 7fa7f4681640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7ec06b150 0x7fa7ec1457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.898+0000 7fa7f4681640 1 --2- 172.21.15.31:0/709315623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7ec06ad10 0x7fa7ec144670 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:23.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.898+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 >> 172.21.15.31:0/709315623 conn(0x7fa7ec0b9250 msgr2=0x7fa7ec148a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:23.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.898+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 shutdown_connections 2023-12-22T08:41:23.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:23.898+0000 7fa7f4681640 1 -- 172.21.15.31:0/709315623 wait complete. 2023-12-22T08:41:23.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:23.911 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:24.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.017+0000 7f18b4cd5640 1 Processor -- start 2023-12-22T08:41:24.020 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.017+0000 7f18b4cd5640 1 -- start start 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18b4cd5640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f18b0144d80 0x7f18b00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18b4cd5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b00b77d0 0x7f18b014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18b4cd5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b014ab10 con 0x7f18b00b8690 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18b4cd5640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b006c2f0 con 0x7f18b0144d80 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18b4cd5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00ba620 con 0x7f18b00b77d0 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18ae59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f18b00b8690 0x7f18b0144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36458/0 (socket says 172.21.15.31:36458) 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18ae59c640 1 -- 172.21.15.31:0/1726681352 learned_addr learned my addr 172.21.15.31:0/1726681352 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:24.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18aed9d640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b00b77d0 0x7f18b014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18add9b640 1 --2- 172.21.15.31:0/1726681352 >> v2:172.21.15.69:3300/0 conn(0x7f18b0144d80 0x7f18b00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581474630 0 0) 0x7f18b014ab10 con 0x7f18b00b8690 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.018+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f189c003520 con 0x7f18b00b8690 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1307920849 0 0) 0x7f189c003520 con 0x7f18b00b8690 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b00b77d0 msgr2=0x7f18b014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b00b77d0 0x7f18b014afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 >> v2:172.21.15.69:3300/0 conn(0x7f18b0144d80 msgr2=0x7f18b00b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 --2- 172.21.15.31:0/1726681352 >> v2:172.21.15.69:3300/0 conn(0x7f18b0144d80 0x7f18b00b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b00b9e60 con 0x7f18b00b8690 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f18a8001670 con 0x7f18b00b8690 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 >> v1:172.21.15.31:6789/0 conn(0x7f18b00b8690 legacy=0x7f18b0144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b00b77d0 0x7f189c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f189c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f189c004d00 0x7f189c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b006c2f0 con 0x7f189c003ef0 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00ba620 con 0x7f189c004d00 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c00b9d0 con 0x7f18b00b77d0 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18add9b640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f189c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18ae59c640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b00b77d0 0x7f189c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18aed9d640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f189c004d00 0x7f189c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18add9b640 1 -- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b00b77d0 msgr2=0x7f189c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18add9b640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b00b77d0 0x7f189c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18add9b640 1 -- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f189c004d00 msgr2=0x7f189c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18add9b640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f189c004d00 0x7f189c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.019+0000 7f18add9b640 1 -- 172.21.15.31:0/1726681352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c003520 con 0x7f189c003ef0 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.020+0000 7f18add9b640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f189c0047c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1898009af0 tx=0x7f189c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9158f8fd8b241269 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.020+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189802c710 con 0x7f189c003ef0 2023-12-22T08:41:24.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.020+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189802c870 con 0x7f189c003ef0 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.020+0000 7f18ad59a640 1 -- 172.21.15.31:0/1726681352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189802cc00 con 0x7f189c003ef0 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.020+0000 7f18b4cd5640 1 -- 172.21.15.31:0/1726681352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 msgr2=0x7f189c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.020+0000 7f18b4cd5640 1 --2- 172.21.15.31:0/1726681352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f189c0047c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1898009af0 tx=0x7f189c0057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.020+0000 7f18aed9d640 1 -- 172.21.15.31:0/1726681352 reap_dead start 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.021+0000 7f18b4cd5640 1 -- 172.21.15.31:0/1726681352 shutdown_connections 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.021+0000 7f18b4cd5640 1 -- 172.21.15.31:0/1726681352 >> 172.21.15.31:0/1726681352 conn(0x7f18b006b6a0 msgr2=0x7f18b006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.021+0000 7f18b4cd5640 1 -- 172.21.15.31:0/1726681352 shutdown_connections 2023-12-22T08:41:24.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.021+0000 7f18b4cd5640 1 -- 172.21.15.31:0/1726681352 wait complete. 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.022+0000 7f18b4cd5640 1 Processor -- start 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.022+0000 7f18b4cd5640 1 -- start start 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.022+0000 7f18b4cd5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f18b014a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.022+0000 7f18b4cd5640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b0149770 0x7f18b0148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.022+0000 7f18b4cd5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b0149bf0 0x7f18b0138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.022+0000 7f18b4cd5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b014a9f0 con 0x7f189c003ef0 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.022+0000 7f18b4cd5640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b0142430 con 0x7f18b0149770 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.022+0000 7f18b4cd5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b0147b80 con 0x7f18b0149bf0 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f18b014a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f18b014a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54584/0 (socket says 172.21.15.31:54584) 2023-12-22T08:41:24.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 -- 172.21.15.31:0/3758230303 learned_addr learned my addr 172.21.15.31:0/3758230303 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18add9b640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b0149770 0x7f18b0148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18aed9d640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b0149bf0 0x7f18b0138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 -- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b0149bf0 msgr2=0x7f18b0138d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b0149bf0 0x7f18b0138d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 -- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b0149770 msgr2=0x7f18b0148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b0149770 0x7f18b0148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 -- 172.21.15.31:0/3758230303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b0147e20 con 0x7f189c003ef0 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18add9b640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b0149770 0x7f18b0148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18ae59c640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f18b014a4b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f18a8007340 tx=0x7f18a8007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18a6ffd640 1 -- 172.21.15.31:0/3758230303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800f8c0 con 0x7f189c003ef0 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18a6ffd640 1 -- 172.21.15.31:0/3758230303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a800fa20 con 0x7f189c003ef0 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b0148f70 con 0x7f189c003ef0 2023-12-22T08:41:24.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18a6ffd640 1 -- 172.21.15.31:0/3758230303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800fdd0 con 0x7f189c003ef0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.023+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b0146a80 con 0x7f189c003ef0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.024+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b0073a40 con 0x7f189c003ef0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.025+0000 7f18a6ffd640 1 -- 172.21.15.31:0/3758230303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f18a801d460 con 0x7f189c003ef0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.025+0000 7f18a6ffd640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f189006a430 0x7f189006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.025+0000 7f18a6ffd640 1 -- 172.21.15.31:0/3758230303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f18a80887a0 con 0x7f189c003ef0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.025+0000 7f18add9b640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f189006a430 0x7f189006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.026+0000 7f18add9b640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f189006a430 0x7f189006c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1898036000 tx=0x7f1898030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.029+0000 7f18a6ffd640 1 -- 172.21.15.31:0/3758230303 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f18a8054230 con 0x7f189c003ef0 2023-12-22T08:41:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.204+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18b0142e20 con 0x7f189c003ef0 2023-12-22T08:41:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.204+0000 7f18a6ffd640 1 -- 172.21.15.31:0/3758230303 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18a8057850 con 0x7f189c003ef0 2023-12-22T08:41:24.207 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f189006a430 msgr2=0x7f189006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f189006a430 0x7f189006c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1898036000 tx=0x7f1898030000 comp rx=0 tx=0).stop 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 msgr2=0x7f18b014a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f18b014a4b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f18a8007340 tx=0x7f18a8007800 comp rx=0 tx=0).stop 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 shutdown_connections 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f189006a430 0x7f189006c8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18b0149bf0 0x7f18b0138d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b0149770 0x7f18b0148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 --2- 172.21.15.31:0/3758230303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189c003ef0 0x7f18b014a4b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 >> 172.21.15.31:0/3758230303 conn(0x7f18b006b6a0 msgr2=0x7f18b0143900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 shutdown_connections 2023-12-22T08:41:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.206+0000 7f18b4cd5640 1 -- 172.21.15.31:0/3758230303 wait complete. 2023-12-22T08:41:24.219 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T08:41:24.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.322+0000 7efd88d73640 1 Processor -- start 2023-12-22T08:41:24.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.322+0000 7efd88d73640 1 -- start start 2023-12-22T08:41:24.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.322+0000 7efd88d73640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efd8414aa00 0x7efd840bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd88d73640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd84140ef0 0x7efd84141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd88d73640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd841418c0 con 0x7efd840b79f0 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd88d73640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd840bbca0 con 0x7efd8414aa00 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd88d73640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd840bacc0 con 0x7efd84140ef0 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd8259c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efd840b79f0 0x7efd840b83a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36460/0 (socket says 172.21.15.31:36460) 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd8259c640 1 -- 172.21.15.31:0/609937777 learned_addr learned my addr 172.21.15.31:0/609937777 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd7bfff640 1 --2- 172.21.15.31:0/609937777 >> v2:172.21.15.69:3300/0 conn(0x7efd8414aa00 0x7efd840bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617273798 0 0) 0x7efd841418c0 con 0x7efd840b79f0 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd82d9d640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd84140ef0 0x7efd84141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd70003520 con 0x7efd840b79f0 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4226394782 0 0) 0x7efd70003520 con 0x7efd840b79f0 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd84140ef0 msgr2=0x7efd84141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd84140ef0 0x7efd84141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 >> v2:172.21.15.69:3300/0 conn(0x7efd8414aa00 msgr2=0x7efd840bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 --2- 172.21.15.31:0/609937777 >> v2:172.21.15.69:3300/0 conn(0x7efd8414aa00 0x7efd840bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840bbe60 con 0x7efd840b79f0 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7efd74001670 con 0x7efd840b79f0 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 >> v1:172.21.15.31:6789/0 conn(0x7efd840b79f0 legacy=0x7efd840b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd84140ef0 0x7efd70003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd70003f40 0x7efd700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd70004d00 0x7efd70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840bacc0 con 0x7efd70003f40 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7000b980 con 0x7efd70004d00 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7000bb40 con 0x7efd84140ef0 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd7bfff640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd70003f40 0x7efd700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd8259c640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd84140ef0 0x7efd70003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.323+0000 7efd82d9d640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd70004d00 0x7efd70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.324+0000 7efd7bfff640 1 -- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd84140ef0 msgr2=0x7efd70003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.324+0000 7efd7bfff640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd84140ef0 0x7efd70003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.324+0000 7efd7bfff640 1 -- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd70004d00 msgr2=0x7efd70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.324+0000 7efd7bfff640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd70004d00 0x7efd70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.324+0000 7efd7bfff640 1 -- 172.21.15.31:0/609937777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70003520 con 0x7efd70003f40 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.324+0000 7efd7bfff640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd70003f40 0x7efd700047c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009ac0 tx=0x7efd700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fd3caa3f3f7e56 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c02c710 con 0x7efd70003f40 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c02c870 con 0x7efd70003f40 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd81d9b640 1 -- 172.21.15.31:0/609937777 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c02cc00 con 0x7efd70003f40 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd88d73640 1 -- 172.21.15.31:0/609937777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd70003f40 msgr2=0x7efd700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd88d73640 1 --2- 172.21.15.31:0/609937777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd70003f40 0x7efd700047c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009ac0 tx=0x7efd700057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd82d9d640 1 -- 172.21.15.31:0/609937777 reap_dead start 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd88d73640 1 -- 172.21.15.31:0/609937777 shutdown_connections 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd88d73640 1 -- 172.21.15.31:0/609937777 >> 172.21.15.31:0/609937777 conn(0x7efd840c0340 msgr2=0x7efd840c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd88d73640 1 -- 172.21.15.31:0/609937777 shutdown_connections 2023-12-22T08:41:24.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.325+0000 7efd88d73640 1 -- 172.21.15.31:0/609937777 wait complete. 2023-12-22T08:41:24.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.326+0000 7efd88d73640 1 Processor -- start 2023-12-22T08:41:24.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.326+0000 7efd88d73640 1 -- start start 2023-12-22T08:41:24.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd88d73640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd70003f40 0x7efd841420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd88d73640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd84143b20 0x7efd841dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd88d73640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd84143fa0 0x7efd841e0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd88d73640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd841436d0 con 0x7efd84143b20 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd88d73640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84145500 con 0x7efd84143fa0 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd88d73640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd84149790 con 0x7efd70003f40 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd7bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd84143b20 0x7efd841dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd7bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd84143b20 0x7efd841dfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54598/0 (socket says 172.21.15.31:54598) 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd7bfff640 1 -- 172.21.15.31:0/2046453363 learned_addr learned my addr 172.21.15.31:0/2046453363 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd8259c640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd70003f40 0x7efd841420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd82d9d640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd84143fa0 0x7efd841e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd7bfff640 1 -- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd70003f40 msgr2=0x7efd841420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd7bfff640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd70003f40 0x7efd841420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd7bfff640 1 -- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd84143fa0 msgr2=0x7efd841e0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd7bfff640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd84143fa0 0x7efd841e0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.327+0000 7efd7bfff640 1 -- 172.21.15.31:0/2046453363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84149a70 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.328+0000 7efd7bfff640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd84143b20 0x7efd841dfbe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efd6c02c2b0 tx=0x7efd6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.328+0000 7efd7affd640 1 -- 172.21.15.31:0/2046453363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c003810 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.328+0000 7efd7affd640 1 -- 172.21.15.31:0/2046453363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c02de90 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.328+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd84149d50 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.328+0000 7efd7affd640 1 -- 172.21.15.31:0/2046453363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c003b70 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.328+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8414e740 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.329+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8414e8d0 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.329+0000 7efd7affd640 1 -- 172.21.15.31:0/2046453363 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd6c003cd0 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.329+0000 7efd7affd640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd6406a430 0x7efd6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.330+0000 7efd7affd640 1 -- 172.21.15.31:0/2046453363 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd6c0aa5e0 con 0x7efd84143b20 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.330+0000 7efd8259c640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd6406a430 0x7efd6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.330+0000 7efd8259c640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd6406a430 0x7efd6406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efd74000fb0 tx=0x7efd74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.334+0000 7efd7affd640 1 -- 172.21.15.31:0/2046453363 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd6c075e90 con 0x7efd84143b20 2023-12-22T08:41:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.513+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efd84073a40 con 0x7efd84143b20 2023-12-22T08:41:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.514+0000 7efd7affd640 1 -- 172.21.15.31:0/2046453363 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7efd6c0794b0 con 0x7efd84143b20 2023-12-22T08:41:24.516 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:24.516 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-12-22T08:41:24.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-12-22T08:41:24.517 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-12-22T08:41:24.517 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-12-22T08:41:24.517 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-12-22T08:41:24.517 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-12-22T08:41:24.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd6406a430 msgr2=0x7efd6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd6406a430 0x7efd6406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efd74000fb0 tx=0x7efd74009040 comp rx=0 tx=0).stop 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd84143b20 msgr2=0x7efd841dfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd84143b20 0x7efd841dfbe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efd6c02c2b0 tx=0x7efd6c004730 comp rx=0 tx=0).stop 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 shutdown_connections 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd6406a430 0x7efd6406c8f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd84143fa0 0x7efd841e0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd84143b20 0x7efd841dfbe0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 --2- 172.21.15.31:0/2046453363 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd70003f40 0x7efd841420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 >> 172.21.15.31:0/2046453363 conn(0x7efd840c0340 msgr2=0x7efd840bcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 shutdown_connections 2023-12-22T08:41:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.516+0000 7efd88d73640 1 -- 172.21.15.31:0/2046453363 wait complete. 2023-12-22T08:41:24.529 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T08:41:24.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-22T08:41:24.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.636+0000 7f6ae199f640 1 Processor -- start 2023-12-22T08:41:24.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.636+0000 7f6ae199f640 1 -- start start 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ae199f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6adc0a0cc0 0x7f6adc0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ae199f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc148a50 0x7f6adc0b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ae199f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc1498f0 con 0x7f6adc142f20 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ae199f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc0b37e0 con 0x7f6adc0a0cc0 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ae199f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc148fc0 con 0x7f6adc148a50 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ada7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6adc0a0cc0 0x7f6adc0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ada7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6adc0a0cc0 0x7f6adc0b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54604/0 (socket says 172.21.15.31:54604) 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ada7fc640 1 -- 172.21.15.31:0/3931927403 learned_addr learned my addr 172.21.15.31:0/3931927403 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6adb7fe640 1 --2- 172.21.15.31:0/3931927403 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc148a50 0x7f6adc0b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ada7fc640 1 -- 172.21.15.31:0/3931927403 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc148a50 msgr2=0x7f6adc0b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ada7fc640 1 --2- 172.21.15.31:0/3931927403 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc148a50 0x7f6adc0b92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.637+0000 7f6ada7fc640 1 -- 172.21.15.31:0/3931927403 >> v1:172.21.15.69:6789/0 conn(0x7f6adc142f20 legacy=0x7f6adc0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:24.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.638+0000 7f6ada7fc640 1 -- 172.21.15.31:0/3931927403 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc1492a0 con 0x7f6adc0a0cc0 2023-12-22T08:41:24.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.638+0000 7f6ada7fc640 1 --2- 172.21.15.31:0/3931927403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc0a0cc0 0x7f6adc0b8da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009870 tx=0x7f6ac402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf786363f3abb87f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.638+0000 7f6ad9ffb640 1 -- 172.21.15.31:0/3931927403 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac402f840 con 0x7f6adc0a0cc0 2023-12-22T08:41:24.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.638+0000 7f6ad9ffb640 1 -- 172.21.15.31:0/3931927403 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac402f9a0 con 0x7f6adc0a0cc0 2023-12-22T08:41:24.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ad9ffb640 1 -- 172.21.15.31:0/3931927403 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac402fd30 con 0x7f6adc0a0cc0 2023-12-22T08:41:24.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ae199f640 1 -- 172.21.15.31:0/3931927403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc0a0cc0 msgr2=0x7f6adc0b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ae199f640 1 --2- 172.21.15.31:0/3931927403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc0a0cc0 0x7f6adc0b8da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009870 tx=0x7f6ac402ba20 comp rx=0 tx=0).stop 2023-12-22T08:41:24.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ae199f640 1 -- 172.21.15.31:0/3931927403 shutdown_connections 2023-12-22T08:41:24.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ae199f640 1 --2- 172.21.15.31:0/3931927403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc0a0cc0 0x7f6adc0b8da0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ae199f640 1 --2- 172.21.15.31:0/3931927403 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc148a50 0x7f6adc0b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ae199f640 1 -- 172.21.15.31:0/3931927403 >> 172.21.15.31:0/3931927403 conn(0x7f6adc0be1e0 msgr2=0x7f6adc0be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:24.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ae199f640 1 -- 172.21.15.31:0/3931927403 shutdown_connections 2023-12-22T08:41:24.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.639+0000 7f6ae199f640 1 -- 172.21.15.31:0/3931927403 wait complete. 2023-12-22T08:41:24.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.640+0000 7f6ae199f640 1 Processor -- start 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.640+0000 7f6ae199f640 1 -- start start 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6ae199f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc0a0cc0 0x7f6adc0a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6ae199f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6adc142f20 0x7f6adc1e0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6ae199f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc148a50 0x7f6adc09fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6ae199f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0a33d0 con 0x7f6adc148a50 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6ae199f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc06c5a0 con 0x7f6adc142f20 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6ae199f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc06ca30 con 0x7f6adc0a0cc0 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc148a50 0x7f6adc09fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc148a50 0x7f6adc09fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54620/0 (socket says 172.21.15.31:54620) 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adb7fe640 1 -- 172.21.15.31:0/1937154820 learned_addr learned my addr 172.21.15.31:0/1937154820 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6ada7fc640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6adc142f20 0x7f6adc1e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adaffd640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc0a0cc0 0x7f6adc0a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adb7fe640 1 -- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc0a0cc0 msgr2=0x7f6adc0a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adb7fe640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc0a0cc0 0x7f6adc0a2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adb7fe640 1 -- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6adc142f20 msgr2=0x7f6adc1e0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adb7fe640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6adc142f20 0x7f6adc1e0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adb7fe640 1 -- 172.21.15.31:0/1937154820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40094d0 con 0x7f6adc148a50 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6ada7fc640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6adc142f20 0x7f6adc1e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.641+0000 7f6adaffd640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc0a0cc0 0x7f6adc0a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.642+0000 7f6adb7fe640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc148a50 0x7f6adc09fe70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c7c0 tx=0x7f6ad400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.642+0000 7f6ad3fff640 1 -- 172.21.15.31:0/1937154820 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4005be0 con 0x7f6adc148a50 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.642+0000 7f6ad3fff640 1 -- 172.21.15.31:0/1937154820 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4005d40 con 0x7f6adc148a50 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.642+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc0a1230 con 0x7f6adc148a50 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.642+0000 7f6ad3fff640 1 -- 172.21.15.31:0/1937154820 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4004260 con 0x7f6adc148a50 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.642+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0a1480 con 0x7f6adc148a50 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.643+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc066e90 con 0x7f6adc148a50 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.643+0000 7f6ad3fff640 1 -- 172.21.15.31:0/1937154820 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ad40043c0 con 0x7f6adc148a50 2023-12-22T08:41:24.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.644+0000 7f6ad3fff640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6abc06a430 0x7f6abc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:24.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.644+0000 7f6ad3fff640 1 -- 172.21.15.31:0/1937154820 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ad40885d0 con 0x7f6adc148a50 2023-12-22T08:41:24.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.644+0000 7f6adaffd640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6abc06a430 0x7f6abc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:24.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.644+0000 7f6adaffd640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6abc06a430 0x7f6abc06c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0012e0 tx=0x7f6acc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:24.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.648+0000 7f6ad3fff640 1 -- 172.21.15.31:0/1937154820 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6ad4054060 con 0x7f6adc148a50 2023-12-22T08:41:24.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:24.825+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6adc06c750 con 0x7f6adc148a50 2023-12-22T08:41:25.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.730+0000 7f6ad3fff640 1 -- 172.21.15.31:0/1937154820 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6adc06c750 con 0x7f6adc148a50 2023-12-22T08:41:25.732 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6abc06a430 msgr2=0x7f6abc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6abc06a430 0x7f6abc06c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0012e0 tx=0x7f6acc009040 comp rx=0 tx=0).stop 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc148a50 msgr2=0x7f6adc09fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc148a50 0x7f6adc09fe70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400c7c0 tx=0x7f6ad400cc80 comp rx=0 tx=0).stop 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 shutdown_connections 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6abc06a430 0x7f6abc06c8f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc148a50 0x7f6adc09fe70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6adc142f20 0x7f6adc1e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 --2- 172.21.15.31:0/1937154820 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6adc0a0cc0 0x7f6adc0a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 >> 172.21.15.31:0/1937154820 conn(0x7f6adc0be1e0 msgr2=0x7f6adc06e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 shutdown_connections 2023-12-22T08:41:25.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.735+0000 7f6ae199f640 1 -- 172.21.15.31:0/1937154820 wait complete. 2023-12-22T08:41:25.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T08:41:25.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.867+0000 7f1679087640 1 Processor -- start 2023-12-22T08:41:25.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.867+0000 7f1679087640 1 -- start start 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1679087640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16740b8690 0x7f16740b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1679087640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167414ab10 con 0x7f16740b77d0 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1679087640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167406c2f0 con 0x7f1674144d80 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1679087640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16740ba620 con 0x7f16740b8690 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1672d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16740b8690 0x7f16740b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f167259c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f16740b77d0 0x7f1674144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33620/0 (socket says 172.21.15.31:33620) 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1672d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16740b8690 0x7f16740b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34662/0 (socket says 172.21.15.31:34662) 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f167259c640 1 -- 172.21.15.31:0/3930055009 learned_addr learned my addr 172.21.15.31:0/3930055009 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1672d9d640 1 -- 172.21.15.31:0/3930055009 >> v1:172.21.15.69:6789/0 conn(0x7f1674144d80 legacy=0x7f167414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:25.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1672d9d640 1 -- 172.21.15.31:0/3930055009 >> v1:172.21.15.31:6789/0 conn(0x7f16740b77d0 legacy=0x7f1674144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.868+0000 7f1672d9d640 1 -- 172.21.15.31:0/3930055009 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740b9e60 con 0x7f16740b8690 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.869+0000 7f1672d9d640 1 --2- 172.21.15.31:0/3930055009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740b8a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f166c0097a0 tx=0x7f166c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effad9d2bbfd76a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.869+0000 7f1671d9b640 1 -- 172.21.15.31:0/3930055009 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c02e070 con 0x7f16740b8690 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.869+0000 7f1671d9b640 1 -- 172.21.15.31:0/3930055009 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c0315a0 con 0x7f16740b8690 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.869+0000 7f1671d9b640 1 -- 172.21.15.31:0/3930055009 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c031930 con 0x7f16740b8690 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.870+0000 7f1679087640 1 -- 172.21.15.31:0/3930055009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 msgr2=0x7f16740b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.870+0000 7f1679087640 1 --2- 172.21.15.31:0/3930055009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740b8a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f166c0097a0 tx=0x7f166c02b840 comp rx=0 tx=0).stop 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.870+0000 7f1679087640 1 -- 172.21.15.31:0/3930055009 shutdown_connections 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.870+0000 7f1679087640 1 --2- 172.21.15.31:0/3930055009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740b8a70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.870+0000 7f1679087640 1 -- 172.21.15.31:0/3930055009 >> 172.21.15.31:0/3930055009 conn(0x7f167406b6a0 msgr2=0x7f167406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.870+0000 7f1679087640 1 -- 172.21.15.31:0/3930055009 shutdown_connections 2023-12-22T08:41:25.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.870+0000 7f1679087640 1 -- 172.21.15.31:0/3930055009 wait complete. 2023-12-22T08:41:25.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.871+0000 7f1679087640 1 Processor -- start 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.871+0000 7f1679087640 1 -- start start 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f1679087640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16740b77d0 0x7f16741479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f1679087640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740bebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f1679087640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1674144d80 0x7f16741393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f1679087640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16740bf120 con 0x7f16740b8690 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f1679087640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1674145a50 con 0x7f1674144d80 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f1679087640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1674141c10 con 0x7f16740b77d0 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740bebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740bebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34674/0 (socket says 172.21.15.31:34674) 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 -- 172.21.15.31:0/2737626402 learned_addr learned my addr 172.21.15.31:0/2737626402 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f1672d9d640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16740b77d0 0x7f16741479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167359e640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1674144d80 0x7f16741393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 -- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16740b77d0 msgr2=0x7f16741479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16740b77d0 0x7f16741479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 -- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1674144d80 msgr2=0x7f16741393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1674144d80 0x7f16741393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 -- 172.21.15.31:0/2737626402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c009400 con 0x7f16740b8690 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167359e640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1674144d80 0x7f16741393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.872+0000 7f167259c640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740bebe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f166800c4d0 tx=0x7f166800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.873+0000 7f165b7fe640 1 -- 172.21.15.31:0/2737626402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668005ce0 con 0x7f16740b8690 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.873+0000 7f165b7fe640 1 -- 172.21.15.31:0/2737626402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668005e40 con 0x7f16740b8690 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.873+0000 7f165b7fe640 1 -- 172.21.15.31:0/2737626402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668007270 con 0x7f16740b8690 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.873+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16741480a0 con 0x7f16740b8690 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.873+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1674145400 con 0x7f16740b8690 2023-12-22T08:41:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.874+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1674145260 con 0x7f16740b8690 2023-12-22T08:41:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.874+0000 7f165b7fe640 1 -- 172.21.15.31:0/2737626402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f16680073d0 con 0x7f16740b8690 2023-12-22T08:41:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.875+0000 7f165b7fe640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166006a460 0x7f166006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.875+0000 7f165b7fe640 1 -- 172.21.15.31:0/2737626402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1668087b40 con 0x7f16740b8690 2023-12-22T08:41:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.875+0000 7f1672d9d640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166006a460 0x7f166006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.875+0000 7f1672d9d640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166006a460 0x7f166006c920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f166c036000 tx=0x7f166c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:25.879+0000 7f165b7fe640 1 -- 172.21.15.31:0/2737626402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1674145260 con 0x7f16740b8690 2023-12-22T08:41:26.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.056+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1674145260 con 0x7f16740b8690 2023-12-22T08:41:26.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.731+0000 7f165b7fe640 1 -- 172.21.15.31:0/2737626402 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1674145260 con 0x7f16740b8690 2023-12-22T08:41:26.736 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-12-22T08:41:26.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.739+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166006a460 msgr2=0x7f166006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.739+0000 7f1679087640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166006a460 0x7f166006c920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f166c036000 tx=0x7f166c03d040 comp rx=0 tx=0).stop 2023-12-22T08:41:26.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.739+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 msgr2=0x7f16740bebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.739+0000 7f1679087640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740bebe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f166800c4d0 tx=0x7f166800c990 comp rx=0 tx=0).stop 2023-12-22T08:41:26.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.740+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 shutdown_connections 2023-12-22T08:41:26.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.740+0000 7f1679087640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f166006a460 0x7f166006c920 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.740+0000 7f1679087640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1674144d80 0x7f16741393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.740+0000 7f1679087640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b8690 0x7f16740bebe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.740+0000 7f1679087640 1 --2- 172.21.15.31:0/2737626402 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16740b77d0 0x7f16741479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.741+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 >> 172.21.15.31:0/2737626402 conn(0x7f167406b6a0 msgr2=0x7f16740ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.742+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 shutdown_connections 2023-12-22T08:41:26.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.743+0000 7f1679087640 1 -- 172.21.15.31:0/2737626402 wait complete. 2023-12-22T08:41:26.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T08:41:26.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.875+0000 7f966f2ca640 1 Processor -- start 2023-12-22T08:41:26.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.876+0000 7f966f2ca640 1 -- start start 2023-12-22T08:41:26.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.876+0000 7f966f2ca640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9668071150 0x7f96680b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.876+0000 7f966f2ca640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 0x7f9668155510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.876+0000 7f966f2ca640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966806b8e0 con 0x7f96680b7df0 2023-12-22T08:41:26.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.876+0000 7f966f2ca640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966806cb50 con 0x7f9668071150 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.876+0000 7f966f2ca640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966806afb0 con 0x7f966814b480 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.876+0000 7f966c865640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f96680b7df0 0x7f966814ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33626/0 (socket says 172.21.15.31:33626) 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.876+0000 7f966c865640 1 -- 172.21.15.31:0/1892233063 learned_addr learned my addr 172.21.15.31:0/1892233063 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d066640 1 --2- 172.21.15.31:0/1892233063 >> v2:172.21.15.69:3300/0 conn(0x7f9668071150 0x7f96680b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d867640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 0x7f9668155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167660445 0 0) 0x7f966806b8e0 con 0x7f96680b7df0 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9654003520 con 0x7f96680b7df0 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2281809362 0 0) 0x7f9654003520 con 0x7f96680b7df0 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 msgr2=0x7f9668155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 0x7f9668155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 >> v2:172.21.15.69:3300/0 conn(0x7f9668071150 msgr2=0x7f96680b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 --2- 172.21.15.31:0/1892233063 >> v2:172.21.15.69:3300/0 conn(0x7f9668071150 0x7f96680b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966806b290 con 0x7f96680b7df0 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f9658001670 con 0x7f96680b7df0 2023-12-22T08:41:26.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d867640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 0x7f9668155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 >> v1:172.21.15.31:6789/0 conn(0x7f96680b7df0 legacy=0x7f966814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654003970 0x7f9654003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 0x7f96540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9654004d00 0x7f9654005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966806cb50 con 0x7f9654004d00 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966806afb0 con 0x7f9654003970 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965400b980 con 0x7f966814b480 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d867640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9654004d00 0x7f9654005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966c865640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 0x7f96540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d066640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654003970 0x7f9654003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d867640 1 -- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 msgr2=0x7f96540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d867640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 0x7f96540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d867640 1 -- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654003970 msgr2=0x7f9654003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:26.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d867640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654003970 0x7f9654003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966d867640 1 -- 172.21.15.31:0/1892233063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660009a70 con 0x7f9654004d00 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.877+0000 7f966c865640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f966814b480 0x7f96540047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.878+0000 7f966d867640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9654004d00 0x7f9654005180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f966000e380 tx=0x7f96540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba1f54a3d571991 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.878+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966002cd70 con 0x7f9654004d00 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.878+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966000f040 con 0x7f9654004d00 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.878+0000 7f965ffff640 1 -- 172.21.15.31:0/1892233063 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660034640 con 0x7f9654004d00 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.879+0000 7f966f2ca640 1 -- 172.21.15.31:0/1892233063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9654004d00 msgr2=0x7f9654005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.879+0000 7f966f2ca640 1 --2- 172.21.15.31:0/1892233063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9654004d00 0x7f9654005180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f966000e380 tx=0x7f96540057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.879+0000 7f966d867640 1 -- 172.21.15.31:0/1892233063 reap_dead start 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.879+0000 7f966f2ca640 1 -- 172.21.15.31:0/1892233063 shutdown_connections 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.879+0000 7f966f2ca640 1 -- 172.21.15.31:0/1892233063 >> 172.21.15.31:0/1892233063 conn(0x7f96680be1d0 msgr2=0x7f96680be5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.879+0000 7f966f2ca640 1 -- 172.21.15.31:0/1892233063 shutdown_connections 2023-12-22T08:41:26.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.879+0000 7f966f2ca640 1 -- 172.21.15.31:0/1892233063 wait complete. 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.880+0000 7f966f2ca640 1 Processor -- start 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.880+0000 7f966f2ca640 1 -- start start 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966f2ca640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654004d00 0x7f966814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966f2ca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96680acbd0 0x7f96681e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966f2ca640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f96681e3820 0x7f9668143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966f2ca640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966814e8e0 con 0x7f96680acbd0 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966f2ca640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96681e3cb0 con 0x7f9654004d00 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966f2ca640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680aba30 con 0x7f96681e3820 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96680acbd0 0x7f96681e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96680acbd0 0x7f96681e32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34690/0 (socket says 172.21.15.31:34690) 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 -- 172.21.15.31:0/1460624724 learned_addr learned my addr 172.21.15.31:0/1460624724 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:26.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966d066640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654004d00 0x7f966814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966d867640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f96681e3820 0x7f9668143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 -- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f96681e3820 msgr2=0x7f9668143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f96681e3820 0x7f9668143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 -- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654004d00 msgr2=0x7f966814e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654004d00 0x7f966814e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 -- 172.21.15.31:0/1460624724 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96680abd10 con 0x7f96680acbd0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966c865640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96680acbd0 0x7f96681e32e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9658007380 tx=0x7f9658007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f965dffb640 1 -- 172.21.15.31:0/1460624724 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965800fae0 con 0x7f96680acbd0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f965dffb640 1 -- 172.21.15.31:0/1460624724 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965800fc40 con 0x7f96680acbd0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96680abff0 con 0x7f96680acbd0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.881+0000 7f965dffb640 1 -- 172.21.15.31:0/1460624724 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658012350 con 0x7f96680acbd0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.882+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96680b43c0 con 0x7f96680acbd0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.883+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9668073a40 con 0x7f96680acbd0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.883+0000 7f965dffb640 1 -- 172.21.15.31:0/1460624724 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96580124b0 con 0x7f96680acbd0 2023-12-22T08:41:26.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.883+0000 7f965dffb640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f964c06a460 0x7f964c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:26.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.883+0000 7f965dffb640 1 -- 172.21.15.31:0/1460624724 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9658088410 con 0x7f96680acbd0 2023-12-22T08:41:26.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.883+0000 7f966d066640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f964c06a460 0x7f964c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:26.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.884+0000 7f966d066640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f964c06a460 0x7f964c06c920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9664009bc0 tx=0x7f9664009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:26.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:26.888+0000 7f965dffb640 1 -- 172.21.15.31:0/1460624724 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9658053a80 con 0x7f96680acbd0 2023-12-22T08:41:27.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.100+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9668149050 con 0x7f96680acbd0 2023-12-22T08:41:27.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.110+0000 7f965dffb640 1 -- 172.21.15.31:0/1460624724 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f965801a0c0 con 0x7f96680acbd0 2023-12-22T08:41:27.112 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 4 and data pool 5 2023-12-22T08:41:27.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.116+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f964c06a460 msgr2=0x7f964c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.116+0000 7f966f2ca640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f964c06a460 0x7f964c06c920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9664009bc0 tx=0x7f9664009190 comp rx=0 tx=0).stop 2023-12-22T08:41:27.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.116+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96680acbd0 msgr2=0x7f96681e32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.116+0000 7f966f2ca640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96680acbd0 0x7f96681e32e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9658007380 tx=0x7f9658007780 comp rx=0 tx=0).stop 2023-12-22T08:41:27.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.121+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 shutdown_connections 2023-12-22T08:41:27.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.121+0000 7f966f2ca640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f964c06a460 0x7f964c06c920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.121+0000 7f966f2ca640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f96681e3820 0x7f9668143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.121+0000 7f966f2ca640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96680acbd0 0x7f96681e32e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.121+0000 7f966f2ca640 1 --2- 172.21.15.31:0/1460624724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9654004d00 0x7f966814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.121+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 >> 172.21.15.31:0/1460624724 conn(0x7f96680be1d0 msgr2=0x7f96681446e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:27.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.126+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 shutdown_connections 2023-12-22T08:41:27.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.126+0000 7f966f2ca640 1 -- 172.21.15.31:0/1460624724 wait complete. 2023-12-22T08:41:27.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.246+0000 7f99da277640 1 Processor -- start 2023-12-22T08:41:27.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.246+0000 7f99da277640 1 -- start start 2023-12-22T08:41:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99da277640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99d40ba480 0x7f99d4071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99da277640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f99d414abf0 0x7f99d414b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99da277640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d4145340 con 0x7f99d40b7dc0 2023-12-22T08:41:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99da277640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40b81a0 con 0x7f99d40ba480 2023-12-22T08:41:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99da277640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d406b8e0 con 0x7f99d414abf0 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99d40ba480 0x7f99d4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99d40ba480 0x7f99d4071940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34700/0 (socket says 172.21.15.31:34700) 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d37fe640 1 -- 172.21.15.31:0/2554037418 learned_addr learned my addr 172.21.15.31:0/2554037418 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d8814640 1 --2- 172.21.15.31:0/2554037418 >> v2:172.21.15.69:3300/0 conn(0x7f99d414abf0 0x7f99d414b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d37fe640 1 -- 172.21.15.31:0/2554037418 >> v2:172.21.15.69:3300/0 conn(0x7f99d414abf0 msgr2=0x7f99d414b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d37fe640 1 --2- 172.21.15.31:0/2554037418 >> v2:172.21.15.69:3300/0 conn(0x7f99d414abf0 0x7f99d414b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d37fe640 1 -- 172.21.15.31:0/2554037418 >> v1:172.21.15.31:6789/0 conn(0x7f99d40b7dc0 legacy=0x7f99d4070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d37fe640 1 -- 172.21.15.31:0/2554037418 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40715d0 con 0x7f99d40ba480 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.247+0000 7f99d2ffd640 1 -- 172.21.15.31:0/2554037418 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651349481 0 0) 0x7f99d4145340 con 0x7f99d40b7dc0 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.248+0000 7f99d37fe640 1 --2- 172.21.15.31:0/2554037418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d40ba480 0x7f99d4071940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f99d4071ff0 tx=0x7f99c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2790df6d12360864 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.248+0000 7f99d2ffd640 1 -- 172.21.15.31:0/2554037418 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8030860 con 0x7f99d40ba480 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.248+0000 7f99d2ffd640 1 -- 172.21.15.31:0/2554037418 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c80309c0 con 0x7f99d40ba480 2023-12-22T08:41:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.248+0000 7f99d2ffd640 1 -- 172.21.15.31:0/2554037418 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8030d50 con 0x7f99d40ba480 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.249+0000 7f99da277640 1 -- 172.21.15.31:0/2554037418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d40ba480 msgr2=0x7f99d4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.249+0000 7f99da277640 1 --2- 172.21.15.31:0/2554037418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d40ba480 0x7f99d4071940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f99d4071ff0 tx=0x7f99c802b9a0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.249+0000 7f99da277640 1 -- 172.21.15.31:0/2554037418 shutdown_connections 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.249+0000 7f99da277640 1 --2- 172.21.15.31:0/2554037418 >> v2:172.21.15.69:3300/0 conn(0x7f99d414abf0 0x7f99d414b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.249+0000 7f99da277640 1 --2- 172.21.15.31:0/2554037418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d40ba480 0x7f99d4071940 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.249+0000 7f99da277640 1 -- 172.21.15.31:0/2554037418 >> 172.21.15.31:0/2554037418 conn(0x7f99d40be150 msgr2=0x7f99d40be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.249+0000 7f99da277640 1 -- 172.21.15.31:0/2554037418 shutdown_connections 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.249+0000 7f99da277640 1 -- 172.21.15.31:0/2554037418 wait complete. 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.250+0000 7f99da277640 1 Processor -- start 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.250+0000 7f99da277640 1 -- start start 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99da277640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99d40b7dc0 0x7f99d414e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99da277640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d40ba480 0x7f99d4147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99da277640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d414abf0 0x7f99d4140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99da277640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4146c50 con 0x7f99d414abf0 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99da277640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41494b0 con 0x7f99d40ba480 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99da277640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d414dfb0 con 0x7f99d40b7dc0 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d414abf0 0x7f99d4140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d414abf0 0x7f99d4140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34704/0 (socket says 172.21.15.31:34704) 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 -- 172.21.15.31:0/1797160277 learned_addr learned my addr 172.21.15.31:0/1797160277 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d37fe640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d40ba480 0x7f99d4147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d3fff640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99d40b7dc0 0x7f99d414e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 -- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99d40b7dc0 msgr2=0x7f99d414e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99d40b7dc0 0x7f99d414e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 -- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d40ba480 msgr2=0x7f99d4147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d40ba480 0x7f99d4147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 -- 172.21.15.31:0/1797160277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c80094d0 con 0x7f99d414abf0 2023-12-22T08:41:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d8814640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d414abf0 0x7f99d4140380 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99cc007e60 tx=0x7f99cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d0ff9640 1 -- 172.21.15.31:0/1797160277 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc014420 con 0x7f99d414abf0 2023-12-22T08:41:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d0ff9640 1 -- 172.21.15.31:0/1797160277 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc0145a0 con 0x7f99d414abf0 2023-12-22T08:41:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d4145bb0 con 0x7f99d414abf0 2023-12-22T08:41:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.251+0000 7f99d0ff9640 1 -- 172.21.15.31:0/1797160277 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc014950 con 0x7f99d414abf0 2023-12-22T08:41:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.252+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d4146170 con 0x7f99d414abf0 2023-12-22T08:41:27.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.252+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d4073a40 con 0x7f99d414abf0 2023-12-22T08:41:27.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.253+0000 7f99d0ff9640 1 -- 172.21.15.31:0/1797160277 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f99cc014ab0 con 0x7f99d414abf0 2023-12-22T08:41:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.253+0000 7f99d0ff9640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f99c006a430 0x7f99c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.254+0000 7f99d0ff9640 1 -- 172.21.15.31:0/1797160277 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99cc0890f0 con 0x7f99d414abf0 2023-12-22T08:41:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.254+0000 7f99d3fff640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f99c006a430 0x7f99c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.254+0000 7f99d3fff640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f99c006a430 0x7f99c006c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99c4000f60 tx=0x7f99c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.258+0000 7f99d0ff9640 1 -- 172.21.15.31:0/1797160277 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f99cc054780 con 0x7f99d414abf0 2023-12-22T08:41:27.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.435+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99d40b5680 con 0x7f99d414abf0 2023-12-22T08:41:27.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.436+0000 7f99d0ff9640 1 -- 172.21.15.31:0/1797160277 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16162 (secure 0 0 0) 0x7f99cc057da0 con 0x7f99d414abf0 2023-12-22T08:41:27.438 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:27.439 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":30,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:41:27.101669+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:24.856244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:26.086679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:27.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f99c006a430 msgr2=0x7f99c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f99c006a430 0x7f99c006c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99c4000f60 tx=0x7f99c4009040 comp rx=0 tx=0).stop 2023-12-22T08:41:27.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d414abf0 msgr2=0x7f99d4140380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d414abf0 0x7f99d4140380 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99cc007e60 tx=0x7f99cc00e4b0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 shutdown_connections 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f99c006a430 0x7f99c006c8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99d414abf0 0x7f99d4140380 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d40ba480 0x7f99d4147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 --2- 172.21.15.31:0/1797160277 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99d40b7dc0 0x7f99d414e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 >> 172.21.15.31:0/1797160277 conn(0x7f99d40be150 msgr2=0x7f99d4144760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 shutdown_connections 2023-12-22T08:41:27.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.438+0000 7f99da277640 1 -- 172.21.15.31:0/1797160277 wait complete. 2023-12-22T08:41:27.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.555+0000 7feb04ab9640 1 Processor -- start 2023-12-22T08:41:27.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.555+0000 7feb04ab9640 1 -- start start 2023-12-22T08:41:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.555+0000 7feb04ab9640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7feb00145fd0 0x7feb0014bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.555+0000 7feb04ab9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feb000b5fa0 0x7feb00071310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.555+0000 7feb04ab9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b37d0 0x7feb001489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.555+0000 7feb04ab9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb000b5b80 con 0x7feb000b5fa0 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.555+0000 7feb04ab9640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb00071f20 con 0x7feb00145fd0 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.555+0000 7feb04ab9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0014c440 con 0x7feb000b37d0 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafdd9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feb000b5fa0 0x7feb00071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafdd9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feb000b5fa0 0x7feb00071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34712/0 (socket says 172.21.15.31:34712) 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafdd9b640 1 -- 172.21.15.31:0/1483356364 learned_addr learned my addr 172.21.15.31:0/1483356364 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafe59c640 1 --2- 172.21.15.31:0/1483356364 >> v2:172.21.15.69:3300/0 conn(0x7feb00145fd0 0x7feb0014bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafed9d640 1 --2- 172.21.15.31:0/1483356364 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b37d0 0x7feb001489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafdd9b640 1 -- 172.21.15.31:0/1483356364 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b37d0 msgr2=0x7feb001489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafdd9b640 1 --2- 172.21.15.31:0/1483356364 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b37d0 0x7feb001489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafdd9b640 1 -- 172.21.15.31:0/1483356364 >> v2:172.21.15.69:3300/0 conn(0x7feb00145fd0 msgr2=0x7feb0014bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafdd9b640 1 --2- 172.21.15.31:0/1483356364 >> v2:172.21.15.69:3300/0 conn(0x7feb00145fd0 0x7feb0014bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.556+0000 7feafdd9b640 1 -- 172.21.15.31:0/1483356364 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb001463b0 con 0x7feb000b5fa0 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feafdd9b640 1 --2- 172.21.15.31:0/1483356364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b5fa0 0x7feb00071310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feb0006ec00 tx=0x7feaf402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc4644eda1d4246 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feafd59a640 1 -- 172.21.15.31:0/1483356364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4031870 con 0x7feb000b5fa0 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feafd59a640 1 -- 172.21.15.31:0/1483356364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf40319d0 con 0x7feb000b5fa0 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feafd59a640 1 -- 172.21.15.31:0/1483356364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4031d60 con 0x7feb000b5fa0 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 -- 172.21.15.31:0/1483356364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b5fa0 msgr2=0x7feb00071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1483356364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b5fa0 0x7feb00071310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feb0006ec00 tx=0x7feaf402b910 comp rx=0 tx=0).stop 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 -- 172.21.15.31:0/1483356364 shutdown_connections 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1483356364 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b37d0 0x7feb001489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1483356364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b5fa0 0x7feb00071310 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1483356364 >> v2:172.21.15.69:3300/0 conn(0x7feb00145fd0 0x7feb0014bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 -- 172.21.15.31:0/1483356364 >> 172.21.15.31:0/1483356364 conn(0x7feb000bc3d0 msgr2=0x7feb000bc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 -- 172.21.15.31:0/1483356364 shutdown_connections 2023-12-22T08:41:27.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.557+0000 7feb04ab9640 1 -- 172.21.15.31:0/1483356364 wait complete. 2023-12-22T08:41:27.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feb04ab9640 1 Processor -- start 2023-12-22T08:41:27.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feb04ab9640 1 -- start start 2023-12-22T08:41:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feb04ab9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b37d0 0x7feb000b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feb04ab9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b5fa0 0x7feb0013e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feb04ab9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb00145fd0 0x7feb0013ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feb04ab9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00070eb0 con 0x7feb000b37d0 2023-12-22T08:41:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feb04ab9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb000b9620 con 0x7feb00145fd0 2023-12-22T08:41:27.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feb04ab9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb000b2fc0 con 0x7feb000b5fa0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feafe59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b37d0 0x7feb000b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feafe59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b37d0 0x7feb000b90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34728/0 (socket says 172.21.15.31:34728) 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feafe59c640 1 -- 172.21.15.31:0/1316993456 learned_addr learned my addr 172.21.15.31:0/1316993456 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feafed9d640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb00145fd0 0x7feb0013ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.559+0000 7feafdd9b640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b5fa0 0x7feb0013e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feafe59c640 1 -- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b5fa0 msgr2=0x7feb0013e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feafe59c640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b5fa0 0x7feb0013e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feafe59c640 1 -- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb00145fd0 msgr2=0x7feb0013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feafe59c640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb00145fd0 0x7feb0013ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feafe59c640 1 -- 172.21.15.31:0/1316993456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40094d0 con 0x7feb000b37d0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feafe59c640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b37d0 0x7feb000b90e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feaf000e9b0 tx=0x7feaf000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feaeeffd640 1 -- 172.21.15.31:0/1316993456 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0009670 con 0x7feb000b37d0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feaeeffd640 1 -- 172.21.15.31:0/1316993456 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf000c9a0 con 0x7feb000b37d0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feaeeffd640 1 -- 172.21.15.31:0/1316993456 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000cd50 con 0x7feb000b37d0 2023-12-22T08:41:27.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0013ddb0 con 0x7feb000b37d0 2023-12-22T08:41:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.560+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb000701a0 con 0x7feb000b37d0 2023-12-22T08:41:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.561+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb00073a40 con 0x7feb000b37d0 2023-12-22T08:41:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.561+0000 7feaeeffd640 1 -- 172.21.15.31:0/1316993456 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feaf0013470 con 0x7feb000b37d0 2023-12-22T08:41:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.562+0000 7feaeeffd640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feae006a430 0x7feae006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.562+0000 7feaeeffd640 1 -- 172.21.15.31:0/1316993456 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feaf0088b20 con 0x7feb000b37d0 2023-12-22T08:41:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.562+0000 7feafdd9b640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feae006a430 0x7feae006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.562+0000 7feafdd9b640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feae006a430 0x7feae006c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feaf4036000 tx=0x7feaf403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.566+0000 7feaeeffd640 1 -- 172.21.15.31:0/1316993456 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feaf00541d0 con 0x7feb000b37d0 2023-12-22T08:41:27.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.744+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb000710f0 con 0x7feb000b37d0 2023-12-22T08:41:27.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.746+0000 7feaeeffd640 1 -- 172.21.15.31:0/1316993456 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16162 (secure 0 0 0) 0x7feaf00577f0 con 0x7feb000b37d0 2023-12-22T08:41:27.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:27.748 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":30,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:41:27.101669+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:24.856244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:26.086679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:27.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feae006a430 msgr2=0x7feae006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feae006a430 0x7feae006c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feaf4036000 tx=0x7feaf403c040 comp rx=0 tx=0).stop 2023-12-22T08:41:27.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b37d0 msgr2=0x7feb000b90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b37d0 0x7feb000b90e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feaf000e9b0 tx=0x7feaf000ee70 comp rx=0 tx=0).stop 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 shutdown_connections 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feae006a430 0x7feae006c8f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feb00145fd0 0x7feb0013ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feb000b5fa0 0x7feb0013e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 --2- 172.21.15.31:0/1316993456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb000b37d0 0x7feb000b90e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 >> 172.21.15.31:0/1316993456 conn(0x7feb000bc3d0 msgr2=0x7feb00144780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 shutdown_connections 2023-12-22T08:41:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.748+0000 7feb04ab9640 1 -- 172.21.15.31:0/1316993456 wait complete. 2023-12-22T08:41:27.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T08:41:27.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd97e0640 1 Processor -- start 2023-12-22T08:41:27.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd97e0640 1 -- start start 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd97e0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd40b8690 0x7f9fd40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd97e0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9fd40b77d0 0x7f9fd4144670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd97e0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fd4144bb0 0x7f9fd414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd97e0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd414ab10 con 0x7f9fd4144bb0 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd97e0640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd406c2f0 con 0x7f9fd40b77d0 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd97e0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd40ba620 con 0x7f9fd40b8690 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fd4144bb0 0x7f9fd414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fd4144bb0 0x7f9fd414afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34736/0 (socket says 172.21.15.31:34736) 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.868+0000 7f9fd37fe640 1 -- 172.21.15.31:0/1641928840 learned_addr learned my addr 172.21.15.31:0/1641928840 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd2ffd640 1 --2- 172.21.15.31:0/1641928840 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd40b8690 0x7f9fd40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd27fc640 1 --2- 172.21.15.31:0/1641928840 >> v2:172.21.15.69:3300/0 conn(0x7f9fd40b77d0 0x7f9fd4144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd37fe640 1 -- 172.21.15.31:0/1641928840 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd40b8690 msgr2=0x7f9fd40b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd37fe640 1 --2- 172.21.15.31:0/1641928840 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd40b8690 0x7f9fd40b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd37fe640 1 -- 172.21.15.31:0/1641928840 >> v2:172.21.15.69:3300/0 conn(0x7f9fd40b77d0 msgr2=0x7f9fd4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd37fe640 1 --2- 172.21.15.31:0/1641928840 >> v2:172.21.15.69:3300/0 conn(0x7f9fd40b77d0 0x7f9fd4144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd37fe640 1 -- 172.21.15.31:0/1641928840 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40b9e60 con 0x7f9fd4144bb0 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd2ffd640 1 --2- 172.21.15.31:0/1641928840 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd40b8690 0x7f9fd40b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd27fc640 1 --2- 172.21.15.31:0/1641928840 >> v2:172.21.15.69:3300/0 conn(0x7f9fd40b77d0 0x7f9fd4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.869+0000 7f9fd37fe640 1 --2- 172.21.15.31:0/1641928840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd4144bb0 0x7f9fd414afa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9fd408a260 tx=0x7f9fcc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ffab2ada819665 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd1ffb640 1 -- 172.21.15.31:0/1641928840 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc02c9e0 con 0x7f9fd4144bb0 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd1ffb640 1 -- 172.21.15.31:0/1641928840 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc02cb40 con 0x7f9fd4144bb0 2023-12-22T08:41:27.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd1ffb640 1 -- 172.21.15.31:0/1641928840 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0343f0 con 0x7f9fd4144bb0 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 -- 172.21.15.31:0/1641928840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd4144bb0 msgr2=0x7f9fd414afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/1641928840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd4144bb0 0x7f9fd414afa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9fd408a260 tx=0x7f9fcc02be40 comp rx=0 tx=0).stop 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 -- 172.21.15.31:0/1641928840 shutdown_connections 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/1641928840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd4144bb0 0x7f9fd414afa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/1641928840 >> v2:172.21.15.69:3300/0 conn(0x7f9fd40b77d0 0x7f9fd4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/1641928840 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd40b8690 0x7f9fd40b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 -- 172.21.15.31:0/1641928840 >> 172.21.15.31:0/1641928840 conn(0x7f9fd406b6a0 msgr2=0x7f9fd406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 -- 172.21.15.31:0/1641928840 shutdown_connections 2023-12-22T08:41:27.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.870+0000 7f9fd97e0640 1 -- 172.21.15.31:0/1641928840 wait complete. 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.871+0000 7f9fd97e0640 1 Processor -- start 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.871+0000 7f9fd97e0640 1 -- start start 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd97e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fd40b77d0 0x7f9fd4147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd97e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd40b8690 0x7f9fd41e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd97e0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd4144bb0 0x7f9fd41486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd97e0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd4148080 con 0x7f9fd40b8690 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd97e0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd41491f0 con 0x7f9fd40b77d0 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd97e0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd4149f00 con 0x7f9fd4144bb0 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd27fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd40b8690 0x7f9fd41e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd27fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd40b8690 0x7f9fd41e3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34750/0 (socket says 172.21.15.31:34750) 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd27fc640 1 -- 172.21.15.31:0/4037870359 learned_addr learned my addr 172.21.15.31:0/4037870359 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd2ffd640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fd40b77d0 0x7f9fd4147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd37fe640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd4144bb0 0x7f9fd41486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd27fc640 1 -- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd4144bb0 msgr2=0x7f9fd41486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd27fc640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd4144bb0 0x7f9fd41486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd27fc640 1 -- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fd40b77d0 msgr2=0x7f9fd4147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd27fc640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fd40b77d0 0x7f9fd4147b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.872+0000 7f9fd27fc640 1 -- 172.21.15.31:0/4037870359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc009b30 con 0x7f9fd40b8690 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.873+0000 7f9fd27fc640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd40b8690 0x7f9fd41e3ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800c7c0 tx=0x7f9fc800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.873+0000 7f9fbb7fe640 1 -- 172.21.15.31:0/4037870359 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8007a30 con 0x7f9fd40b8690 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.873+0000 7f9fbb7fe640 1 -- 172.21.15.31:0/4037870359 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc8007b90 con 0x7f9fd40b8690 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.873+0000 7f9fbb7fe640 1 -- 172.21.15.31:0/4037870359 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800ce70 con 0x7f9fd40b8690 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.873+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd41e36f0 con 0x7f9fd40b8690 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.873+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd4149bc0 con 0x7f9fd40b8690 2023-12-22T08:41:27.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.874+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd4072220 con 0x7f9fd40b8690 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.874+0000 7f9fbb7fe640 1 -- 172.21.15.31:0/4037870359 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9fc80113f0 con 0x7f9fd40b8690 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.875+0000 7f9fbb7fe640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9fc006a430 0x7f9fc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.875+0000 7f9fbb7fe640 1 -- 172.21.15.31:0/4037870359 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fc80889c0 con 0x7f9fd40b8690 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.875+0000 7f9fd2ffd640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9fc006a430 0x7f9fc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:27.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.875+0000 7f9fd2ffd640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9fc006a430 0x7f9fc006c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400a990 tx=0x7f9fc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:27.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:27.879+0000 7f9fbb7fe640 1 -- 172.21.15.31:0/4037870359 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9fc8054040 con 0x7f9fd40b8690 2023-12-22T08:41:28.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.090+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9fd4073a40 con 0x7f9fd40b8690 2023-12-22T08:41:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.116+0000 7f9fbb7fe640 1 -- 172.21.15.31:0/4037870359 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9fc8057660 con 0x7f9fd40b8690 2023-12-22T08:41:28.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9fc006a430 msgr2=0x7f9fc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:28.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9fc006a430 0x7f9fc006c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400a990 tx=0x7f9fc4008040 comp rx=0 tx=0).stop 2023-12-22T08:41:28.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd40b8690 msgr2=0x7f9fd41e3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:28.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd40b8690 0x7f9fd41e3ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800c7c0 tx=0x7f9fc800cc80 comp rx=0 tx=0).stop 2023-12-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 shutdown_connections 2023-12-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9fc006a430 0x7f9fc006c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9fd4144bb0 0x7f9fd41486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fd40b8690 0x7f9fd41e3ef0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 --2- 172.21.15.31:0/4037870359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fd40b77d0 0x7f9fd4147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 >> 172.21.15.31:0/4037870359 conn(0x7f9fd406b6a0 msgr2=0x7f9fd414aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 shutdown_connections 2023-12-22T08:41:28.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.119+0000 7f9fd97e0640 1 -- 172.21.15.31:0/4037870359 wait complete. 2023-12-22T08:41:28.132 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T08:41:28.132 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T08:41:28.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.237+0000 7fe540139640 1 Processor -- start 2023-12-22T08:41:28.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe540139640 1 -- start start 2023-12-22T08:41:28.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe540139640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe53806b9d0 0x7fe53806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:28.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe540139640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe53806bdb0 0x7fe53806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:28.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe540139640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53806eae0 con 0x7fe53806f4c0 2023-12-22T08:41:28.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe540139640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53806cee0 con 0x7fe53806b9d0 2023-12-22T08:41:28.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe540139640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53814e100 con 0x7fe53806bdb0 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe53ded5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe53806b9d0 0x7fe53806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe53ded5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe53806b9d0 0x7fe53806c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34758/0 (socket says 172.21.15.31:34758) 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe53ded5640 1 -- 172.21.15.31:0/2122829957 learned_addr learned my addr 172.21.15.31:0/2122829957 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.238+0000 7fe53e6d6640 1 --1- 172.21.15.31:0/2122829957 >> v1:172.21.15.31:6789/0 conn(0x7fe53806f4c0 0x7fe53814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33642/0 (socket says 172.21.15.31:33642) 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.239+0000 7fe53d6d4640 1 --2- 172.21.15.31:0/2122829957 >> v2:172.21.15.69:3300/0 conn(0x7fe53806bdb0 0x7fe53806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.239+0000 7fe53ded5640 1 -- 172.21.15.31:0/2122829957 >> v2:172.21.15.69:3300/0 conn(0x7fe53806bdb0 msgr2=0x7fe53806ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.239+0000 7fe53ded5640 1 --2- 172.21.15.31:0/2122829957 >> v2:172.21.15.69:3300/0 conn(0x7fe53806bdb0 0x7fe53806ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.239+0000 7fe53ded5640 1 -- 172.21.15.31:0/2122829957 >> v1:172.21.15.31:6789/0 conn(0x7fe53806f4c0 legacy=0x7fe53814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.239+0000 7fe53ced3640 1 -- 172.21.15.31:0/2122829957 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377313094 0 0) 0x7fe53806eae0 con 0x7fe53806f4c0 2023-12-22T08:41:28.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.239+0000 7fe53ded5640 1 -- 172.21.15.31:0/2122829957 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53806e6c0 con 0x7fe53806b9d0 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.239+0000 7fe53ded5640 1 --2- 172.21.15.31:0/2122829957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806b9d0 0x7fe53806c9a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe53806ac30 tx=0x7fe53402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88478a108056b19a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe53ced3640 1 -- 172.21.15.31:0/2122829957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534030860 con 0x7fe53806b9d0 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe53ced3640 1 -- 172.21.15.31:0/2122829957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5340309c0 con 0x7fe53806b9d0 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe53ced3640 1 -- 172.21.15.31:0/2122829957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534030d50 con 0x7fe53806b9d0 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe540139640 1 -- 172.21.15.31:0/2122829957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806b9d0 msgr2=0x7fe53806c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe540139640 1 --2- 172.21.15.31:0/2122829957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806b9d0 0x7fe53806c9a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe53806ac30 tx=0x7fe53402b9a0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe540139640 1 -- 172.21.15.31:0/2122829957 shutdown_connections 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe540139640 1 --2- 172.21.15.31:0/2122829957 >> v2:172.21.15.69:3300/0 conn(0x7fe53806bdb0 0x7fe53806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe540139640 1 --2- 172.21.15.31:0/2122829957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806b9d0 0x7fe53806c9a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe540139640 1 -- 172.21.15.31:0/2122829957 >> 172.21.15.31:0/2122829957 conn(0x7fe5380be1e0 msgr2=0x7fe5380be5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe540139640 1 -- 172.21.15.31:0/2122829957 shutdown_connections 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.240+0000 7fe540139640 1 -- 172.21.15.31:0/2122829957 wait complete. 2023-12-22T08:41:28.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.241+0000 7fe540139640 1 Processor -- start 2023-12-22T08:41:28.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.241+0000 7fe540139640 1 -- start start 2023-12-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe540139640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe53806b9d0 0x7fe53814a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe540139640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806bdb0 0x7fe53814b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe540139640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe53806f4c0 0x7fe538148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe540139640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53814cdc0 con 0x7fe53806bdb0 2023-12-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe540139640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe538149970 con 0x7fe53806b9d0 2023-12-22T08:41:28.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe540139640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53814ac50 con 0x7fe53806f4c0 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53d6d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806bdb0 0x7fe53814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53d6d4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806bdb0 0x7fe53814b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34774/0 (socket says 172.21.15.31:34774) 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53d6d4640 1 -- 172.21.15.31:0/2342092057 learned_addr learned my addr 172.21.15.31:0/2342092057 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53ded5640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe53806b9d0 0x7fe53814a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53d6d4640 1 -- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe53806f4c0 msgr2=0x7fe538148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53d6d4640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe53806f4c0 0x7fe538148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53d6d4640 1 -- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe53806b9d0 msgr2=0x7fe53814a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53d6d4640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe53806b9d0 0x7fe53814a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53d6d4640 1 -- 172.21.15.31:0/2342092057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340094d0 con 0x7fe53806bdb0 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.242+0000 7fe53ded5640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe53806b9d0 0x7fe53814a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.243+0000 7fe53d6d4640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806bdb0 0x7fe53814b270 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe52800d830 tx=0x7fe52800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:28.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.243+0000 7fe52e7fc640 1 -- 172.21.15.31:0/2342092057 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800b6c0 con 0x7fe53806bdb0 2023-12-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.243+0000 7fe52e7fc640 1 -- 172.21.15.31:0/2342092057 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800b820 con 0x7fe53806bdb0 2023-12-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.243+0000 7fe52e7fc640 1 -- 172.21.15.31:0/2342092057 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800bbb0 con 0x7fe53806bdb0 2023-12-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.243+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53814c110 con 0x7fe53806bdb0 2023-12-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.243+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53814b7b0 con 0x7fe53806bdb0 2023-12-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.244+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe538066e90 con 0x7fe53806bdb0 2023-12-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.244+0000 7fe52e7fc640 1 -- 172.21.15.31:0/2342092057 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe52801e460 con 0x7fe53806bdb0 2023-12-22T08:41:28.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.245+0000 7fe52e7fc640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe51c06a430 0x7fe51c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:28.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.245+0000 7fe52e7fc640 1 -- 172.21.15.31:0/2342092057 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5280891c0 con 0x7fe53806bdb0 2023-12-22T08:41:28.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.245+0000 7fe53ded5640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe51c06a430 0x7fe51c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:28.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.245+0000 7fe53ded5640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe51c06a430 0x7fe51c06c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe534036000 tx=0x7fe53403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:28.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.249+0000 7fe52e7fc640 1 -- 172.21.15.31:0/2342092057 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe528054680 con 0x7fe53806bdb0 2023-12-22T08:41:28.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:28.465+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe538073a40 con 0x7fe53806bdb0 2023-12-22T08:41:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.120+0000 7fe52e7fc640 1 -- 172.21.15.31:0/2342092057 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe528057ca0 con 0x7fe53806bdb0 2023-12-22T08:41:29.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe51c06a430 msgr2=0x7fe51c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe51c06a430 0x7fe51c06c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe534036000 tx=0x7fe53403b040 comp rx=0 tx=0).stop 2023-12-22T08:41:29.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806bdb0 msgr2=0x7fe53814b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806bdb0 0x7fe53814b270 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe52800d830 tx=0x7fe52800dcf0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 shutdown_connections 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe51c06a430 0x7fe51c06c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe53806f4c0 0x7fe538148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe53806bdb0 0x7fe53814b270 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 --2- 172.21.15.31:0/2342092057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe53806b9d0 0x7fe53814a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 >> 172.21.15.31:0/2342092057 conn(0x7fe5380be1e0 msgr2=0x7fe5380b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 shutdown_connections 2023-12-22T08:41:29.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.123+0000 7fe540139640 1 -- 172.21.15.31:0/2342092057 wait complete. 2023-12-22T08:41:29.138 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T08:41:29.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.247+0000 7ff1174f7640 1 Processor -- start 2023-12-22T08:41:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.247+0000 7ff1174f7640 1 -- start start 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff1174f7640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff11006a6d0 0x7ff11014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff1174f7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 0x7ff1100b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff1174f7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1100ba550 0x7ff11014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff1174f7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1100bb310 con 0x7ff1100ba550 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff1174f7640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1100bf960 con 0x7ff11006a6d0 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff1174f7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100bb5b0 con 0x7ff11014b1f0 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115a94640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1100ba550 0x7ff11014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115a94640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1100ba550 0x7ff11014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34790/0 (socket says 172.21.15.31:34790) 2023-12-22T08:41:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115a94640 1 -- 172.21.15.31:0/619109136 learned_addr learned my addr 172.21.15.31:0/619109136 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115293640 1 --2- 172.21.15.31:0/619109136 >> v2:172.21.15.69:3300/0 conn(0x7ff11006a6d0 0x7ff11014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff114a92640 1 --2- 172.21.15.31:0/619109136 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 0x7ff1100b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115a94640 1 -- 172.21.15.31:0/619109136 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 msgr2=0x7ff1100b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115a94640 1 --2- 172.21.15.31:0/619109136 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 0x7ff1100b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115a94640 1 -- 172.21.15.31:0/619109136 >> v2:172.21.15.69:3300/0 conn(0x7ff11006a6d0 msgr2=0x7ff11014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115a94640 1 --2- 172.21.15.31:0/619109136 >> v2:172.21.15.69:3300/0 conn(0x7ff11006a6d0 0x7ff11014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.248+0000 7ff115a94640 1 -- 172.21.15.31:0/619109136 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1100c0120 con 0x7ff1100ba550 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.249+0000 7ff115a94640 1 --2- 172.21.15.31:0/619109136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11014e1b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff11008a260 tx=0x7ff10802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fca32eca88261c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.249+0000 7ff107fff640 1 -- 172.21.15.31:0/619109136 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108031870 con 0x7ff1100ba550 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.249+0000 7ff107fff640 1 -- 172.21.15.31:0/619109136 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1080319d0 con 0x7ff1100ba550 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.249+0000 7ff107fff640 1 -- 172.21.15.31:0/619109136 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108031d60 con 0x7ff1100ba550 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 -- 172.21.15.31:0/619109136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 msgr2=0x7ff11014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 --2- 172.21.15.31:0/619109136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11014e1b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff11008a260 tx=0x7ff10802b910 comp rx=0 tx=0).stop 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 -- 172.21.15.31:0/619109136 shutdown_connections 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 --2- 172.21.15.31:0/619109136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11014e1b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 --2- 172.21.15.31:0/619109136 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 0x7ff1100b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 --2- 172.21.15.31:0/619109136 >> v2:172.21.15.69:3300/0 conn(0x7ff11006a6d0 0x7ff11014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 -- 172.21.15.31:0/619109136 >> 172.21.15.31:0/619109136 conn(0x7ff1100c0350 msgr2=0x7ff1100c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 -- 172.21.15.31:0/619109136 shutdown_connections 2023-12-22T08:41:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.250+0000 7ff1174f7640 1 -- 172.21.15.31:0/619109136 wait complete. 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.251+0000 7ff1174f7640 1 Processor -- start 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.251+0000 7ff1174f7640 1 -- start start 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff1174f7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11006a6d0 0x7ff1100b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff1174f7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11009f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff1174f7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 0x7ff1100a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff1174f7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100a5550 con 0x7ff1100ba550 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff1174f7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100b6410 con 0x7ff11006a6d0 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff1174f7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11009aa30 con 0x7ff11014b1f0 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff114a92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11009f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff115293640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11006a6d0 0x7ff1100b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff115293640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11006a6d0 0x7ff1100b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:50782/0 (socket says 172.21.15.31:50782) 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff114a92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11009f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34794/0 (socket says 172.21.15.31:34794) 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff115293640 1 -- 172.21.15.31:0/2916925876 learned_addr learned my addr 172.21.15.31:0/2916925876 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff115a94640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 0x7ff1100a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff114a92640 1 -- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 msgr2=0x7ff1100a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff114a92640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 0x7ff1100a5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff114a92640 1 -- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11006a6d0 msgr2=0x7ff1100b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff114a92640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11006a6d0 0x7ff1100b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff114a92640 1 -- 172.21.15.31:0/2916925876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1080094d0 con 0x7ff1100ba550 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff114a92640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11009f110 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff10000e840 tx=0x7ff10000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.252+0000 7ff105ffb640 1 -- 172.21.15.31:0/2916925876 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10000c730 con 0x7ff1100ba550 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.253+0000 7ff105ffb640 1 -- 172.21.15.31:0/2916925876 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10000c890 con 0x7ff1100ba550 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.253+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1100b6680 con 0x7ff1100ba550 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.253+0000 7ff105ffb640 1 -- 172.21.15.31:0/2916925876 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10000cc20 con 0x7ff1100ba550 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.253+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1100a5b50 con 0x7ff1100ba550 2023-12-22T08:41:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.254+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1100b6810 con 0x7ff1100ba550 2023-12-22T08:41:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.254+0000 7ff105ffb640 1 -- 172.21.15.31:0/2916925876 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff100013470 con 0x7ff1100ba550 2023-12-22T08:41:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.255+0000 7ff105ffb640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0f406a430 0x7ff0f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.255+0000 7ff105ffb640 1 -- 172.21.15.31:0/2916925876 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1000887f0 con 0x7ff1100ba550 2023-12-22T08:41:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.255+0000 7ff115293640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0f406a430 0x7ff0f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.255+0000 7ff115293640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0f406a430 0x7ff0f406c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009a40 tx=0x7ff10c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.259+0000 7ff105ffb640 1 -- 172.21.15.31:0/2916925876 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff100053f20 con 0x7ff1100ba550 2023-12-22T08:41:29.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.470+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff110073a40 con 0x7ff1100ba550 2023-12-22T08:41:29.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.471+0000 7ff105ffb640 1 -- 172.21.15.31:0/2916925876 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3888 (secure 0 0 0) 0x7ff100017090 con 0x7ff1100ba550 2023-12-22T08:41:29.473 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:29.473 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/173415810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":173415810},{"type":"v1","addr":"172.21.15.31:6835","nonce":173415810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/3869821333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3869821333},{"type":"v1","addr":"172.21.15.69:6835","nonce":3869821333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:27.101993+0000","modified":"2023-12-22T08:41:29.116339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/3038519921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3038519921},{"type":"v1","addr":"172.21.15.31:6834","nonce":3038519921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:29.474 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 13 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0f406a430 msgr2=0x7ff0f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0f406a430 0x7ff0f406c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009a40 tx=0x7ff10c00b040 comp rx=0 tx=0).stop 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 msgr2=0x7ff11009f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11009f110 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff10000e840 tx=0x7ff10000ed00 comp rx=0 tx=0).stop 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 shutdown_connections 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0f406a430 0x7ff0f406c8f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff11014b1f0 0x7ff1100a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1100ba550 0x7ff11009f110 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 --2- 172.21.15.31:0/2916925876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11006a6d0 0x7ff1100b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 >> 172.21.15.31:0/2916925876 conn(0x7ff1100c0350 msgr2=0x7ff1100b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 shutdown_connections 2023-12-22T08:41:29.476 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.472+0000 7ff1174f7640 1 -- 172.21.15.31:0/2916925876 wait complete. 2023-12-22T08:41:29.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:29.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.588+0000 7eff9cce2640 1 Processor -- start 2023-12-22T08:41:29.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.588+0000 7eff9cce2640 1 -- start start 2023-12-22T08:41:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff9cce2640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7eff9806a6d0 0x7eff9814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff9cce2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff980bb310 con 0x7eff980ba550 2023-12-22T08:41:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff9cce2640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff980bf960 con 0x7eff9814b1f0 2023-12-22T08:41:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff9cce2640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff980bb5b0 con 0x7eff9806a6d0 2023-12-22T08:41:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff96d9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff980ba550 0x7eff981554e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33646/0 (socket says 172.21.15.31:33646) 2023-12-22T08:41:29.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff96d9d640 1 -- 172.21.15.31:0/199566400 learned_addr learned my addr 172.21.15.31:0/199566400 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff9659c640 1 --2- 172.21.15.31:0/199566400 >> v2:172.21.15.69:3300/0 conn(0x7eff9806a6d0 0x7eff9814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318897839 0 0) 0x7eff980bb310 con 0x7eff980ba550 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.589+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff84003520 con 0x7eff980ba550 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1161533500 0 0) 0x7eff84003520 con 0x7eff980ba550 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 >> v2:172.21.15.69:3300/0 conn(0x7eff9806a6d0 msgr2=0x7eff9814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 --2- 172.21.15.31:0/199566400 >> v2:172.21.15.69:3300/0 conn(0x7eff9806a6d0 0x7eff9814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 >> v1:172.21.15.69:6789/0 conn(0x7eff9814b1f0 legacy=0x7eff980b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980c0120 con 0x7eff980ba550 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7eff900019f0 con 0x7eff980ba550 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 >> v1:172.21.15.31:6789/0 conn(0x7eff980ba550 legacy=0x7eff981554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff84003970 0x7eff84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff840047c0 0x7eff84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff84005180 0x7eff8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff980bb5b0 con 0x7eff84003970 2023-12-22T08:41:29.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8400c020 con 0x7eff84005180 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8400c1e0 con 0x7eff840047c0 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff9659c640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff84003970 0x7eff84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff96d9d640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff84005180 0x7eff8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff8ffff640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff840047c0 0x7eff84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff9659c640 1 -- 172.21.15.31:0/199566400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff840047c0 msgr2=0x7eff84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff9659c640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff840047c0 0x7eff84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff9659c640 1 -- 172.21.15.31:0/199566400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff84005180 msgr2=0x7eff8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff9659c640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff84005180 0x7eff8400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff9659c640 1 -- 172.21.15.31:0/199566400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84003520 con 0x7eff84003970 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.590+0000 7eff96d9d640 1 -- 172.21.15.31:0/199566400 reap_dead start 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.591+0000 7eff9659c640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff84003970 0x7eff84003d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7eff88009ac0 tx=0x7eff840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da007cd3442331 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.591+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8802c630 con 0x7eff84003970 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.591+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8802c790 con 0x7eff84003970 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.591+0000 7eff95d9b640 1 -- 172.21.15.31:0/199566400 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8802cb20 con 0x7eff84003970 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.592+0000 7eff9cce2640 1 -- 172.21.15.31:0/199566400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff84003970 msgr2=0x7eff84003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.592+0000 7eff9cce2640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff84003970 0x7eff84003d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7eff88009ac0 tx=0x7eff840057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.592+0000 7eff9cce2640 1 -- 172.21.15.31:0/199566400 shutdown_connections 2023-12-22T08:41:29.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.592+0000 7eff9cce2640 1 --2- 172.21.15.31:0/199566400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff84003970 0x7eff84003d90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.592+0000 7eff9cce2640 1 -- 172.21.15.31:0/199566400 >> 172.21.15.31:0/199566400 conn(0x7eff980c0350 msgr2=0x7eff980c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:29.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.592+0000 7eff9cce2640 1 -- 172.21.15.31:0/199566400 shutdown_connections 2023-12-22T08:41:29.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.592+0000 7eff9cce2640 1 -- 172.21.15.31:0/199566400 wait complete. 2023-12-22T08:41:29.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.593+0000 7eff9cce2640 1 Processor -- start 2023-12-22T08:41:29.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.593+0000 7eff9cce2640 1 -- start start 2023-12-22T08:41:29.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.593+0000 7eff9cce2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff84003970 0x7eff9814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.593+0000 7eff9cce2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff981d5790 0x7eff981df970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.593+0000 7eff9cce2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff981d77a0 0x7eff9809e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.593+0000 7eff9cce2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff98099800 con 0x7eff981d5790 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.593+0000 7eff9cce2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9814e930 con 0x7eff981d77a0 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.593+0000 7eff9cce2640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff981dfeb0 con 0x7eff84003970 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff981d5790 0x7eff981df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff981d5790 0x7eff981df970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34802/0 (socket says 172.21.15.31:34802) 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 -- 172.21.15.31:0/988040565 learned_addr learned my addr 172.21.15.31:0/988040565 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff96d9d640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff981d77a0 0x7eff9809e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff9659c640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff84003970 0x7eff9814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 -- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff84003970 msgr2=0x7eff9814e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff84003970 0x7eff9814e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 -- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff981d77a0 msgr2=0x7eff9809e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff981d77a0 0x7eff9809e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 -- 172.21.15.31:0/988040565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9809f430 con 0x7eff981d5790 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8ffff640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff981d5790 0x7eff981df970 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff80000c00 tx=0x7eff8000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8effd640 1 -- 172.21.15.31:0/988040565 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff800052e0 con 0x7eff981d5790 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8effd640 1 -- 172.21.15.31:0/988040565 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff80005440 con 0x7eff981d5790 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff981d5c20 con 0x7eff981d5790 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff8effd640 1 -- 172.21.15.31:0/988040565 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80003810 con 0x7eff981d5790 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.594+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff981d6fa0 con 0x7eff981d5790 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.595+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff98073a40 con 0x7eff981d5790 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.596+0000 7eff8effd640 1 -- 172.21.15.31:0/988040565 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7eff80003970 con 0x7eff981d5790 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.596+0000 7eff8effd640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7eff7806a430 0x7eff7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.596+0000 7eff8effd640 1 -- 172.21.15.31:0/988040565 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff800880b0 con 0x7eff981d5790 2023-12-22T08:41:29.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.596+0000 7eff9659c640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7eff7806a430 0x7eff7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.597+0000 7eff9659c640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7eff7806a430 0x7eff7806c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff88036000 tx=0x7eff88030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.600+0000 7eff8effd640 1 -- 172.21.15.31:0/988040565 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7eff800537e0 con 0x7eff981d5790 2023-12-22T08:41:29.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.777+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff980a62d0 con 0x7eff981d5790 2023-12-22T08:41:29.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.779+0000 7eff8effd640 1 -- 172.21.15.31:0/988040565 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7eff80056e00 con 0x7eff981d5790 2023-12-22T08:41:29.781 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:29.781 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:41:28.105217+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:24.856244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:26.086679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:29.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7eff7806a430 msgr2=0x7eff7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7eff7806a430 0x7eff7806c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff88036000 tx=0x7eff88030000 comp rx=0 tx=0).stop 2023-12-22T08:41:29.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff981d5790 msgr2=0x7eff981df970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff981d5790 0x7eff981df970 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff80000c00 tx=0x7eff8000e8a0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 shutdown_connections 2023-12-22T08:41:29.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7eff7806a430 0x7eff7806c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff981d77a0 0x7eff9809e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff981d5790 0x7eff981df970 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 --2- 172.21.15.31:0/988040565 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7eff84003970 0x7eff9814e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 >> 172.21.15.31:0/988040565 conn(0x7eff980c0350 msgr2=0x7eff980a52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:29.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 shutdown_connections 2023-12-22T08:41:29.784 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.781+0000 7eff9cce2640 1 -- 172.21.15.31:0/988040565 wait complete. 2023-12-22T08:41:29.794 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T08:41:29.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:29.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.899+0000 7fbaaa461640 1 Processor -- start 2023-12-22T08:41:29.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.899+0000 7fbaaa461640 1 -- start start 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaaa461640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaaa461640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbaa40afb00 0x7fbaa4070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaaa461640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbaa414ab30 0x7fbaa414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaaa461640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa4070970 con 0x7fbaa40afb00 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaaa461640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa406fa60 con 0x7fbaa414ab30 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaaa461640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4071ef0 con 0x7fbaa4144f20 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbaa40afb00 0x7fbaa4070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbaa40afb00 0x7fbaa4070430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34816/0 (socket says 172.21.15.31:34816) 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa37fe640 1 -- 172.21.15.31:0/694707370 learned_addr learned my addr 172.21.15.31:0/694707370 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:29.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa3fff640 1 --2- 172.21.15.31:0/694707370 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa89fe640 1 --2- 172.21.15.31:0/694707370 >> v2:172.21.15.69:3300/0 conn(0x7fbaa414ab30 0x7fbaa414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa37fe640 1 -- 172.21.15.31:0/694707370 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 msgr2=0x7fbaa406fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa37fe640 1 --2- 172.21.15.31:0/694707370 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa406fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa37fe640 1 -- 172.21.15.31:0/694707370 >> v2:172.21.15.69:3300/0 conn(0x7fbaa414ab30 msgr2=0x7fbaa414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa37fe640 1 --2- 172.21.15.31:0/694707370 >> v2:172.21.15.69:3300/0 conn(0x7fbaa414ab30 0x7fbaa414afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa37fe640 1 -- 172.21.15.31:0/694707370 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa406f430 con 0x7fbaa40afb00 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.900+0000 7fbaa3fff640 1 --2- 172.21.15.31:0/694707370 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa406fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.901+0000 7fbaa37fe640 1 --2- 172.21.15.31:0/694707370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa40afb00 0x7fbaa4070430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbaa406eec0 tx=0x7fba9402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72706710993f8a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.901+0000 7fbaa2ffd640 1 -- 172.21.15.31:0/694707370 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940317e0 con 0x7fbaa40afb00 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.901+0000 7fbaa2ffd640 1 -- 172.21.15.31:0/694707370 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94031940 con 0x7fbaa40afb00 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.901+0000 7fbaa2ffd640 1 -- 172.21.15.31:0/694707370 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94031cd0 con 0x7fbaa40afb00 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.901+0000 7fbaaa461640 1 -- 172.21.15.31:0/694707370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa40afb00 msgr2=0x7fbaa4070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.901+0000 7fbaaa461640 1 --2- 172.21.15.31:0/694707370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa40afb00 0x7fbaa4070430 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbaa406eec0 tx=0x7fba9402b880 comp rx=0 tx=0).stop 2023-12-22T08:41:29.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.902+0000 7fbaaa461640 1 -- 172.21.15.31:0/694707370 shutdown_connections 2023-12-22T08:41:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.902+0000 7fbaaa461640 1 --2- 172.21.15.31:0/694707370 >> v2:172.21.15.69:3300/0 conn(0x7fbaa414ab30 0x7fbaa414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.902+0000 7fbaaa461640 1 --2- 172.21.15.31:0/694707370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa40afb00 0x7fbaa4070430 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.902+0000 7fbaaa461640 1 --2- 172.21.15.31:0/694707370 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa406fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.902+0000 7fbaaa461640 1 -- 172.21.15.31:0/694707370 >> 172.21.15.31:0/694707370 conn(0x7fbaa40bc3d0 msgr2=0x7fbaa40bc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.902+0000 7fbaaa461640 1 -- 172.21.15.31:0/694707370 shutdown_connections 2023-12-22T08:41:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.902+0000 7fbaaa461640 1 -- 172.21.15.31:0/694707370 wait complete. 2023-12-22T08:41:29.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaaa461640 1 Processor -- start 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaaa461640 1 -- start start 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaaa461640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaa40afb00 0x7fbaa40b9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaaa461640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa41dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaaa461640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa414ab30 0x7fbaa414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaaa461640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40b9bc0 con 0x7fbaa414ab30 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaaa461640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa414ca00 con 0x7fbaa40afb00 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaaa461640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40b3300 con 0x7fbaa4144f20 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaa89fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa414ab30 0x7fbaa414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaa89fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa414ab30 0x7fbaa414e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34830/0 (socket says 172.21.15.31:34830) 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.903+0000 7fbaa89fe640 1 -- 172.21.15.31:0/1206111970 learned_addr learned my addr 172.21.15.31:0/1206111970 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa3fff640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaa40afb00 0x7fbaa40b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa37fe640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa41dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa89fe640 1 -- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 msgr2=0x7fbaa41dfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa89fe640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa41dfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa89fe640 1 -- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaa40afb00 msgr2=0x7fbaa40b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa89fe640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaa40afb00 0x7fbaa40b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa89fe640 1 -- 172.21.15.31:0/1206111970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba940094d0 con 0x7fbaa414ab30 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa37fe640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa41dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa89fe640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa414ab30 0x7fbaa414e5d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00cc30 tx=0x7fba9c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa0ff9640 1 -- 172.21.15.31:0/1206111970 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00ce40 con 0x7fbaa414ab30 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa0ff9640 1 -- 172.21.15.31:0/1206111970 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c003990 con 0x7fbaa414ab30 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaa0ff9640 1 -- 172.21.15.31:0/1206111970 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c003d20 con 0x7fbaa414ab30 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa41e0790 con 0x7fbaa414ab30 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.904+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa40b7ce0 con 0x7fbaa414ab30 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.905+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa40b7f00 con 0x7fbaa414ab30 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.906+0000 7fbaa0ff9640 1 -- 172.21.15.31:0/1206111970 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fba9c003e80 con 0x7fbaa414ab30 2023-12-22T08:41:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.906+0000 7fbaa0ff9640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fba9006a430 0x7fba9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:29.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.906+0000 7fbaa0ff9640 1 -- 172.21.15.31:0/1206111970 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba9c088c70 con 0x7fbaa414ab30 2023-12-22T08:41:29.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.906+0000 7fbaa3fff640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fba9006a430 0x7fba9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:29.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.907+0000 7fbaa3fff640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fba9006a430 0x7fba9006c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba98006b10 tx=0x7fba98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:29.910+0000 7fbaa0ff9640 1 -- 172.21.15.31:0/1206111970 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fba9c054310 con 0x7fbaa414ab30 2023-12-22T08:41:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.084+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbaa406f6f0 con 0x7fba9006a430 2023-12-22T08:41:30.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.092+0000 7fbaa0ff9640 1 -- 172.21.15.31:0/1206111970 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264588 (secure 0 0 0) 0x7fba9800c040 con 0x7fba9006a430 2023-12-22T08:41:30.097 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:30.099 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:41:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fba9006a430 msgr2=0x7fba9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fba9006a430 0x7fba9006c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba98006b10 tx=0x7fba98008040 comp rx=0 tx=0).stop 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa414ab30 msgr2=0x7fbaa414e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa414ab30 0x7fbaa414e5d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00cc30 tx=0x7fba9c00a5c0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 shutdown_connections 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fba9006a430 0x7fba9006c8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaa414ab30 0x7fbaa414e5d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbaa4144f20 0x7fbaa41dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 --2- 172.21.15.31:0/1206111970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbaa40afb00 0x7fbaa40b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 >> 172.21.15.31:0/1206111970 conn(0x7fbaa40bc3d0 msgr2=0x7fbaa4148720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 shutdown_connections 2023-12-22T08:41:30.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.095+0000 7fbaaa461640 1 -- 172.21.15.31:0/1206111970 wait complete. 2023-12-22T08:41:30.108 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-12-22T08:41:29.793929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219488,"kb_used_data":3872,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755232,"statfs":{"total":773094113280,"available":772869357568,"internally_reserved":0,"allocated":3964928,"data_stored":2221756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.066842"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.134008+0000","last_change":"2023-12-22T08:41:27.129975+0000","last_active":"2023-12-22T08:41:27.134008+0000","last_peered":"2023-12-22T08:41:27.134008+0000","last_clean":"2023-12-22T08:41:27.134008+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:41:27.134008+0000","last_undegraded":"2023-12-22T08:41:27.134008+0000","last_fullsized":"2023-12-22T08:41:27.134008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:55.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133907+0000","last_change":"2023-12-22T08:41:27.132308+0000","last_active":"2023-12-22T08:41:27.133907+0000","last_peered":"2023-12-22T08:41:27.133907+0000","last_clean":"2023-12-22T08:41:27.133907+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:41:27.133907+0000","last_undegraded":"2023-12-22T08:41:27.133907+0000","last_fullsized":"2023-12-22T08:41:27.133907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111813+0000","last_change":"2023-12-22T08:41:27.117719+0000","last_active":"2023-12-22T08:41:28.111813+0000","last_peered":"2023-12-22T08:41:28.111813+0000","last_clean":"2023-12-22T08:41:28.111813+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:41:28.111813+0000","last_undegraded":"2023-12-22T08:41:28.111813+0000","last_fullsized":"2023-12-22T08:41:28.111813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112687+0000","last_change":"2023-12-22T08:41:27.126330+0000","last_active":"2023-12-22T08:41:28.112687+0000","last_peered":"2023-12-22T08:41:28.112687+0000","last_clean":"2023-12-22T08:41:28.112687+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:41:28.112687+0000","last_undegraded":"2023-12-22T08:41:28.112687+0000","last_fullsized":"2023-12-22T08:41:28.112687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.137877+0000","last_change":"2023-12-22T08:41:27.131419+0000","last_active":"2023-12-22T08:41:27.137877+0000","last_peered":"2023-12-22T08:41:27.137877+0000","last_clean":"2023-12-22T08:41:27.137877+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:41:27.137877+0000","last_undegraded":"2023-12-22T08:41:27.137877+0000","last_fullsized":"2023-12-22T08:41:27.137877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.722212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133369+0000","last_change":"2023-12-22T08:41:27.125465+0000","last_active":"2023-12-22T08:41:27.133369+0000","last_peered":"2023-12-22T08:41:27.133369+0000","last_clean":"2023-12-22T08:41:27.133369+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:41:27.133369+0000","last_undegraded":"2023-12-22T08:41:27.133369+0000","last_fullsized":"2023-12-22T08:41:27.133369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131444+0000","last_change":"2023-12-22T08:41:27.127918+0000","last_active":"2023-12-22T08:41:27.131444+0000","last_peered":"2023-12-22T08:41:27.131444+0000","last_clean":"2023-12-22T08:41:27.131444+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:41:27.131444+0000","last_undegraded":"2023-12-22T08:41:27.131444+0000","last_fullsized":"2023-12-22T08:41:27.131444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131999+0000","last_change":"2023-12-22T08:41:27.128397+0000","last_active":"2023-12-22T08:41:27.131999+0000","last_peered":"2023-12-22T08:41:27.131999+0000","last_clean":"2023-12-22T08:41:27.131999+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:41:27.131999+0000","last_undegraded":"2023-12-22T08:41:27.131999+0000","last_fullsized":"2023-12-22T08:41:27.131999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111299+0000","last_change":"2023-12-22T08:41:27.115975+0000","last_active":"2023-12-22T08:41:28.111299+0000","last_peered":"2023-12-22T08:41:28.111299+0000","last_clean":"2023-12-22T08:41:28.111299+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:41:28.111299+0000","last_undegraded":"2023-12-22T08:41:28.111299+0000","last_fullsized":"2023-12-22T08:41:28.111299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112929+0000","last_change":"2023-12-22T08:41:27.133760+0000","last_active":"2023-12-22T08:41:28.112929+0000","last_peered":"2023-12-22T08:41:28.112929+0000","last_clean":"2023-12-22T08:41:28.112929+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:41:28.112929+0000","last_undegraded":"2023-12-22T08:41:28.112929+0000","last_fullsized":"2023-12-22T08:41:28.112929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126211+0000","last_change":"2023-12-22T08:41:27.121357+0000","last_active":"2023-12-22T08:41:27.126211+0000","last_peered":"2023-12-22T08:41:27.126211+0000","last_clean":"2023-12-22T08:41:27.126211+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:41:27.126211+0000","last_undegraded":"2023-12-22T08:41:27.126211+0000","last_fullsized":"2023-12-22T08:41:27.126211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111645+0000","last_change":"2023-12-22T08:41:27.131986+0000","last_active":"2023-12-22T08:41:28.111645+0000","last_peered":"2023-12-22T08:41:28.111645+0000","last_clean":"2023-12-22T08:41:28.111645+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:41:28.111645+0000","last_undegraded":"2023-12-22T08:41:28.111645+0000","last_fullsized":"2023-12-22T08:41:28.111645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126360+0000","last_change":"2023-12-22T08:41:27.120741+0000","last_active":"2023-12-22T08:41:27.126360+0000","last_peered":"2023-12-22T08:41:27.126360+0000","last_clean":"2023-12-22T08:41:27.126360+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:27.126360+0000","last_undegraded":"2023-12-22T08:41:27.126360+0000","last_fullsized":"2023-12-22T08:41:27.126360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:46.823109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133780+0000","last_change":"2023-12-22T08:41:27.127642+0000","last_active":"2023-12-22T08:41:27.133780+0000","last_peered":"2023-12-22T08:41:27.133780+0000","last_clean":"2023-12-22T08:41:27.133780+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:27.133780+0000","last_undegraded":"2023-12-22T08:41:27.133780+0000","last_fullsized":"2023-12-22T08:41:27.133780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111013+0000","last_change":"2023-12-22T08:41:27.124240+0000","last_active":"2023-12-22T08:41:28.111013+0000","last_peered":"2023-12-22T08:41:28.111013+0000","last_clean":"2023-12-22T08:41:28.111013+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:28.111013+0000","last_undegraded":"2023-12-22T08:41:28.111013+0000","last_fullsized":"2023-12-22T08:41:28.111013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.136770+0000","last_change":"2023-12-22T08:41:27.131917+0000","last_active":"2023-12-22T08:41:27.136770+0000","last_peered":"2023-12-22T08:41:27.136770+0000","last_clean":"2023-12-22T08:41:27.136770+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:41:27.136770+0000","last_undegraded":"2023-12-22T08:41:27.136770+0000","last_fullsized":"2023-12-22T08:41:27.136770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131369+0000","last_change":"2023-12-22T08:41:27.126772+0000","last_active":"2023-12-22T08:41:27.131369+0000","last_peered":"2023-12-22T08:41:27.131369+0000","last_clean":"2023-12-22T08:41:27.131369+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:27.131369+0000","last_undegraded":"2023-12-22T08:41:27.131369+0000","last_fullsized":"2023-12-22T08:41:27.131369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133888+0000","last_change":"2023-12-22T08:41:27.132073+0000","last_active":"2023-12-22T08:41:27.133888+0000","last_peered":"2023-12-22T08:41:27.133888+0000","last_clean":"2023-12-22T08:41:27.133888+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:41:27.133888+0000","last_undegraded":"2023-12-22T08:41:27.133888+0000","last_fullsized":"2023-12-22T08:41:27.133888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133593+0000","last_change":"2023-12-22T08:41:27.128462+0000","last_active":"2023-12-22T08:41:27.133593+0000","last_peered":"2023-12-22T08:41:27.133593+0000","last_clean":"2023-12-22T08:41:27.133593+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:41:27.133593+0000","last_undegraded":"2023-12-22T08:41:27.133593+0000","last_fullsized":"2023-12-22T08:41:27.133593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128398+0000","last_change":"2023-12-22T08:41:27.124709+0000","last_active":"2023-12-22T08:41:27.128398+0000","last_peered":"2023-12-22T08:41:27.128398+0000","last_clean":"2023-12-22T08:41:27.128398+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:27.128398+0000","last_undegraded":"2023-12-22T08:41:27.128398+0000","last_fullsized":"2023-12-22T08:41:27.128398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:26.745936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111759+0000","last_change":"2023-12-22T08:41:27.120855+0000","last_active":"2023-12-22T08:41:28.111759+0000","last_peered":"2023-12-22T08:41:28.111759+0000","last_clean":"2023-12-22T08:41:28.111759+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:41:28.111759+0000","last_undegraded":"2023-12-22T08:41:28.111759+0000","last_fullsized":"2023-12-22T08:41:28.111759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:04.575089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111532+0000","last_change":"2023-12-22T08:41:27.129305+0000","last_active":"2023-12-22T08:41:28.111532+0000","last_peered":"2023-12-22T08:41:28.111532+0000","last_clean":"2023-12-22T08:41:28.111532+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:41:28.111532+0000","last_undegraded":"2023-12-22T08:41:28.111532+0000","last_fullsized":"2023-12-22T08:41:28.111532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128867+0000","last_change":"2023-12-22T08:41:27.123800+0000","last_active":"2023-12-22T08:41:27.128867+0000","last_peered":"2023-12-22T08:41:27.128867+0000","last_clean":"2023-12-22T08:41:27.128867+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:27.128867+0000","last_undegraded":"2023-12-22T08:41:27.128867+0000","last_fullsized":"2023-12-22T08:41:27.128867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110929+0000","last_change":"2023-12-22T08:41:27.114600+0000","last_active":"2023-12-22T08:41:28.110929+0000","last_peered":"2023-12-22T08:41:28.110929+0000","last_clean":"2023-12-22T08:41:28.110929+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:41:28.110929+0000","last_undegraded":"2023-12-22T08:41:28.110929+0000","last_fullsized":"2023-12-22T08:41:28.110929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113130+0000","last_change":"2023-12-22T08:41:27.121608+0000","last_active":"2023-12-22T08:41:28.113130+0000","last_peered":"2023-12-22T08:41:28.113130+0000","last_clean":"2023-12-22T08:41:28.113130+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:41:28.113130+0000","last_undegraded":"2023-12-22T08:41:28.113130+0000","last_fullsized":"2023-12-22T08:41:28.113130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133804+0000","last_change":"2023-12-22T08:41:27.131698+0000","last_active":"2023-12-22T08:41:27.133804+0000","last_peered":"2023-12-22T08:41:27.133804+0000","last_clean":"2023-12-22T08:41:27.133804+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:41:27.133804+0000","last_undegraded":"2023-12-22T08:41:27.133804+0000","last_fullsized":"2023-12-22T08:41:27.133804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113081+0000","last_change":"2023-12-22T08:41:27.121328+0000","last_active":"2023-12-22T08:41:28.113081+0000","last_peered":"2023-12-22T08:41:28.113081+0000","last_clean":"2023-12-22T08:41:28.113081+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:41:28.113081+0000","last_undegraded":"2023-12-22T08:41:28.113081+0000","last_fullsized":"2023-12-22T08:41:28.113081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111750+0000","last_change":"2023-12-22T08:41:27.117153+0000","last_active":"2023-12-22T08:41:28.111750+0000","last_peered":"2023-12-22T08:41:28.111750+0000","last_clean":"2023-12-22T08:41:28.111750+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:28.111750+0000","last_undegraded":"2023-12-22T08:41:28.111750+0000","last_fullsized":"2023-12-22T08:41:28.111750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111857+0000","last_change":"2023-12-22T08:41:27.128755+0000","last_active":"2023-12-22T08:41:28.111857+0000","last_peered":"2023-12-22T08:41:28.111857+0000","last_clean":"2023-12-22T08:41:28.111857+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:41:28.111857+0000","last_undegraded":"2023-12-22T08:41:28.111857+0000","last_fullsized":"2023-12-22T08:41:28.111857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131280+0000","last_change":"2023-12-22T08:41:27.126203+0000","last_active":"2023-12-22T08:41:27.131280+0000","last_peered":"2023-12-22T08:41:27.131280+0000","last_clean":"2023-12-22T08:41:27.131280+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:41:27.131280+0000","last_undegraded":"2023-12-22T08:41:27.131280+0000","last_fullsized":"2023-12-22T08:41:27.131280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133952+0000","last_change":"2023-12-22T08:41:27.127519+0000","last_active":"2023-12-22T08:41:27.133952+0000","last_peered":"2023-12-22T08:41:27.133952+0000","last_clean":"2023-12-22T08:41:27.133952+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:41:27.133952+0000","last_undegraded":"2023-12-22T08:41:27.133952+0000","last_fullsized":"2023-12-22T08:41:27.133952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:50.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.129207+0000","last_change":"2023-12-22T08:41:27.122823+0000","last_active":"2023-12-22T08:41:27.129207+0000","last_peered":"2023-12-22T08:41:27.129207+0000","last_clean":"2023-12-22T08:41:27.129207+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:41:27.129207+0000","last_undegraded":"2023-12-22T08:41:27.129207+0000","last_fullsized":"2023-12-22T08:41:27.129207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.123392+0000","last_change":"2023-12-22T08:41:27.121742+0000","last_active":"2023-12-22T08:41:27.123392+0000","last_peered":"2023-12-22T08:41:27.123392+0000","last_clean":"2023-12-22T08:41:27.123392+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:27.123392+0000","last_undegraded":"2023-12-22T08:41:27.123392+0000","last_fullsized":"2023-12-22T08:41:27.123392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.132017+0000","last_change":"2023-12-22T08:41:26.742786+0000","last_active":"2023-12-22T08:41:27.132017+0000","last_peered":"2023-12-22T08:41:27.132017+0000","last_clean":"2023-12-22T08:41:27.132017+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:27.132017+0000","last_undegraded":"2023-12-22T08:41:27.132017+0000","last_fullsized":"2023-12-22T08:41:27.132017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.134032+0000","last_change":"2023-12-22T08:41:27.130511+0000","last_active":"2023-12-22T08:41:27.134032+0000","last_peered":"2023-12-22T08:41:27.134032+0000","last_clean":"2023-12-22T08:41:27.134032+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:41:27.134032+0000","last_undegraded":"2023-12-22T08:41:27.134032+0000","last_fullsized":"2023-12-22T08:41:27.134032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:18.765379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128862+0000","last_change":"2023-12-22T08:41:26.743569+0000","last_active":"2023-12-22T08:41:27.128862+0000","last_peered":"2023-12-22T08:41:27.128862+0000","last_clean":"2023-12-22T08:41:27.128862+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:27.128862+0000","last_undegraded":"2023-12-22T08:41:27.128862+0000","last_fullsized":"2023-12-22T08:41:27.128862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111545+0000","last_change":"2023-12-22T08:41:27.128744+0000","last_active":"2023-12-22T08:41:28.111545+0000","last_peered":"2023-12-22T08:41:28.111545+0000","last_clean":"2023-12-22T08:41:28.111545+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:41:28.111545+0000","last_undegraded":"2023-12-22T08:41:28.111545+0000","last_fullsized":"2023-12-22T08:41:28.111545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.130669+0000","last_change":"2023-12-22T08:41:26.747403+0000","last_active":"2023-12-22T08:41:27.130669+0000","last_peered":"2023-12-22T08:41:27.130669+0000","last_clean":"2023-12-22T08:41:27.130669+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:27.130669+0000","last_undegraded":"2023-12-22T08:41:27.130669+0000","last_fullsized":"2023-12-22T08:41:27.130669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:17.763510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113171+0000","last_change":"2023-12-22T08:41:27.121058+0000","last_active":"2023-12-22T08:41:28.113171+0000","last_peered":"2023-12-22T08:41:28.113171+0000","last_clean":"2023-12-22T08:41:28.113171+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:41:28.113171+0000","last_undegraded":"2023-12-22T08:41:28.113171+0000","last_fullsized":"2023-12-22T08:41:28.113171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126464+0000","last_change":"2023-12-22T08:41:26.747241+0000","last_active":"2023-12-22T08:41:27.126464+0000","last_peered":"2023-12-22T08:41:27.126464+0000","last_clean":"2023-12-22T08:41:27.126464+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:27.126464+0000","last_undegraded":"2023-12-22T08:41:27.126464+0000","last_fullsized":"2023-12-22T08:41:27.126464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:52.257765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.129267+0000","last_change":"2023-12-22T08:41:27.123533+0000","last_active":"2023-12-22T08:41:27.129267+0000","last_peered":"2023-12-22T08:41:27.129267+0000","last_clean":"2023-12-22T08:41:27.129267+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:41:27.129267+0000","last_undegraded":"2023-12-22T08:41:27.129267+0000","last_fullsized":"2023-12-22T08:41:27.129267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111846+0000","last_change":"2023-12-22T08:41:26.750084+0000","last_active":"2023-12-22T08:41:28.111846+0000","last_peered":"2023-12-22T08:41:28.111846+0000","last_clean":"2023-12-22T08:41:28.111846+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:41:28.111846+0000","last_undegraded":"2023-12-22T08:41:28.111846+0000","last_fullsized":"2023-12-22T08:41:28.111846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111151+0000","last_change":"2023-12-22T08:41:27.125421+0000","last_active":"2023-12-22T08:41:28.111151+0000","last_peered":"2023-12-22T08:41:28.111151+0000","last_clean":"2023-12-22T08:41:28.111151+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:41:28.111151+0000","last_undegraded":"2023-12-22T08:41:28.111151+0000","last_fullsized":"2023-12-22T08:41:28.111151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:39.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111620+0000","last_change":"2023-12-22T08:41:26.743416+0000","last_active":"2023-12-22T08:41:28.111620+0000","last_peered":"2023-12-22T08:41:28.111620+0000","last_clean":"2023-12-22T08:41:28.111620+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:41:28.111620+0000","last_undegraded":"2023-12-22T08:41:28.111620+0000","last_fullsized":"2023-12-22T08:41:28.111620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:42.994044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111016+0000","last_change":"2023-12-22T08:41:27.123904+0000","last_active":"2023-12-22T08:41:28.111016+0000","last_peered":"2023-12-22T08:41:28.111016+0000","last_clean":"2023-12-22T08:41:28.111016+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:41:28.111016+0000","last_undegraded":"2023-12-22T08:41:28.111016+0000","last_fullsized":"2023-12-22T08:41:28.111016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.115977+0000","last_change":"2023-12-22T08:41:26.745648+0000","last_active":"2023-12-22T08:41:27.115977+0000","last_peered":"2023-12-22T08:41:27.115977+0000","last_clean":"2023-12-22T08:41:27.115977+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:41:27.115977+0000","last_undegraded":"2023-12-22T08:41:27.115977+0000","last_fullsized":"2023-12-22T08:41:27.115977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112566+0000","last_change":"2023-12-22T08:41:27.126166+0000","last_active":"2023-12-22T08:41:28.112566+0000","last_peered":"2023-12-22T08:41:28.112566+0000","last_clean":"2023-12-22T08:41:28.112566+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:28.112566+0000","last_undegraded":"2023-12-22T08:41:28.112566+0000","last_fullsized":"2023-12-22T08:41:28.112566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111017+0000","last_change":"2023-12-22T08:41:26.739716+0000","last_active":"2023-12-22T08:41:28.111017+0000","last_peered":"2023-12-22T08:41:28.111017+0000","last_clean":"2023-12-22T08:41:28.111017+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:28.111017+0000","last_undegraded":"2023-12-22T08:41:28.111017+0000","last_fullsized":"2023-12-22T08:41:28.111017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:25.744068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111505+0000","last_change":"2023-12-22T08:41:27.133504+0000","last_active":"2023-12-22T08:41:28.111505+0000","last_peered":"2023-12-22T08:41:28.111505+0000","last_clean":"2023-12-22T08:41:28.111505+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:41:28.111505+0000","last_undegraded":"2023-12-22T08:41:28.111505+0000","last_fullsized":"2023-12-22T08:41:28.111505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.118324+0000","last_change":"2023-12-22T08:41:26.743175+0000","last_active":"2023-12-22T08:41:27.118324+0000","last_peered":"2023-12-22T08:41:27.118324+0000","last_clean":"2023-12-22T08:41:27.118324+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:27.118324+0000","last_undegraded":"2023-12-22T08:41:27.118324+0000","last_fullsized":"2023-12-22T08:41:27.118324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:03.573220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133656+0000","last_change":"2023-12-22T08:41:27.129547+0000","last_active":"2023-12-22T08:41:27.133656+0000","last_peered":"2023-12-22T08:41:27.133656+0000","last_clean":"2023-12-22T08:41:27.133656+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:41:27.133656+0000","last_undegraded":"2023-12-22T08:41:27.133656+0000","last_fullsized":"2023-12-22T08:41:27.133656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.112998+0000","last_change":"2023-12-22T08:41:26.743757+0000","last_active":"2023-12-22T08:41:27.112998+0000","last_peered":"2023-12-22T08:41:27.112998+0000","last_clean":"2023-12-22T08:41:27.112998+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:27.112998+0000","last_undegraded":"2023-12-22T08:41:27.112998+0000","last_fullsized":"2023-12-22T08:41:27.112998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133796+0000","last_change":"2023-12-22T08:41:27.131773+0000","last_active":"2023-12-22T08:41:27.133796+0000","last_peered":"2023-12-22T08:41:27.133796+0000","last_clean":"2023-12-22T08:41:27.133796+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:41:27.133796+0000","last_undegraded":"2023-12-22T08:41:27.133796+0000","last_fullsized":"2023-12-22T08:41:27.133796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111905+0000","last_change":"2023-12-22T08:41:26.745597+0000","last_active":"2023-12-22T08:41:28.111905+0000","last_peered":"2023-12-22T08:41:28.111905+0000","last_clean":"2023-12-22T08:41:28.111905+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:28.111905+0000","last_undegraded":"2023-12-22T08:41:28.111905+0000","last_fullsized":"2023-12-22T08:41:28.111905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111718+0000","last_change":"2023-12-22T08:41:27.118227+0000","last_active":"2023-12-22T08:41:28.111718+0000","last_peered":"2023-12-22T08:41:28.111718+0000","last_clean":"2023-12-22T08:41:28.111718+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:41:28.111718+0000","last_undegraded":"2023-12-22T08:41:28.111718+0000","last_fullsized":"2023-12-22T08:41:28.111718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.138369+0000","last_change":"2023-12-22T08:41:26.748072+0000","last_active":"2023-12-22T08:41:27.138369+0000","last_peered":"2023-12-22T08:41:27.138369+0000","last_clean":"2023-12-22T08:41:27.138369+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:27.138369+0000","last_undegraded":"2023-12-22T08:41:27.138369+0000","last_fullsized":"2023-12-22T08:41:27.138369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:05.371284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112579+0000","last_change":"2023-12-22T08:41:27.120378+0000","last_active":"2023-12-22T08:41:28.112579+0000","last_peered":"2023-12-22T08:41:28.112579+0000","last_clean":"2023-12-22T08:41:28.112579+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:28.112579+0000","last_undegraded":"2023-12-22T08:41:28.112579+0000","last_fullsized":"2023-12-22T08:41:28.112579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111924+0000","last_change":"2023-12-22T08:41:26.740501+0000","last_active":"2023-12-22T08:41:28.111924+0000","last_peered":"2023-12-22T08:41:28.111924+0000","last_clean":"2023-12-22T08:41:28.111924+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:28.111924+0000","last_undegraded":"2023-12-22T08:41:28.111924+0000","last_fullsized":"2023-12-22T08:41:28.111924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133470+0000","last_change":"2023-12-22T08:41:27.127482+0000","last_active":"2023-12-22T08:41:27.133470+0000","last_peered":"2023-12-22T08:41:27.133470+0000","last_clean":"2023-12-22T08:41:27.133470+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:41:27.133470+0000","last_undegraded":"2023-12-22T08:41:27.133470+0000","last_fullsized":"2023-12-22T08:41:27.133470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112604+0000","last_change":"2023-12-22T08:41:26.746743+0000","last_active":"2023-12-22T08:41:28.112604+0000","last_peered":"2023-12-22T08:41:28.112604+0000","last_clean":"2023-12-22T08:41:28.112604+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:28.112604+0000","last_undegraded":"2023-12-22T08:41:28.112604+0000","last_fullsized":"2023-12-22T08:41:28.112604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.129231+0000","last_change":"2023-12-22T08:41:27.123864+0000","last_active":"2023-12-22T08:41:27.129231+0000","last_peered":"2023-12-22T08:41:27.129231+0000","last_clean":"2023-12-22T08:41:27.129231+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:41:27.129231+0000","last_undegraded":"2023-12-22T08:41:27.129231+0000","last_fullsized":"2023-12-22T08:41:27.129231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.116076+0000","last_change":"2023-12-22T08:41:26.742515+0000","last_active":"2023-12-22T08:41:27.116076+0000","last_peered":"2023-12-22T08:41:27.116076+0000","last_clean":"2023-12-22T08:41:27.116076+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:27.116076+0000","last_undegraded":"2023-12-22T08:41:27.116076+0000","last_fullsized":"2023-12-22T08:41:27.116076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:32.527496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126767+0000","last_change":"2023-12-22T08:41:27.122673+0000","last_active":"2023-12-22T08:41:27.126767+0000","last_peered":"2023-12-22T08:41:27.126767+0000","last_clean":"2023-12-22T08:41:27.126767+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:41:27.126767+0000","last_undegraded":"2023-12-22T08:41:27.126767+0000","last_fullsized":"2023-12-22T08:41:27.126767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:06.373152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.134353+0000","last_change":"2023-12-22T08:41:26.748785+0000","last_active":"2023-12-22T08:41:27.134353+0000","last_peered":"2023-12-22T08:41:27.134353+0000","last_clean":"2023-12-22T08:41:27.134353+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:41:27.134353+0000","last_undegraded":"2023-12-22T08:41:27.134353+0000","last_fullsized":"2023-12-22T08:41:27.134353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111273+0000","last_change":"2023-12-22T08:41:27.118299+0000","last_active":"2023-12-22T08:41:28.111273+0000","last_peered":"2023-12-22T08:41:28.111273+0000","last_clean":"2023-12-22T08:41:28.111273+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:41:28.111273+0000","last_undegraded":"2023-12-22T08:41:28.111273+0000","last_fullsized":"2023-12-22T08:41:28.111273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113208+0000","last_change":"2023-12-22T08:41:26.751813+0000","last_active":"2023-12-22T08:41:28.113208+0000","last_peered":"2023-12-22T08:41:28.113208+0000","last_clean":"2023-12-22T08:41:28.113208+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:28.113208+0000","last_undegraded":"2023-12-22T08:41:28.113208+0000","last_fullsized":"2023-12-22T08:41:28.113208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111455+0000","last_change":"2023-12-22T08:41:27.122998+0000","last_active":"2023-12-22T08:41:28.111455+0000","last_peered":"2023-12-22T08:41:28.111455+0000","last_clean":"2023-12-22T08:41:28.111455+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:41:28.111455+0000","last_undegraded":"2023-12-22T08:41:28.111455+0000","last_fullsized":"2023-12-22T08:41:28.111455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111193+0000","last_change":"2023-12-22T08:41:26.740945+0000","last_active":"2023-12-22T08:41:28.111193+0000","last_peered":"2023-12-22T08:41:28.111193+0000","last_clean":"2023-12-22T08:41:28.111193+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:41:28.111193+0000","last_undegraded":"2023-12-22T08:41:28.111193+0000","last_fullsized":"2023-12-22T08:41:28.111193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112745+0000","last_change":"2023-12-22T08:41:27.125917+0000","last_active":"2023-12-22T08:41:28.112745+0000","last_peered":"2023-12-22T08:41:28.112745+0000","last_clean":"2023-12-22T08:41:28.112745+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:41:28.112745+0000","last_undegraded":"2023-12-22T08:41:28.112745+0000","last_fullsized":"2023-12-22T08:41:28.112745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111940+0000","last_change":"2023-12-22T08:41:26.743117+0000","last_active":"2023-12-22T08:41:28.111940+0000","last_peered":"2023-12-22T08:41:28.111940+0000","last_clean":"2023-12-22T08:41:28.111940+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:41:28.111940+0000","last_undegraded":"2023-12-22T08:41:28.111940+0000","last_fullsized":"2023-12-22T08:41:28.111940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128652+0000","last_change":"2023-12-22T08:41:27.125969+0000","last_active":"2023-12-22T08:41:27.128652+0000","last_peered":"2023-12-22T08:41:27.128652+0000","last_clean":"2023-12-22T08:41:27.128652+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:27.128652+0000","last_undegraded":"2023-12-22T08:41:27.128652+0000","last_fullsized":"2023-12-22T08:41:27.128652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:34.167113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111633+0000","last_change":"2023-12-22T08:41:26.744095+0000","last_active":"2023-12-22T08:41:28.111633+0000","last_peered":"2023-12-22T08:41:28.111633+0000","last_clean":"2023-12-22T08:41:28.111633+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:41:28.111633+0000","last_undegraded":"2023-12-22T08:41:28.111633+0000","last_fullsized":"2023-12-22T08:41:28.111633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:11.707505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128577+0000","last_change":"2023-12-22T08:41:27.125387+0000","last_active":"2023-12-22T08:41:27.128577+0000","last_peered":"2023-12-22T08:41:27.128577+0000","last_clean":"2023-12-22T08:41:27.128577+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:27.128577+0000","last_undegraded":"2023-12-22T08:41:27.128577+0000","last_fullsized":"2023-12-22T08:41:27.128577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:31.788205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126646+0000","last_change":"2023-12-22T08:41:26.747215+0000","last_active":"2023-12-22T08:41:27.126646+0000","last_peered":"2023-12-22T08:41:27.126646+0000","last_clean":"2023-12-22T08:41:27.126646+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:27.126646+0000","last_undegraded":"2023-12-22T08:41:27.126646+0000","last_fullsized":"2023-12-22T08:41:27.126646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128367+0000","last_change":"2023-12-22T08:41:27.122152+0000","last_active":"2023-12-22T08:41:27.128367+0000","last_peered":"2023-12-22T08:41:27.128367+0000","last_clean":"2023-12-22T08:41:27.128367+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:27.128367+0000","last_undegraded":"2023-12-22T08:41:27.128367+0000","last_fullsized":"2023-12-22T08:41:27.128367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.709373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.116323+0000","last_change":"2023-12-22T08:41:26.746895+0000","last_active":"2023-12-22T08:41:27.116323+0000","last_peered":"2023-12-22T08:41:27.116323+0000","last_clean":"2023-12-22T08:41:27.116323+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:27.116323+0000","last_undegraded":"2023-12-22T08:41:27.116323+0000","last_fullsized":"2023-12-22T08:41:27.116323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126313+0000","last_change":"2023-12-22T08:41:27.121179+0000","last_active":"2023-12-22T08:41:27.126313+0000","last_peered":"2023-12-22T08:41:27.126313+0000","last_clean":"2023-12-22T08:41:27.126313+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:27.126313+0000","last_undegraded":"2023-12-22T08:41:27.126313+0000","last_fullsized":"2023-12-22T08:41:27.126313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:53.573498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111334+0000","last_change":"2023-12-22T08:41:26.744242+0000","last_active":"2023-12-22T08:41:28.111334+0000","last_peered":"2023-12-22T08:41:28.111334+0000","last_clean":"2023-12-22T08:41:28.111334+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:28.111334+0000","last_undegraded":"2023-12-22T08:41:28.111334+0000","last_fullsized":"2023-12-22T08:41:28.111334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.129305+0000","last_change":"2023-12-22T08:41:27.125910+0000","last_active":"2023-12-22T08:41:27.129305+0000","last_peered":"2023-12-22T08:41:27.129305+0000","last_clean":"2023-12-22T08:41:27.129305+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:41:27.129305+0000","last_undegraded":"2023-12-22T08:41:27.129305+0000","last_fullsized":"2023-12-22T08:41:27.129305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110836+0000","last_change":"2023-12-22T08:41:26.747152+0000","last_active":"2023-12-22T08:41:28.110836+0000","last_peered":"2023-12-22T08:41:28.110836+0000","last_clean":"2023-12-22T08:41:28.110836+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:28.110836+0000","last_undegraded":"2023-12-22T08:41:28.110836+0000","last_fullsized":"2023-12-22T08:41:28.110836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128301+0000","last_change":"2023-12-22T08:41:27.122069+0000","last_active":"2023-12-22T08:41:27.128301+0000","last_peered":"2023-12-22T08:41:27.128301+0000","last_clean":"2023-12-22T08:41:27.128301+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:27.128301+0000","last_undegraded":"2023-12-22T08:41:27.128301+0000","last_fullsized":"2023-12-22T08:41:27.128301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:04.235137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113220+0000","last_change":"2023-12-22T08:41:26.748464+0000","last_active":"2023-12-22T08:41:28.113220+0000","last_peered":"2023-12-22T08:41:28.113220+0000","last_clean":"2023-12-22T08:41:28.113220+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:28.113220+0000","last_undegraded":"2023-12-22T08:41:28.113220+0000","last_fullsized":"2023-12-22T08:41:28.113220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111578+0000","last_change":"2023-12-22T08:41:27.117970+0000","last_active":"2023-12-22T08:41:28.111578+0000","last_peered":"2023-12-22T08:41:28.111578+0000","last_clean":"2023-12-22T08:41:28.111578+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:41:28.111578+0000","last_undegraded":"2023-12-22T08:41:28.111578+0000","last_fullsized":"2023-12-22T08:41:28.111578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.113093+0000","last_change":"2023-12-22T08:41:26.744425+0000","last_active":"2023-12-22T08:41:27.113093+0000","last_peered":"2023-12-22T08:41:27.113093+0000","last_clean":"2023-12-22T08:41:27.113093+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:27.113093+0000","last_undegraded":"2023-12-22T08:41:27.113093+0000","last_fullsized":"2023-12-22T08:41:27.113093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:17.007353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.123361+0000","last_change":"2023-12-22T08:41:27.121596+0000","last_active":"2023-12-22T08:41:27.123361+0000","last_peered":"2023-12-22T08:41:27.123361+0000","last_clean":"2023-12-22T08:41:27.123361+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:27.123361+0000","last_undegraded":"2023-12-22T08:41:27.123361+0000","last_fullsized":"2023-12-22T08:41:27.123361+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112784+0000","last_change":"2023-12-22T08:41:26.748558+0000","last_active":"2023-12-22T08:41:28.112784+0000","last_peered":"2023-12-22T08:41:28.112784+0000","last_clean":"2023-12-22T08:41:28.112784+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:28.112784+0000","last_undegraded":"2023-12-22T08:41:28.112784+0000","last_fullsized":"2023-12-22T08:41:28.112784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126819+0000","last_change":"2023-12-22T08:41:27.124314+0000","last_active":"2023-12-22T08:41:27.126819+0000","last_peered":"2023-12-22T08:41:27.126819+0000","last_clean":"2023-12-22T08:41:27.126819+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:27.126819+0000","last_undegraded":"2023-12-22T08:41:27.126819+0000","last_fullsized":"2023-12-22T08:41:27.126819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:18.009221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.114451+0000","last_change":"2023-12-22T08:41:26.740301+0000","last_active":"2023-12-22T08:41:27.114451+0000","last_peered":"2023-12-22T08:41:27.114451+0000","last_clean":"2023-12-22T08:41:27.114451+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:27.114451+0000","last_undegraded":"2023-12-22T08:41:27.114451+0000","last_fullsized":"2023-12-22T08:41:27.114451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.123295+0000","last_change":"2023-12-22T08:41:27.121048+0000","last_active":"2023-12-22T08:41:27.123295+0000","last_peered":"2023-12-22T08:41:27.123295+0000","last_clean":"2023-12-22T08:41:27.123295+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:27.123295+0000","last_undegraded":"2023-12-22T08:41:27.123295+0000","last_fullsized":"2023-12-22T08:41:27.123295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112660+0000","last_change":"2023-12-22T08:41:26.747176+0000","last_active":"2023-12-22T08:41:28.112660+0000","last_peered":"2023-12-22T08:41:28.112660+0000","last_clean":"2023-12-22T08:41:28.112660+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:28.112660+0000","last_undegraded":"2023-12-22T08:41:28.112660+0000","last_fullsized":"2023-12-22T08:41:28.112660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.130840+0000","last_change":"2023-12-22T08:41:27.122915+0000","last_active":"2023-12-22T08:41:27.130840+0000","last_peered":"2023-12-22T08:41:27.130840+0000","last_clean":"2023-12-22T08:41:27.130840+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:41:27.130840+0000","last_undegraded":"2023-12-22T08:41:27.130840+0000","last_fullsized":"2023-12-22T08:41:27.130840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:27.533832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111422+0000","last_change":"2023-12-22T08:41:26.739638+0000","last_active":"2023-12-22T08:41:28.111422+0000","last_peered":"2023-12-22T08:41:28.111422+0000","last_clean":"2023-12-22T08:41:28.111422+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:28.111422+0000","last_undegraded":"2023-12-22T08:41:28.111422+0000","last_fullsized":"2023-12-22T08:41:28.111422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:03.233269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111243+0000","last_change":"2023-12-22T08:41:27.131013+0000","last_active":"2023-12-22T08:41:28.111243+0000","last_peered":"2023-12-22T08:41:28.111243+0000","last_clean":"2023-12-22T08:41:28.111243+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:41:28.111243+0000","last_undegraded":"2023-12-22T08:41:28.111243+0000","last_fullsized":"2023-12-22T08:41:28.111243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.114941+0000","last_change":"2023-12-22T08:41:26.745042+0000","last_active":"2023-12-22T08:41:27.114941+0000","last_peered":"2023-12-22T08:41:27.114941+0000","last_clean":"2023-12-22T08:41:27.114941+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:27.114941+0000","last_undegraded":"2023-12-22T08:41:27.114941+0000","last_fullsized":"2023-12-22T08:41:27.114941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131429+0000","last_change":"2023-12-22T08:41:27.128761+0000","last_active":"2023-12-22T08:41:27.131429+0000","last_peered":"2023-12-22T08:41:27.131429+0000","last_clean":"2023-12-22T08:41:27.131429+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:27.131429+0000","last_undegraded":"2023-12-22T08:41:27.131429+0000","last_fullsized":"2023-12-22T08:41:27.131429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.116206+0000","last_change":"2023-12-22T08:41:26.742603+0000","last_active":"2023-12-22T08:41:27.116206+0000","last_peered":"2023-12-22T08:41:27.116206+0000","last_clean":"2023-12-22T08:41:27.116206+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:27.116206+0000","last_undegraded":"2023-12-22T08:41:27.116206+0000","last_fullsized":"2023-12-22T08:41:27.116206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-22T08:41:26.739927+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:41:26.739927+0000","last_peered":"2023-12-22T08:41:26.739927+0000","last_clean":"2023-12-22T08:41:26.739927+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:26.739927+0000","last_undegraded":"2023-12-22T08:41:26.739927+0000","last_fullsized":"2023-12-22T08:41:26.739927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":718420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":128578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":128066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":129548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":339968,"data_stored":128032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":929792,"data_stored":718330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:41:30.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:30.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.251+0000 7efd63163640 1 Processor -- start 2023-12-22T08:41:30.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.251+0000 7efd63163640 1 -- start start 2023-12-22T08:41:30.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd63163640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd5c06a6d0 0x7efd5c14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd63163640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efd5c14b1f0 0x7efd5c0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd63163640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c0bb310 con 0x7efd5c0ba550 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd63163640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c0bf960 con 0x7efd5c06a6d0 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd63163640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c0bb5b0 con 0x7efd5c14b1f0 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd60eff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd5c06a6d0 0x7efd5c14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd61700640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efd5c0ba550 0x7efd5c14e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33648/0 (socket says 172.21.15.31:33648) 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd60eff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd5c06a6d0 0x7efd5c14acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34834/0 (socket says 172.21.15.31:34834) 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd61700640 1 -- 172.21.15.31:0/1189689202 learned_addr learned my addr 172.21.15.31:0/1189689202 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd5bfff640 1 --2- 172.21.15.31:0/1189689202 >> v2:172.21.15.69:3300/0 conn(0x7efd5c14b1f0 0x7efd5c0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd60eff640 1 -- 172.21.15.31:0/1189689202 >> v2:172.21.15.69:3300/0 conn(0x7efd5c14b1f0 msgr2=0x7efd5c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd60eff640 1 --2- 172.21.15.31:0/1189689202 >> v2:172.21.15.69:3300/0 conn(0x7efd5c14b1f0 0x7efd5c0b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd60eff640 1 -- 172.21.15.31:0/1189689202 >> v1:172.21.15.31:6789/0 conn(0x7efd5c0ba550 legacy=0x7efd5c14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd5b7fe640 1 -- 172.21.15.31:0/1189689202 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372111757 0 0) 0x7efd5c0bb310 con 0x7efd5c0ba550 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.252+0000 7efd60eff640 1 -- 172.21.15.31:0/1189689202 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0c0120 con 0x7efd5c06a6d0 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.253+0000 7efd60eff640 1 --2- 172.21.15.31:0/1189689202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c06a6d0 0x7efd5c14acb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0bde10 tx=0x7efd4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd734db8c44fb87 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.253+0000 7efd5b7fe640 1 -- 172.21.15.31:0/1189689202 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c031830 con 0x7efd5c06a6d0 2023-12-22T08:41:30.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.253+0000 7efd5b7fe640 1 -- 172.21.15.31:0/1189689202 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c031990 con 0x7efd5c06a6d0 2023-12-22T08:41:30.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.253+0000 7efd5b7fe640 1 -- 172.21.15.31:0/1189689202 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c031d20 con 0x7efd5c06a6d0 2023-12-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.254+0000 7efd63163640 1 -- 172.21.15.31:0/1189689202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c06a6d0 msgr2=0x7efd5c14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.254+0000 7efd63163640 1 --2- 172.21.15.31:0/1189689202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c06a6d0 0x7efd5c14acb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0bde10 tx=0x7efd4c02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.254+0000 7efd63163640 1 -- 172.21.15.31:0/1189689202 shutdown_connections 2023-12-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.254+0000 7efd63163640 1 --2- 172.21.15.31:0/1189689202 >> v2:172.21.15.69:3300/0 conn(0x7efd5c14b1f0 0x7efd5c0b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.254+0000 7efd63163640 1 --2- 172.21.15.31:0/1189689202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c06a6d0 0x7efd5c14acb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.254+0000 7efd63163640 1 -- 172.21.15.31:0/1189689202 >> 172.21.15.31:0/1189689202 conn(0x7efd5c0c0350 msgr2=0x7efd5c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.254+0000 7efd63163640 1 -- 172.21.15.31:0/1189689202 shutdown_connections 2023-12-22T08:41:30.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.254+0000 7efd63163640 1 -- 172.21.15.31:0/1189689202 wait complete. 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.255+0000 7efd63163640 1 Processor -- start 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.255+0000 7efd63163640 1 -- start start 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd63163640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd5c06a6d0 0x7efd5c0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd63163640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd5c0ba550 0x7efd5c1e0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd63163640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c14b1f0 0x7efd5c1e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd63163640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c1e02c0 con 0x7efd5c14b1f0 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd63163640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0a5930 con 0x7efd5c06a6d0 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd63163640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0b51b0 con 0x7efd5c0ba550 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c14b1f0 0x7efd5c1e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c14b1f0 0x7efd5c1e39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34836/0 (socket says 172.21.15.31:34836) 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 -- 172.21.15.31:0/3172914457 learned_addr learned my addr 172.21.15.31:0/3172914457 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd60eff640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd5c06a6d0 0x7efd5c0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd5bfff640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd5c0ba550 0x7efd5c1e0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 -- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd5c0ba550 msgr2=0x7efd5c1e0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd5c0ba550 0x7efd5c1e0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 -- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd5c06a6d0 msgr2=0x7efd5c0a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd5c06a6d0 0x7efd5c0a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 -- 172.21.15.31:0/3172914457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c009400 con 0x7efd5c14b1f0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd61700640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c14b1f0 0x7efd5c1e39c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c7e0 tx=0x7efd5400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd597fa640 1 -- 172.21.15.31:0/3172914457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400a640 con 0x7efd5c14b1f0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd597fa640 1 -- 172.21.15.31:0/3172914457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5400a7a0 con 0x7efd5c14b1f0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c14ebf0 con 0x7efd5c14b1f0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd597fa640 1 -- 172.21.15.31:0/3172914457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400ab30 con 0x7efd5c14b1f0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.256+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c0b3a10 con 0x7efd5c14b1f0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.257+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c1e0470 con 0x7efd5c14b1f0 2023-12-22T08:41:30.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.258+0000 7efd597fa640 1 -- 172.21.15.31:0/3172914457 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd5400ac90 con 0x7efd5c14b1f0 2023-12-22T08:41:30.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.258+0000 7efd597fa640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd4806a430 0x7efd4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.258+0000 7efd597fa640 1 -- 172.21.15.31:0/3172914457 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd54087ca0 con 0x7efd5c14b1f0 2023-12-22T08:41:30.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.259+0000 7efd60eff640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd4806a430 0x7efd4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.259+0000 7efd60eff640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd4806a430 0x7efd4806c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efd4c036000 tx=0x7efd4c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.263+0000 7efd597fa640 1 -- 172.21.15.31:0/3172914457 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efd5c1e0470 con 0x7efd5c14b1f0 2023-12-22T08:41:30.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.434+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd5c0c1160 con 0x7efd4806a430 2023-12-22T08:41:30.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.441+0000 7efd597fa640 1 -- 172.21.15.31:0/3172914457 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264588 (secure 0 0 0) 0x7efd4c045410 con 0x7efd4806a430 2023-12-22T08:41:30.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:30.448 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:41:30.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd4806a430 msgr2=0x7efd4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd4806a430 0x7efd4806c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efd4c036000 tx=0x7efd4c03c040 comp rx=0 tx=0).stop 2023-12-22T08:41:30.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c14b1f0 msgr2=0x7efd5c1e39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c14b1f0 0x7efd5c1e39c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c7e0 tx=0x7efd5400cca0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 shutdown_connections 2023-12-22T08:41:30.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7efd4806a430 0x7efd4806c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd5c14b1f0 0x7efd5c1e39c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efd5c0ba550 0x7efd5c1e0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 --2- 172.21.15.31:0/3172914457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd5c06a6d0 0x7efd5c0a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 >> 172.21.15.31:0/3172914457 conn(0x7efd5c0c0350 msgr2=0x7efd5c146b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:30.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 shutdown_connections 2023-12-22T08:41:30.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.444+0000 7efd63163640 1 -- 172.21.15.31:0/3172914457 wait complete. 2023-12-22T08:41:30.457 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-12-22T08:41:29.793929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219488,"kb_used_data":3872,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755232,"statfs":{"total":773094113280,"available":772869357568,"internally_reserved":0,"allocated":3964928,"data_stored":2221756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.066842"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.134008+0000","last_change":"2023-12-22T08:41:27.129975+0000","last_active":"2023-12-22T08:41:27.134008+0000","last_peered":"2023-12-22T08:41:27.134008+0000","last_clean":"2023-12-22T08:41:27.134008+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:41:27.134008+0000","last_undegraded":"2023-12-22T08:41:27.134008+0000","last_fullsized":"2023-12-22T08:41:27.134008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:55.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133907+0000","last_change":"2023-12-22T08:41:27.132308+0000","last_active":"2023-12-22T08:41:27.133907+0000","last_peered":"2023-12-22T08:41:27.133907+0000","last_clean":"2023-12-22T08:41:27.133907+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:41:27.133907+0000","last_undegraded":"2023-12-22T08:41:27.133907+0000","last_fullsized":"2023-12-22T08:41:27.133907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111813+0000","last_change":"2023-12-22T08:41:27.117719+0000","last_active":"2023-12-22T08:41:28.111813+0000","last_peered":"2023-12-22T08:41:28.111813+0000","last_clean":"2023-12-22T08:41:28.111813+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:41:28.111813+0000","last_undegraded":"2023-12-22T08:41:28.111813+0000","last_fullsized":"2023-12-22T08:41:28.111813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112687+0000","last_change":"2023-12-22T08:41:27.126330+0000","last_active":"2023-12-22T08:41:28.112687+0000","last_peered":"2023-12-22T08:41:28.112687+0000","last_clean":"2023-12-22T08:41:28.112687+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:41:28.112687+0000","last_undegraded":"2023-12-22T08:41:28.112687+0000","last_fullsized":"2023-12-22T08:41:28.112687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.137877+0000","last_change":"2023-12-22T08:41:27.131419+0000","last_active":"2023-12-22T08:41:27.137877+0000","last_peered":"2023-12-22T08:41:27.137877+0000","last_clean":"2023-12-22T08:41:27.137877+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:41:27.137877+0000","last_undegraded":"2023-12-22T08:41:27.137877+0000","last_fullsized":"2023-12-22T08:41:27.137877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.722212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133369+0000","last_change":"2023-12-22T08:41:27.125465+0000","last_active":"2023-12-22T08:41:27.133369+0000","last_peered":"2023-12-22T08:41:27.133369+0000","last_clean":"2023-12-22T08:41:27.133369+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:41:27.133369+0000","last_undegraded":"2023-12-22T08:41:27.133369+0000","last_fullsized":"2023-12-22T08:41:27.133369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131444+0000","last_change":"2023-12-22T08:41:27.127918+0000","last_active":"2023-12-22T08:41:27.131444+0000","last_peered":"2023-12-22T08:41:27.131444+0000","last_clean":"2023-12-22T08:41:27.131444+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:41:27.131444+0000","last_undegraded":"2023-12-22T08:41:27.131444+0000","last_fullsized":"2023-12-22T08:41:27.131444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131999+0000","last_change":"2023-12-22T08:41:27.128397+0000","last_active":"2023-12-22T08:41:27.131999+0000","last_peered":"2023-12-22T08:41:27.131999+0000","last_clean":"2023-12-22T08:41:27.131999+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:41:27.131999+0000","last_undegraded":"2023-12-22T08:41:27.131999+0000","last_fullsized":"2023-12-22T08:41:27.131999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111299+0000","last_change":"2023-12-22T08:41:27.115975+0000","last_active":"2023-12-22T08:41:28.111299+0000","last_peered":"2023-12-22T08:41:28.111299+0000","last_clean":"2023-12-22T08:41:28.111299+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:41:28.111299+0000","last_undegraded":"2023-12-22T08:41:28.111299+0000","last_fullsized":"2023-12-22T08:41:28.111299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112929+0000","last_change":"2023-12-22T08:41:27.133760+0000","last_active":"2023-12-22T08:41:28.112929+0000","last_peered":"2023-12-22T08:41:28.112929+0000","last_clean":"2023-12-22T08:41:28.112929+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:41:28.112929+0000","last_undegraded":"2023-12-22T08:41:28.112929+0000","last_fullsized":"2023-12-22T08:41:28.112929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126211+0000","last_change":"2023-12-22T08:41:27.121357+0000","last_active":"2023-12-22T08:41:27.126211+0000","last_peered":"2023-12-22T08:41:27.126211+0000","last_clean":"2023-12-22T08:41:27.126211+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:41:27.126211+0000","last_undegraded":"2023-12-22T08:41:27.126211+0000","last_fullsized":"2023-12-22T08:41:27.126211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111645+0000","last_change":"2023-12-22T08:41:27.131986+0000","last_active":"2023-12-22T08:41:28.111645+0000","last_peered":"2023-12-22T08:41:28.111645+0000","last_clean":"2023-12-22T08:41:28.111645+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:41:28.111645+0000","last_undegraded":"2023-12-22T08:41:28.111645+0000","last_fullsized":"2023-12-22T08:41:28.111645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126360+0000","last_change":"2023-12-22T08:41:27.120741+0000","last_active":"2023-12-22T08:41:27.126360+0000","last_peered":"2023-12-22T08:41:27.126360+0000","last_clean":"2023-12-22T08:41:27.126360+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:27.126360+0000","last_undegraded":"2023-12-22T08:41:27.126360+0000","last_fullsized":"2023-12-22T08:41:27.126360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:46.823109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133780+0000","last_change":"2023-12-22T08:41:27.127642+0000","last_active":"2023-12-22T08:41:27.133780+0000","last_peered":"2023-12-22T08:41:27.133780+0000","last_clean":"2023-12-22T08:41:27.133780+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:27.133780+0000","last_undegraded":"2023-12-22T08:41:27.133780+0000","last_fullsized":"2023-12-22T08:41:27.133780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111013+0000","last_change":"2023-12-22T08:41:27.124240+0000","last_active":"2023-12-22T08:41:28.111013+0000","last_peered":"2023-12-22T08:41:28.111013+0000","last_clean":"2023-12-22T08:41:28.111013+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:28.111013+0000","last_undegraded":"2023-12-22T08:41:28.111013+0000","last_fullsized":"2023-12-22T08:41:28.111013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.136770+0000","last_change":"2023-12-22T08:41:27.131917+0000","last_active":"2023-12-22T08:41:27.136770+0000","last_peered":"2023-12-22T08:41:27.136770+0000","last_clean":"2023-12-22T08:41:27.136770+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:41:27.136770+0000","last_undegraded":"2023-12-22T08:41:27.136770+0000","last_fullsized":"2023-12-22T08:41:27.136770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131369+0000","last_change":"2023-12-22T08:41:27.126772+0000","last_active":"2023-12-22T08:41:27.131369+0000","last_peered":"2023-12-22T08:41:27.131369+0000","last_clean":"2023-12-22T08:41:27.131369+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:27.131369+0000","last_undegraded":"2023-12-22T08:41:27.131369+0000","last_fullsized":"2023-12-22T08:41:27.131369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133888+0000","last_change":"2023-12-22T08:41:27.132073+0000","last_active":"2023-12-22T08:41:27.133888+0000","last_peered":"2023-12-22T08:41:27.133888+0000","last_clean":"2023-12-22T08:41:27.133888+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:41:27.133888+0000","last_undegraded":"2023-12-22T08:41:27.133888+0000","last_fullsized":"2023-12-22T08:41:27.133888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133593+0000","last_change":"2023-12-22T08:41:27.128462+0000","last_active":"2023-12-22T08:41:27.133593+0000","last_peered":"2023-12-22T08:41:27.133593+0000","last_clean":"2023-12-22T08:41:27.133593+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:41:27.133593+0000","last_undegraded":"2023-12-22T08:41:27.133593+0000","last_fullsized":"2023-12-22T08:41:27.133593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128398+0000","last_change":"2023-12-22T08:41:27.124709+0000","last_active":"2023-12-22T08:41:27.128398+0000","last_peered":"2023-12-22T08:41:27.128398+0000","last_clean":"2023-12-22T08:41:27.128398+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:27.128398+0000","last_undegraded":"2023-12-22T08:41:27.128398+0000","last_fullsized":"2023-12-22T08:41:27.128398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:26.745936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111759+0000","last_change":"2023-12-22T08:41:27.120855+0000","last_active":"2023-12-22T08:41:28.111759+0000","last_peered":"2023-12-22T08:41:28.111759+0000","last_clean":"2023-12-22T08:41:28.111759+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:41:28.111759+0000","last_undegraded":"2023-12-22T08:41:28.111759+0000","last_fullsized":"2023-12-22T08:41:28.111759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:04.575089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111532+0000","last_change":"2023-12-22T08:41:27.129305+0000","last_active":"2023-12-22T08:41:28.111532+0000","last_peered":"2023-12-22T08:41:28.111532+0000","last_clean":"2023-12-22T08:41:28.111532+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:41:28.111532+0000","last_undegraded":"2023-12-22T08:41:28.111532+0000","last_fullsized":"2023-12-22T08:41:28.111532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128867+0000","last_change":"2023-12-22T08:41:27.123800+0000","last_active":"2023-12-22T08:41:27.128867+0000","last_peered":"2023-12-22T08:41:27.128867+0000","last_clean":"2023-12-22T08:41:27.128867+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:27.128867+0000","last_undegraded":"2023-12-22T08:41:27.128867+0000","last_fullsized":"2023-12-22T08:41:27.128867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110929+0000","last_change":"2023-12-22T08:41:27.114600+0000","last_active":"2023-12-22T08:41:28.110929+0000","last_peered":"2023-12-22T08:41:28.110929+0000","last_clean":"2023-12-22T08:41:28.110929+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:41:28.110929+0000","last_undegraded":"2023-12-22T08:41:28.110929+0000","last_fullsized":"2023-12-22T08:41:28.110929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113130+0000","last_change":"2023-12-22T08:41:27.121608+0000","last_active":"2023-12-22T08:41:28.113130+0000","last_peered":"2023-12-22T08:41:28.113130+0000","last_clean":"2023-12-22T08:41:28.113130+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:41:28.113130+0000","last_undegraded":"2023-12-22T08:41:28.113130+0000","last_fullsized":"2023-12-22T08:41:28.113130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133804+0000","last_change":"2023-12-22T08:41:27.131698+0000","last_active":"2023-12-22T08:41:27.133804+0000","last_peered":"2023-12-22T08:41:27.133804+0000","last_clean":"2023-12-22T08:41:27.133804+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:41:27.133804+0000","last_undegraded":"2023-12-22T08:41:27.133804+0000","last_fullsized":"2023-12-22T08:41:27.133804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113081+0000","last_change":"2023-12-22T08:41:27.121328+0000","last_active":"2023-12-22T08:41:28.113081+0000","last_peered":"2023-12-22T08:41:28.113081+0000","last_clean":"2023-12-22T08:41:28.113081+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:41:28.113081+0000","last_undegraded":"2023-12-22T08:41:28.113081+0000","last_fullsized":"2023-12-22T08:41:28.113081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111750+0000","last_change":"2023-12-22T08:41:27.117153+0000","last_active":"2023-12-22T08:41:28.111750+0000","last_peered":"2023-12-22T08:41:28.111750+0000","last_clean":"2023-12-22T08:41:28.111750+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:28.111750+0000","last_undegraded":"2023-12-22T08:41:28.111750+0000","last_fullsized":"2023-12-22T08:41:28.111750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111857+0000","last_change":"2023-12-22T08:41:27.128755+0000","last_active":"2023-12-22T08:41:28.111857+0000","last_peered":"2023-12-22T08:41:28.111857+0000","last_clean":"2023-12-22T08:41:28.111857+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:41:28.111857+0000","last_undegraded":"2023-12-22T08:41:28.111857+0000","last_fullsized":"2023-12-22T08:41:28.111857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131280+0000","last_change":"2023-12-22T08:41:27.126203+0000","last_active":"2023-12-22T08:41:27.131280+0000","last_peered":"2023-12-22T08:41:27.131280+0000","last_clean":"2023-12-22T08:41:27.131280+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:41:27.131280+0000","last_undegraded":"2023-12-22T08:41:27.131280+0000","last_fullsized":"2023-12-22T08:41:27.131280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133952+0000","last_change":"2023-12-22T08:41:27.127519+0000","last_active":"2023-12-22T08:41:27.133952+0000","last_peered":"2023-12-22T08:41:27.133952+0000","last_clean":"2023-12-22T08:41:27.133952+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:41:27.133952+0000","last_undegraded":"2023-12-22T08:41:27.133952+0000","last_fullsized":"2023-12-22T08:41:27.133952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:50.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.129207+0000","last_change":"2023-12-22T08:41:27.122823+0000","last_active":"2023-12-22T08:41:27.129207+0000","last_peered":"2023-12-22T08:41:27.129207+0000","last_clean":"2023-12-22T08:41:27.129207+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:41:27.129207+0000","last_undegraded":"2023-12-22T08:41:27.129207+0000","last_fullsized":"2023-12-22T08:41:27.129207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.123392+0000","last_change":"2023-12-22T08:41:27.121742+0000","last_active":"2023-12-22T08:41:27.123392+0000","last_peered":"2023-12-22T08:41:27.123392+0000","last_clean":"2023-12-22T08:41:27.123392+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:27.123392+0000","last_undegraded":"2023-12-22T08:41:27.123392+0000","last_fullsized":"2023-12-22T08:41:27.123392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.132017+0000","last_change":"2023-12-22T08:41:26.742786+0000","last_active":"2023-12-22T08:41:27.132017+0000","last_peered":"2023-12-22T08:41:27.132017+0000","last_clean":"2023-12-22T08:41:27.132017+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:27.132017+0000","last_undegraded":"2023-12-22T08:41:27.132017+0000","last_fullsized":"2023-12-22T08:41:27.132017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.134032+0000","last_change":"2023-12-22T08:41:27.130511+0000","last_active":"2023-12-22T08:41:27.134032+0000","last_peered":"2023-12-22T08:41:27.134032+0000","last_clean":"2023-12-22T08:41:27.134032+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:41:27.134032+0000","last_undegraded":"2023-12-22T08:41:27.134032+0000","last_fullsized":"2023-12-22T08:41:27.134032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:18.765379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128862+0000","last_change":"2023-12-22T08:41:26.743569+0000","last_active":"2023-12-22T08:41:27.128862+0000","last_peered":"2023-12-22T08:41:27.128862+0000","last_clean":"2023-12-22T08:41:27.128862+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:27.128862+0000","last_undegraded":"2023-12-22T08:41:27.128862+0000","last_fullsized":"2023-12-22T08:41:27.128862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111545+0000","last_change":"2023-12-22T08:41:27.128744+0000","last_active":"2023-12-22T08:41:28.111545+0000","last_peered":"2023-12-22T08:41:28.111545+0000","last_clean":"2023-12-22T08:41:28.111545+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:41:28.111545+0000","last_undegraded":"2023-12-22T08:41:28.111545+0000","last_fullsized":"2023-12-22T08:41:28.111545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.130669+0000","last_change":"2023-12-22T08:41:26.747403+0000","last_active":"2023-12-22T08:41:27.130669+0000","last_peered":"2023-12-22T08:41:27.130669+0000","last_clean":"2023-12-22T08:41:27.130669+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:27.130669+0000","last_undegraded":"2023-12-22T08:41:27.130669+0000","last_fullsized":"2023-12-22T08:41:27.130669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:17.763510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113171+0000","last_change":"2023-12-22T08:41:27.121058+0000","last_active":"2023-12-22T08:41:28.113171+0000","last_peered":"2023-12-22T08:41:28.113171+0000","last_clean":"2023-12-22T08:41:28.113171+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:41:28.113171+0000","last_undegraded":"2023-12-22T08:41:28.113171+0000","last_fullsized":"2023-12-22T08:41:28.113171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126464+0000","last_change":"2023-12-22T08:41:26.747241+0000","last_active":"2023-12-22T08:41:27.126464+0000","last_peered":"2023-12-22T08:41:27.126464+0000","last_clean":"2023-12-22T08:41:27.126464+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:27.126464+0000","last_undegraded":"2023-12-22T08:41:27.126464+0000","last_fullsized":"2023-12-22T08:41:27.126464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:52.257765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.129267+0000","last_change":"2023-12-22T08:41:27.123533+0000","last_active":"2023-12-22T08:41:27.129267+0000","last_peered":"2023-12-22T08:41:27.129267+0000","last_clean":"2023-12-22T08:41:27.129267+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:41:27.129267+0000","last_undegraded":"2023-12-22T08:41:27.129267+0000","last_fullsized":"2023-12-22T08:41:27.129267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111846+0000","last_change":"2023-12-22T08:41:26.750084+0000","last_active":"2023-12-22T08:41:28.111846+0000","last_peered":"2023-12-22T08:41:28.111846+0000","last_clean":"2023-12-22T08:41:28.111846+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:41:28.111846+0000","last_undegraded":"2023-12-22T08:41:28.111846+0000","last_fullsized":"2023-12-22T08:41:28.111846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111151+0000","last_change":"2023-12-22T08:41:27.125421+0000","last_active":"2023-12-22T08:41:28.111151+0000","last_peered":"2023-12-22T08:41:28.111151+0000","last_clean":"2023-12-22T08:41:28.111151+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:41:28.111151+0000","last_undegraded":"2023-12-22T08:41:28.111151+0000","last_fullsized":"2023-12-22T08:41:28.111151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:39.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111620+0000","last_change":"2023-12-22T08:41:26.743416+0000","last_active":"2023-12-22T08:41:28.111620+0000","last_peered":"2023-12-22T08:41:28.111620+0000","last_clean":"2023-12-22T08:41:28.111620+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:41:28.111620+0000","last_undegraded":"2023-12-22T08:41:28.111620+0000","last_fullsized":"2023-12-22T08:41:28.111620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:42.994044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111016+0000","last_change":"2023-12-22T08:41:27.123904+0000","last_active":"2023-12-22T08:41:28.111016+0000","last_peered":"2023-12-22T08:41:28.111016+0000","last_clean":"2023-12-22T08:41:28.111016+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:41:28.111016+0000","last_undegraded":"2023-12-22T08:41:28.111016+0000","last_fullsized":"2023-12-22T08:41:28.111016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.115977+0000","last_change":"2023-12-22T08:41:26.745648+0000","last_active":"2023-12-22T08:41:27.115977+0000","last_peered":"2023-12-22T08:41:27.115977+0000","last_clean":"2023-12-22T08:41:27.115977+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:41:27.115977+0000","last_undegraded":"2023-12-22T08:41:27.115977+0000","last_fullsized":"2023-12-22T08:41:27.115977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112566+0000","last_change":"2023-12-22T08:41:27.126166+0000","last_active":"2023-12-22T08:41:28.112566+0000","last_peered":"2023-12-22T08:41:28.112566+0000","last_clean":"2023-12-22T08:41:28.112566+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:28.112566+0000","last_undegraded":"2023-12-22T08:41:28.112566+0000","last_fullsized":"2023-12-22T08:41:28.112566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111017+0000","last_change":"2023-12-22T08:41:26.739716+0000","last_active":"2023-12-22T08:41:28.111017+0000","last_peered":"2023-12-22T08:41:28.111017+0000","last_clean":"2023-12-22T08:41:28.111017+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:28.111017+0000","last_undegraded":"2023-12-22T08:41:28.111017+0000","last_fullsized":"2023-12-22T08:41:28.111017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:25.744068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111505+0000","last_change":"2023-12-22T08:41:27.133504+0000","last_active":"2023-12-22T08:41:28.111505+0000","last_peered":"2023-12-22T08:41:28.111505+0000","last_clean":"2023-12-22T08:41:28.111505+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:41:28.111505+0000","last_undegraded":"2023-12-22T08:41:28.111505+0000","last_fullsized":"2023-12-22T08:41:28.111505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.118324+0000","last_change":"2023-12-22T08:41:26.743175+0000","last_active":"2023-12-22T08:41:27.118324+0000","last_peered":"2023-12-22T08:41:27.118324+0000","last_clean":"2023-12-22T08:41:27.118324+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:27.118324+0000","last_undegraded":"2023-12-22T08:41:27.118324+0000","last_fullsized":"2023-12-22T08:41:27.118324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:03.573220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133656+0000","last_change":"2023-12-22T08:41:27.129547+0000","last_active":"2023-12-22T08:41:27.133656+0000","last_peered":"2023-12-22T08:41:27.133656+0000","last_clean":"2023-12-22T08:41:27.133656+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:41:27.133656+0000","last_undegraded":"2023-12-22T08:41:27.133656+0000","last_fullsized":"2023-12-22T08:41:27.133656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.112998+0000","last_change":"2023-12-22T08:41:26.743757+0000","last_active":"2023-12-22T08:41:27.112998+0000","last_peered":"2023-12-22T08:41:27.112998+0000","last_clean":"2023-12-22T08:41:27.112998+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:27.112998+0000","last_undegraded":"2023-12-22T08:41:27.112998+0000","last_fullsized":"2023-12-22T08:41:27.112998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133796+0000","last_change":"2023-12-22T08:41:27.131773+0000","last_active":"2023-12-22T08:41:27.133796+0000","last_peered":"2023-12-22T08:41:27.133796+0000","last_clean":"2023-12-22T08:41:27.133796+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:41:27.133796+0000","last_undegraded":"2023-12-22T08:41:27.133796+0000","last_fullsized":"2023-12-22T08:41:27.133796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111905+0000","last_change":"2023-12-22T08:41:26.745597+0000","last_active":"2023-12-22T08:41:28.111905+0000","last_peered":"2023-12-22T08:41:28.111905+0000","last_clean":"2023-12-22T08:41:28.111905+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:28.111905+0000","last_undegraded":"2023-12-22T08:41:28.111905+0000","last_fullsized":"2023-12-22T08:41:28.111905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111718+0000","last_change":"2023-12-22T08:41:27.118227+0000","last_active":"2023-12-22T08:41:28.111718+0000","last_peered":"2023-12-22T08:41:28.111718+0000","last_clean":"2023-12-22T08:41:28.111718+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:41:28.111718+0000","last_undegraded":"2023-12-22T08:41:28.111718+0000","last_fullsized":"2023-12-22T08:41:28.111718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.138369+0000","last_change":"2023-12-22T08:41:26.748072+0000","last_active":"2023-12-22T08:41:27.138369+0000","last_peered":"2023-12-22T08:41:27.138369+0000","last_clean":"2023-12-22T08:41:27.138369+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:27.138369+0000","last_undegraded":"2023-12-22T08:41:27.138369+0000","last_fullsized":"2023-12-22T08:41:27.138369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:05.371284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112579+0000","last_change":"2023-12-22T08:41:27.120378+0000","last_active":"2023-12-22T08:41:28.112579+0000","last_peered":"2023-12-22T08:41:28.112579+0000","last_clean":"2023-12-22T08:41:28.112579+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:28.112579+0000","last_undegraded":"2023-12-22T08:41:28.112579+0000","last_fullsized":"2023-12-22T08:41:28.112579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111924+0000","last_change":"2023-12-22T08:41:26.740501+0000","last_active":"2023-12-22T08:41:28.111924+0000","last_peered":"2023-12-22T08:41:28.111924+0000","last_clean":"2023-12-22T08:41:28.111924+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:28.111924+0000","last_undegraded":"2023-12-22T08:41:28.111924+0000","last_fullsized":"2023-12-22T08:41:28.111924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.133470+0000","last_change":"2023-12-22T08:41:27.127482+0000","last_active":"2023-12-22T08:41:27.133470+0000","last_peered":"2023-12-22T08:41:27.133470+0000","last_clean":"2023-12-22T08:41:27.133470+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:41:27.133470+0000","last_undegraded":"2023-12-22T08:41:27.133470+0000","last_fullsized":"2023-12-22T08:41:27.133470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112604+0000","last_change":"2023-12-22T08:41:26.746743+0000","last_active":"2023-12-22T08:41:28.112604+0000","last_peered":"2023-12-22T08:41:28.112604+0000","last_clean":"2023-12-22T08:41:28.112604+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:28.112604+0000","last_undegraded":"2023-12-22T08:41:28.112604+0000","last_fullsized":"2023-12-22T08:41:28.112604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.129231+0000","last_change":"2023-12-22T08:41:27.123864+0000","last_active":"2023-12-22T08:41:27.129231+0000","last_peered":"2023-12-22T08:41:27.129231+0000","last_clean":"2023-12-22T08:41:27.129231+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:41:27.129231+0000","last_undegraded":"2023-12-22T08:41:27.129231+0000","last_fullsized":"2023-12-22T08:41:27.129231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.116076+0000","last_change":"2023-12-22T08:41:26.742515+0000","last_active":"2023-12-22T08:41:27.116076+0000","last_peered":"2023-12-22T08:41:27.116076+0000","last_clean":"2023-12-22T08:41:27.116076+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:27.116076+0000","last_undegraded":"2023-12-22T08:41:27.116076+0000","last_fullsized":"2023-12-22T08:41:27.116076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:32.527496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126767+0000","last_change":"2023-12-22T08:41:27.122673+0000","last_active":"2023-12-22T08:41:27.126767+0000","last_peered":"2023-12-22T08:41:27.126767+0000","last_clean":"2023-12-22T08:41:27.126767+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:41:27.126767+0000","last_undegraded":"2023-12-22T08:41:27.126767+0000","last_fullsized":"2023-12-22T08:41:27.126767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:06.373152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.134353+0000","last_change":"2023-12-22T08:41:26.748785+0000","last_active":"2023-12-22T08:41:27.134353+0000","last_peered":"2023-12-22T08:41:27.134353+0000","last_clean":"2023-12-22T08:41:27.134353+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:41:27.134353+0000","last_undegraded":"2023-12-22T08:41:27.134353+0000","last_fullsized":"2023-12-22T08:41:27.134353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111273+0000","last_change":"2023-12-22T08:41:27.118299+0000","last_active":"2023-12-22T08:41:28.111273+0000","last_peered":"2023-12-22T08:41:28.111273+0000","last_clean":"2023-12-22T08:41:28.111273+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:41:28.111273+0000","last_undegraded":"2023-12-22T08:41:28.111273+0000","last_fullsized":"2023-12-22T08:41:28.111273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113208+0000","last_change":"2023-12-22T08:41:26.751813+0000","last_active":"2023-12-22T08:41:28.113208+0000","last_peered":"2023-12-22T08:41:28.113208+0000","last_clean":"2023-12-22T08:41:28.113208+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:28.113208+0000","last_undegraded":"2023-12-22T08:41:28.113208+0000","last_fullsized":"2023-12-22T08:41:28.113208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111455+0000","last_change":"2023-12-22T08:41:27.122998+0000","last_active":"2023-12-22T08:41:28.111455+0000","last_peered":"2023-12-22T08:41:28.111455+0000","last_clean":"2023-12-22T08:41:28.111455+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:41:28.111455+0000","last_undegraded":"2023-12-22T08:41:28.111455+0000","last_fullsized":"2023-12-22T08:41:28.111455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111193+0000","last_change":"2023-12-22T08:41:26.740945+0000","last_active":"2023-12-22T08:41:28.111193+0000","last_peered":"2023-12-22T08:41:28.111193+0000","last_clean":"2023-12-22T08:41:28.111193+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:41:28.111193+0000","last_undegraded":"2023-12-22T08:41:28.111193+0000","last_fullsized":"2023-12-22T08:41:28.111193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112745+0000","last_change":"2023-12-22T08:41:27.125917+0000","last_active":"2023-12-22T08:41:28.112745+0000","last_peered":"2023-12-22T08:41:28.112745+0000","last_clean":"2023-12-22T08:41:28.112745+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:41:28.112745+0000","last_undegraded":"2023-12-22T08:41:28.112745+0000","last_fullsized":"2023-12-22T08:41:28.112745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111940+0000","last_change":"2023-12-22T08:41:26.743117+0000","last_active":"2023-12-22T08:41:28.111940+0000","last_peered":"2023-12-22T08:41:28.111940+0000","last_clean":"2023-12-22T08:41:28.111940+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:41:28.111940+0000","last_undegraded":"2023-12-22T08:41:28.111940+0000","last_fullsized":"2023-12-22T08:41:28.111940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128652+0000","last_change":"2023-12-22T08:41:27.125969+0000","last_active":"2023-12-22T08:41:27.128652+0000","last_peered":"2023-12-22T08:41:27.128652+0000","last_clean":"2023-12-22T08:41:27.128652+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:27.128652+0000","last_undegraded":"2023-12-22T08:41:27.128652+0000","last_fullsized":"2023-12-22T08:41:27.128652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:34.167113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111633+0000","last_change":"2023-12-22T08:41:26.744095+0000","last_active":"2023-12-22T08:41:28.111633+0000","last_peered":"2023-12-22T08:41:28.111633+0000","last_clean":"2023-12-22T08:41:28.111633+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:41:28.111633+0000","last_undegraded":"2023-12-22T08:41:28.111633+0000","last_fullsized":"2023-12-22T08:41:28.111633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:11.707505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128577+0000","last_change":"2023-12-22T08:41:27.125387+0000","last_active":"2023-12-22T08:41:27.128577+0000","last_peered":"2023-12-22T08:41:27.128577+0000","last_clean":"2023-12-22T08:41:27.128577+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:27.128577+0000","last_undegraded":"2023-12-22T08:41:27.128577+0000","last_fullsized":"2023-12-22T08:41:27.128577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:31.788205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126646+0000","last_change":"2023-12-22T08:41:26.747215+0000","last_active":"2023-12-22T08:41:27.126646+0000","last_peered":"2023-12-22T08:41:27.126646+0000","last_clean":"2023-12-22T08:41:27.126646+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:27.126646+0000","last_undegraded":"2023-12-22T08:41:27.126646+0000","last_fullsized":"2023-12-22T08:41:27.126646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128367+0000","last_change":"2023-12-22T08:41:27.122152+0000","last_active":"2023-12-22T08:41:27.128367+0000","last_peered":"2023-12-22T08:41:27.128367+0000","last_clean":"2023-12-22T08:41:27.128367+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:27.128367+0000","last_undegraded":"2023-12-22T08:41:27.128367+0000","last_fullsized":"2023-12-22T08:41:27.128367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.709373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.116323+0000","last_change":"2023-12-22T08:41:26.746895+0000","last_active":"2023-12-22T08:41:27.116323+0000","last_peered":"2023-12-22T08:41:27.116323+0000","last_clean":"2023-12-22T08:41:27.116323+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:27.116323+0000","last_undegraded":"2023-12-22T08:41:27.116323+0000","last_fullsized":"2023-12-22T08:41:27.116323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126313+0000","last_change":"2023-12-22T08:41:27.121179+0000","last_active":"2023-12-22T08:41:27.126313+0000","last_peered":"2023-12-22T08:41:27.126313+0000","last_clean":"2023-12-22T08:41:27.126313+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:27.126313+0000","last_undegraded":"2023-12-22T08:41:27.126313+0000","last_fullsized":"2023-12-22T08:41:27.126313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:53.573498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111334+0000","last_change":"2023-12-22T08:41:26.744242+0000","last_active":"2023-12-22T08:41:28.111334+0000","last_peered":"2023-12-22T08:41:28.111334+0000","last_clean":"2023-12-22T08:41:28.111334+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:28.111334+0000","last_undegraded":"2023-12-22T08:41:28.111334+0000","last_fullsized":"2023-12-22T08:41:28.111334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.129305+0000","last_change":"2023-12-22T08:41:27.125910+0000","last_active":"2023-12-22T08:41:27.129305+0000","last_peered":"2023-12-22T08:41:27.129305+0000","last_clean":"2023-12-22T08:41:27.129305+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:41:27.129305+0000","last_undegraded":"2023-12-22T08:41:27.129305+0000","last_fullsized":"2023-12-22T08:41:27.129305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110836+0000","last_change":"2023-12-22T08:41:26.747152+0000","last_active":"2023-12-22T08:41:28.110836+0000","last_peered":"2023-12-22T08:41:28.110836+0000","last_clean":"2023-12-22T08:41:28.110836+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:28.110836+0000","last_undegraded":"2023-12-22T08:41:28.110836+0000","last_fullsized":"2023-12-22T08:41:28.110836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.128301+0000","last_change":"2023-12-22T08:41:27.122069+0000","last_active":"2023-12-22T08:41:27.128301+0000","last_peered":"2023-12-22T08:41:27.128301+0000","last_clean":"2023-12-22T08:41:27.128301+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:27.128301+0000","last_undegraded":"2023-12-22T08:41:27.128301+0000","last_fullsized":"2023-12-22T08:41:27.128301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:04.235137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113220+0000","last_change":"2023-12-22T08:41:26.748464+0000","last_active":"2023-12-22T08:41:28.113220+0000","last_peered":"2023-12-22T08:41:28.113220+0000","last_clean":"2023-12-22T08:41:28.113220+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:28.113220+0000","last_undegraded":"2023-12-22T08:41:28.113220+0000","last_fullsized":"2023-12-22T08:41:28.113220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111578+0000","last_change":"2023-12-22T08:41:27.117970+0000","last_active":"2023-12-22T08:41:28.111578+0000","last_peered":"2023-12-22T08:41:28.111578+0000","last_clean":"2023-12-22T08:41:28.111578+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:41:28.111578+0000","last_undegraded":"2023-12-22T08:41:28.111578+0000","last_fullsized":"2023-12-22T08:41:28.111578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.113093+0000","last_change":"2023-12-22T08:41:26.744425+0000","last_active":"2023-12-22T08:41:27.113093+0000","last_peered":"2023-12-22T08:41:27.113093+0000","last_clean":"2023-12-22T08:41:27.113093+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:27.113093+0000","last_undegraded":"2023-12-22T08:41:27.113093+0000","last_fullsized":"2023-12-22T08:41:27.113093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:17.007353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.123361+0000","last_change":"2023-12-22T08:41:27.121596+0000","last_active":"2023-12-22T08:41:27.123361+0000","last_peered":"2023-12-22T08:41:27.123361+0000","last_clean":"2023-12-22T08:41:27.123361+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:27.123361+0000","last_undegraded":"2023-12-22T08:41:27.123361+0000","last_fullsized":"2023-12-22T08:41:27.123361+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112784+0000","last_change":"2023-12-22T08:41:26.748558+0000","last_active":"2023-12-22T08:41:28.112784+0000","last_peered":"2023-12-22T08:41:28.112784+0000","last_clean":"2023-12-22T08:41:28.112784+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:28.112784+0000","last_undegraded":"2023-12-22T08:41:28.112784+0000","last_fullsized":"2023-12-22T08:41:28.112784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.126819+0000","last_change":"2023-12-22T08:41:27.124314+0000","last_active":"2023-12-22T08:41:27.126819+0000","last_peered":"2023-12-22T08:41:27.126819+0000","last_clean":"2023-12-22T08:41:27.126819+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:27.126819+0000","last_undegraded":"2023-12-22T08:41:27.126819+0000","last_fullsized":"2023-12-22T08:41:27.126819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:18.009221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.114451+0000","last_change":"2023-12-22T08:41:26.740301+0000","last_active":"2023-12-22T08:41:27.114451+0000","last_peered":"2023-12-22T08:41:27.114451+0000","last_clean":"2023-12-22T08:41:27.114451+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:27.114451+0000","last_undegraded":"2023-12-22T08:41:27.114451+0000","last_fullsized":"2023-12-22T08:41:27.114451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.123295+0000","last_change":"2023-12-22T08:41:27.121048+0000","last_active":"2023-12-22T08:41:27.123295+0000","last_peered":"2023-12-22T08:41:27.123295+0000","last_clean":"2023-12-22T08:41:27.123295+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:27.123295+0000","last_undegraded":"2023-12-22T08:41:27.123295+0000","last_fullsized":"2023-12-22T08:41:27.123295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112660+0000","last_change":"2023-12-22T08:41:26.747176+0000","last_active":"2023-12-22T08:41:28.112660+0000","last_peered":"2023-12-22T08:41:28.112660+0000","last_clean":"2023-12-22T08:41:28.112660+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:28.112660+0000","last_undegraded":"2023-12-22T08:41:28.112660+0000","last_fullsized":"2023-12-22T08:41:28.112660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.130840+0000","last_change":"2023-12-22T08:41:27.122915+0000","last_active":"2023-12-22T08:41:27.130840+0000","last_peered":"2023-12-22T08:41:27.130840+0000","last_clean":"2023-12-22T08:41:27.130840+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:41:27.130840+0000","last_undegraded":"2023-12-22T08:41:27.130840+0000","last_fullsized":"2023-12-22T08:41:27.130840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:27.533832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111422+0000","last_change":"2023-12-22T08:41:26.739638+0000","last_active":"2023-12-22T08:41:28.111422+0000","last_peered":"2023-12-22T08:41:28.111422+0000","last_clean":"2023-12-22T08:41:28.111422+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:28.111422+0000","last_undegraded":"2023-12-22T08:41:28.111422+0000","last_fullsized":"2023-12-22T08:41:28.111422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:03.233269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111243+0000","last_change":"2023-12-22T08:41:27.131013+0000","last_active":"2023-12-22T08:41:28.111243+0000","last_peered":"2023-12-22T08:41:28.111243+0000","last_clean":"2023-12-22T08:41:28.111243+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:41:28.111243+0000","last_undegraded":"2023-12-22T08:41:28.111243+0000","last_fullsized":"2023-12-22T08:41:28.111243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.114941+0000","last_change":"2023-12-22T08:41:26.745042+0000","last_active":"2023-12-22T08:41:27.114941+0000","last_peered":"2023-12-22T08:41:27.114941+0000","last_clean":"2023-12-22T08:41:27.114941+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:27.114941+0000","last_undegraded":"2023-12-22T08:41:27.114941+0000","last_fullsized":"2023-12-22T08:41:27.114941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.131429+0000","last_change":"2023-12-22T08:41:27.128761+0000","last_active":"2023-12-22T08:41:27.131429+0000","last_peered":"2023-12-22T08:41:27.131429+0000","last_clean":"2023-12-22T08:41:27.131429+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:27.131429+0000","last_undegraded":"2023-12-22T08:41:27.131429+0000","last_fullsized":"2023-12-22T08:41:27.131429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.116206+0000","last_change":"2023-12-22T08:41:26.742603+0000","last_active":"2023-12-22T08:41:27.116206+0000","last_peered":"2023-12-22T08:41:27.116206+0000","last_clean":"2023-12-22T08:41:27.116206+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:27.116206+0000","last_undegraded":"2023-12-22T08:41:27.116206+0000","last_fullsized":"2023-12-22T08:41:27.116206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-22T08:41:26.739927+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:41:26.739927+0000","last_peered":"2023-12-22T08:41:26.739927+0000","last_clean":"2023-12-22T08:41:26.739927+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:26.739927+0000","last_undegraded":"2023-12-22T08:41:26.739927+0000","last_fullsized":"2023-12-22T08:41:26.739927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":718420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":128578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":128066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":129548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":339968,"data_stored":128032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":929792,"data_stored":718330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:41:30.461 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T08:41:30.461 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T08:41:30.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.607+0000 7fe788dae640 1 Processor -- start 2023-12-22T08:41:30.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.607+0000 7fe788dae640 1 -- start start 2023-12-22T08:41:30.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe788dae640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe784069f70 0x7fe7840b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe788dae640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 0x7fe784144e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe788dae640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe784070570 con 0x7fe784144a20 2023-12-22T08:41:30.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe788dae640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840719e0 con 0x7fe784069f70 2023-12-22T08:41:30.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe788dae640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78406ff60 con 0x7fe78414b1b0 2023-12-22T08:41:30.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe77bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe784144a20 0x7fe78414aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33656/0 (socket says 172.21.15.31:33656) 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe77bfff640 1 -- 172.21.15.31:0/948306973 learned_addr learned my addr 172.21.15.31:0/948306973 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe78259c640 1 --2- 172.21.15.31:0/948306973 >> v2:172.21.15.69:3300/0 conn(0x7fe784069f70 0x7fe7840b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe782d9d640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 0x7fe784144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.608+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686698965 0 0) 0x7fe784070570 con 0x7fe784144a20 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe770003520 con 0x7fe784144a20 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2786315405 0 0) 0x7fe770003520 con 0x7fe784144a20 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 msgr2=0x7fe784144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 0x7fe784144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 >> v2:172.21.15.69:3300/0 conn(0x7fe784069f70 msgr2=0x7fe7840b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 --2- 172.21.15.31:0/948306973 >> v2:172.21.15.69:3300/0 conn(0x7fe784069f70 0x7fe7840b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78406bda0 con 0x7fe784144a20 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7fe76c001670 con 0x7fe784144a20 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe78259c640 1 --2- 172.21.15.31:0/948306973 >> v2:172.21.15.69:3300/0 conn(0x7fe784069f70 0x7fe7840b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:30.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe782d9d640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 0x7fe784144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 >> v1:172.21.15.31:6789/0 conn(0x7fe784144a20 legacy=0x7fe78414aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 0x7fe770003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe770003eb0 0x7fe7700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe770004d00 0x7fe770005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840719e0 con 0x7fe770003eb0 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78406ff60 con 0x7fe770004d00 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77000b980 con 0x7fe78414b1b0 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe77bfff640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe770003eb0 0x7fe7700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe78259c640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 0x7fe770003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe782d9d640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe770004d00 0x7fe770005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe77bfff640 1 -- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 msgr2=0x7fe770003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe77bfff640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe78414b1b0 0x7fe770003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe77bfff640 1 -- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe770004d00 msgr2=0x7fe770005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe77bfff640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe770004d00 0x7fe770005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.609+0000 7fe77bfff640 1 -- 172.21.15.31:0/948306973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c009a70 con 0x7fe770003eb0 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.610+0000 7fe77bfff640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe770003eb0 0x7fe7700047c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c240 tx=0x7fe7700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede48eceb928b958 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.610+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c005ad0 con 0x7fe770003eb0 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.610+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c005c30 con 0x7fe770003eb0 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.610+0000 7fe781d9b640 1 -- 172.21.15.31:0/948306973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c02caf0 con 0x7fe770003eb0 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.611+0000 7fe788dae640 1 -- 172.21.15.31:0/948306973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe770003eb0 msgr2=0x7fe7700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.611+0000 7fe788dae640 1 --2- 172.21.15.31:0/948306973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe770003eb0 0x7fe7700047c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c240 tx=0x7fe7700057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.611+0000 7fe782d9d640 1 -- 172.21.15.31:0/948306973 reap_dead start 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.611+0000 7fe788dae640 1 -- 172.21.15.31:0/948306973 shutdown_connections 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.611+0000 7fe788dae640 1 -- 172.21.15.31:0/948306973 >> 172.21.15.31:0/948306973 conn(0x7fe78406ae10 msgr2=0x7fe78406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.611+0000 7fe788dae640 1 -- 172.21.15.31:0/948306973 shutdown_connections 2023-12-22T08:41:30.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.611+0000 7fe788dae640 1 -- 172.21.15.31:0/948306973 wait complete. 2023-12-22T08:41:30.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.612+0000 7fe788dae640 1 Processor -- start 2023-12-22T08:41:30.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.612+0000 7fe788dae640 1 -- start start 2023-12-22T08:41:30.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe788dae640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe770003eb0 0x7fe784149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe788dae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe78409f220 0x7fe78409f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe788dae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7841e30f0 0x7fe7841e3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe788dae640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78414a1d0 con 0x7fe78409f220 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe788dae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7841e3ab0 con 0x7fe7841e30f0 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe788dae640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840b6600 con 0x7fe770003eb0 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe78409f220 0x7fe78409f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe78409f220 0x7fe78409f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34848/0 (socket says 172.21.15.31:34848) 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 -- 172.21.15.31:0/3230281036 learned_addr learned my addr 172.21.15.31:0/3230281036 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe782d9d640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7841e30f0 0x7fe7841e3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe78259c640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe770003eb0 0x7fe784149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 -- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe770003eb0 msgr2=0x7fe784149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe770003eb0 0x7fe784149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 -- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7841e30f0 msgr2=0x7fe7841e3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7841e30f0 0x7fe7841e3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 -- 172.21.15.31:0/3230281036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840b6850 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe782d9d640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7841e30f0 0x7fe7841e3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe78259c640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe770003eb0 0x7fe784149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77bfff640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe78409f220 0x7fe78409f6a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe76c001eb0 tx=0x7fe7840a0020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77affd640 1 -- 172.21.15.31:0/3230281036 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c039030 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77affd640 1 -- 172.21.15.31:0/3230281036 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c02cce0 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe784147eb0 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe77affd640 1 -- 172.21.15.31:0/3230281036 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c03c040 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.613+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78409d480 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.614+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78409d610 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.615+0000 7fe77affd640 1 -- 172.21.15.31:0/3230281036 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe76c032070 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.615+0000 7fe77affd640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe76406a430 0x7fe76406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.615+0000 7fe77affd640 1 -- 172.21.15.31:0/3230281036 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe76c0a9ca0 con 0x7fe78409f220 2023-12-22T08:41:30.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.615+0000 7fe78259c640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe76406a430 0x7fe76406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.616+0000 7fe78259c640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe76406a430 0x7fe76406c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe7840a3580 tx=0x7fe774008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.620+0000 7fe77affd640 1 -- 172.21.15.31:0/3230281036 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe76c075320 con 0x7fe78409f220 2023-12-22T08:41:30.721 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-12-22T08:41:30.719+0000 7f63a9a1c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T08:41:30.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.866+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe784073a40 con 0x7fe78409f220 2023-12-22T08:41:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.872+0000 7fe77affd640 1 -- 172.21.15.31:0/3230281036 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe76c078940 con 0x7fe78409f220 2023-12-22T08:41:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-12-22T08:41:30.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe76406a430 msgr2=0x7fe76406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe76406a430 0x7fe76406c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe7840a3580 tx=0x7fe774008040 comp rx=0 tx=0).stop 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe78409f220 msgr2=0x7fe78409f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe78409f220 0x7fe78409f6a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe76c001eb0 tx=0x7fe7840a0020 comp rx=0 tx=0).stop 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 shutdown_connections 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe76406a430 0x7fe76406c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7841e30f0 0x7fe7841e3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe78409f220 0x7fe78409f6a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 --2- 172.21.15.31:0/3230281036 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe770003eb0 0x7fe784149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 >> 172.21.15.31:0/3230281036 conn(0x7fe78406ae10 msgr2=0x7fe784142250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 shutdown_connections 2023-12-22T08:41:30.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.874+0000 7fe788dae640 1 -- 172.21.15.31:0/3230281036 wait complete. 2023-12-22T08:41:30.887 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:41:30.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f26017d3640 1 Processor -- start 2023-12-22T08:41:30.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f26017d3640 1 -- start start 2023-12-22T08:41:30.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f26017d3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f26017d3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25fc070600 0x7f25fc14b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f26017d3640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25fc06fa60 con 0x7f25fc144f20 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f26017d3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25fc071ef0 con 0x7f25fc070600 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f26017d3640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc06f430 con 0x7f25fc0afb00 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f25fb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25fc070600 0x7f25fc14b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f25fb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25fc070600 0x7f25fc14b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34864/0 (socket says 172.21.15.31:34864) 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.990+0000 7f25fb7fe640 1 -- 172.21.15.31:0/3886452592 learned_addr learned my addr 172.21.15.31:0/3886452592 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.991+0000 7f25fa7fc640 1 --2- 172.21.15.31:0/3886452592 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.991+0000 7f25fb7fe640 1 -- 172.21.15.31:0/3886452592 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 msgr2=0x7f25fc14ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.991+0000 7f25fb7fe640 1 --2- 172.21.15.31:0/3886452592 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc14ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.991+0000 7f25fb7fe640 1 -- 172.21.15.31:0/3886452592 >> v1:172.21.15.69:6789/0 conn(0x7f25fc144f20 legacy=0x7f25fc06fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.991+0000 7f25fb7fe640 1 -- 172.21.15.31:0/3886452592 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc14b8b0 con 0x7f25fc070600 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.991+0000 7f25fa7fc640 1 --2- 172.21.15.31:0/3886452592 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc14ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.991+0000 7f25fb7fe640 1 --2- 172.21.15.31:0/3886452592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc070600 0x7f25fc14b070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009e50 tx=0x7f25f402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd584047646b012c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f25f9ffb640 1 -- 172.21.15.31:0/3886452592 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f402ca70 con 0x7f25fc070600 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f25f9ffb640 1 -- 172.21.15.31:0/3886452592 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f402cbd0 con 0x7f25fc070600 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f25f9ffb640 1 -- 172.21.15.31:0/3886452592 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f40343f0 con 0x7f25fc070600 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f26017d3640 1 -- 172.21.15.31:0/3886452592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc070600 msgr2=0x7f25fc14b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f26017d3640 1 --2- 172.21.15.31:0/3886452592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc070600 0x7f25fc14b070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009e50 tx=0x7f25f402bed0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f26017d3640 1 -- 172.21.15.31:0/3886452592 shutdown_connections 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f26017d3640 1 --2- 172.21.15.31:0/3886452592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc070600 0x7f25fc14b070 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f26017d3640 1 --2- 172.21.15.31:0/3886452592 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc14ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:30.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f26017d3640 1 -- 172.21.15.31:0/3886452592 >> 172.21.15.31:0/3886452592 conn(0x7f25fc0bc3d0 msgr2=0x7f25fc0bc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:30.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f26017d3640 1 -- 172.21.15.31:0/3886452592 shutdown_connections 2023-12-22T08:41:30.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.992+0000 7f26017d3640 1 -- 172.21.15.31:0/3886452592 wait complete. 2023-12-22T08:41:30.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.993+0000 7f26017d3640 1 Processor -- start 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.993+0000 7f26017d3640 1 -- start start 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f26017d3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25fc070600 0x7f25fc0b8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f26017d3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc0b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f26017d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc144f20 0x7f25fc0b90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f26017d3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0b8c80 con 0x7f25fc144f20 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f26017d3640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0b6df0 con 0x7f25fc070600 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f26017d3640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc0b70d0 con 0x7f25fc0afb00 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25fb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc144f20 0x7f25fc0b90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25fb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc144f20 0x7f25fc0b90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34870/0 (socket says 172.21.15.31:34870) 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25fb7fe640 1 -- 172.21.15.31:0/4142580654 learned_addr learned my addr 172.21.15.31:0/4142580654 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:31.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25faffd640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25fc070600 0x7f25fc0b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25fa7fc640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc0b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25fb7fe640 1 -- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 msgr2=0x7f25fc0b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25fb7fe640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc0b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25fb7fe640 1 -- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25fc070600 msgr2=0x7f25fc0b8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.994+0000 7f25fb7fe640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25fc070600 0x7f25fc0b8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.995+0000 7f25fb7fe640 1 -- 172.21.15.31:0/4142580654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4009b30 con 0x7f25fc144f20 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.995+0000 7f25faffd640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25fc070600 0x7f25fc0b8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.995+0000 7f25fb7fe640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc144f20 0x7f25fc0b90d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25f4036040 tx=0x7f25f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.995+0000 7f25e37fe640 1 -- 172.21.15.31:0/4142580654 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f4009510 con 0x7f25fc144f20 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.995+0000 7f25e37fe640 1 -- 172.21.15.31:0/4142580654 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f403e450 con 0x7f25fc144f20 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.995+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25fc0b73b0 con 0x7f25fc144f20 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.995+0000 7f25e37fe640 1 -- 172.21.15.31:0/4142580654 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f403e7e0 con 0x7f25fc144f20 2023-12-22T08:41:31.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.995+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25fc0b7bb0 con 0x7f25fc144f20 2023-12-22T08:41:31.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.996+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25fc067390 con 0x7f25fc144f20 2023-12-22T08:41:31.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.996+0000 7f25e37fe640 1 -- 172.21.15.31:0/4142580654 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25f403e940 con 0x7f25fc144f20 2023-12-22T08:41:31.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.997+0000 7f25e37fe640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f25e806a430 0x7f25e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.997+0000 7f25e37fe640 1 -- 172.21.15.31:0/4142580654 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25f40ab710 con 0x7f25fc144f20 2023-12-22T08:41:31.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.997+0000 7f25faffd640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f25e806a430 0x7f25e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:30.998+0000 7f25faffd640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f25e806a430 0x7f25e806c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f25ec001660 tx=0x7f25ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.001+0000 7f25e37fe640 1 -- 172.21.15.31:0/4142580654 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f25f4076cf0 con 0x7f25fc144f20 2023-12-22T08:41:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.211+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25fc0b7870 con 0x7f25fc144f20 2023-12-22T08:41:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.211+0000 7f25e37fe640 1 -- 172.21.15.31:0/4142580654 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3888 (secure 0 0 0) 0x7f25f407a310 con 0x7f25fc144f20 2023-12-22T08:41:31.214 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:31.214 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/173415810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":173415810},{"type":"v1","addr":"172.21.15.31:6835","nonce":173415810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/3869821333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3869821333},{"type":"v1","addr":"172.21.15.69:6835","nonce":3869821333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:27.101993+0000","modified":"2023-12-22T08:41:29.116339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/3038519921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3038519921},{"type":"v1","addr":"172.21.15.31:6834","nonce":3038519921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:41:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 13 2023-12-22T08:41:31.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f25e806a430 msgr2=0x7f25e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f25e806a430 0x7f25e806c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f25ec001660 tx=0x7f25ec009040 comp rx=0 tx=0).stop 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc144f20 msgr2=0x7f25fc0b90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc144f20 0x7f25fc0b90d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25f4036040 tx=0x7f25f4004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 shutdown_connections 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f25e806a430 0x7f25e806c8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc144f20 0x7f25fc0b90d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25fc0afb00 0x7f25fc0b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 --2- 172.21.15.31:0/4142580654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25fc070600 0x7f25fc0b8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 >> 172.21.15.31:0/4142580654 conn(0x7f25fc0bc3d0 msgr2=0x7f25fc13ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 shutdown_connections 2023-12-22T08:41:31.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.213+0000 7f26017d3640 1 -- 172.21.15.31:0/4142580654 wait complete. 2023-12-22T08:41:31.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T08:41:27.101993+0000', 'modified': '2023-12-22T08:41:29.116339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4974}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4974': {'gid': 4974, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6834/3038519921', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 3038519921}, {'type': 'v1', 'addr': '172.21.15.31:6834', 'nonce': 3038519921}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-22T08:41:31.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T08:41:31.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-22T08:41:31.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f376ad48640 1 Processor -- start 2023-12-22T08:41:31.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f376ad48640 1 -- start start 2023-12-22T08:41:31.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f376ad48640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3764144ea0 0x7f376414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f376ad48640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f37640b9600 0x7f376406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f376ad48640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640b9040 con 0x7f37640702b0 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f376ad48640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376414b360 con 0x7f37640b9600 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f376ad48640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640b8d60 con 0x7f3764144ea0 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f37692e5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f37640702b0 0x7f376414e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33662/0 (socket says 172.21.15.31:33662) 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.637+0000 7f37692e5640 1 -- 172.21.15.31:0/3413241123 learned_addr learned my addr 172.21.15.31:0/3413241123 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592764917 0 0) 0x7f37640b9040 con 0x7f37640702b0 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3754003520 con 0x7f37640702b0 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3763fff640 1 --2- 172.21.15.31:0/3413241123 >> v2:172.21.15.69:3300/0 conn(0x7f37640b9600 0x7f376406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3768ae4640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3764144ea0 0x7f376414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2339975777 0 0) 0x7f3754003520 con 0x7f37640702b0 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3764144ea0 msgr2=0x7f376414acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3764144ea0 0x7f376414acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 >> v2:172.21.15.69:3300/0 conn(0x7f37640b9600 msgr2=0x7f376406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 --2- 172.21.15.31:0/3413241123 >> v2:172.21.15.69:3300/0 conn(0x7f37640b9600 0x7f376406fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764069e30 con 0x7f37640702b0 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f375c0019f0 con 0x7f37640702b0 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 >> v1:172.21.15.31:6789/0 conn(0x7f37640702b0 legacy=0x7f376414e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f3754003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3764144ea0 0x7f37540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3754004d00 0x7f3754005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376414b360 con 0x7f3754003970 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640b8d60 con 0x7f3754004d00 2023-12-22T08:41:31.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375400b980 con 0x7f3764144ea0 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3768ae4640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f3754003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3763fff640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3764144ea0 0x7f37540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f37692e5640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3754004d00 0x7f3754005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3768ae4640 1 -- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3764144ea0 msgr2=0x7f37540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3768ae4640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3764144ea0 0x7f37540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3768ae4640 1 -- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3754004d00 msgr2=0x7f3754005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3768ae4640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3754004d00 0x7f3754005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.638+0000 7f3768ae4640 1 -- 172.21.15.31:0/3413241123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754003520 con 0x7f3754003970 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.639+0000 7f3768ae4640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f3754003d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3758009ac0 tx=0x7f37540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af284e9e41e45487 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.639+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375802c6b0 con 0x7f3754003970 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.639+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375802c810 con 0x7f3754003970 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.639+0000 7f37637fe640 1 -- 172.21.15.31:0/3413241123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375802cba0 con 0x7f3754003970 2023-12-22T08:41:31.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.640+0000 7f376ad48640 1 -- 172.21.15.31:0/3413241123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 msgr2=0x7f3754003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.640+0000 7f376ad48640 1 --2- 172.21.15.31:0/3413241123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f3754003d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3758009ac0 tx=0x7f37540057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.640+0000 7f37692e5640 1 -- 172.21.15.31:0/3413241123 reap_dead start 2023-12-22T08:41:31.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.640+0000 7f376ad48640 1 -- 172.21.15.31:0/3413241123 shutdown_connections 2023-12-22T08:41:31.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.640+0000 7f376ad48640 1 -- 172.21.15.31:0/3413241123 >> 172.21.15.31:0/3413241123 conn(0x7f376406ae10 msgr2=0x7f376406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.640+0000 7f376ad48640 1 -- 172.21.15.31:0/3413241123 shutdown_connections 2023-12-22T08:41:31.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.640+0000 7f376ad48640 1 -- 172.21.15.31:0/3413241123 wait complete. 2023-12-22T08:41:31.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.641+0000 7f376ad48640 1 Processor -- start 2023-12-22T08:41:31.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.641+0000 7f376ad48640 1 -- start start 2023-12-22T08:41:31.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f376ad48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f376414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f376ad48640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37640a07e0 0x7f376414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f376ad48640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37640b6420 0x7f37641e2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f376ad48640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376414e330 con 0x7f3754003970 2023-12-22T08:41:31.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f376ad48640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640b56c0 con 0x7f37640b6420 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f376ad48640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376414eb40 con 0x7f37640a07e0 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f376414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f376414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34894/0 (socket says 172.21.15.31:34894) 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 -- 172.21.15.31:0/921076061 learned_addr learned my addr 172.21.15.31:0/921076061 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3763fff640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37640a07e0 0x7f376414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f37692e5640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37640b6420 0x7f37641e2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 -- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37640a07e0 msgr2=0x7f376414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37640a07e0 0x7f376414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 -- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37640b6420 msgr2=0x7f37641e2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37640b6420 0x7f37641e2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 -- 172.21.15.31:0/921076061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640b5960 con 0x7f3754003970 2023-12-22T08:41:31.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f3768ae4640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f376414a850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3758009ac0 tx=0x7f3758004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f37617fa640 1 -- 172.21.15.31:0/921076061 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758003810 con 0x7f3754003970 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f37617fa640 1 -- 172.21.15.31:0/921076061 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758003970 con 0x7f3754003970 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f37617fa640 1 -- 172.21.15.31:0/921076061 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758003ce0 con 0x7f3754003970 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.642+0000 7f376ad48640 1 -- 172.21.15.31:0/921076061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37640b5c40 con 0x7f3754003970 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.643+0000 7f376ad48640 1 -- 172.21.15.31:0/921076061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37640b68b0 con 0x7f3754003970 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.644+0000 7f37617fa640 1 -- 172.21.15.31:0/921076061 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3758040450 con 0x7f3754003970 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.644+0000 7f37617fa640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f374806a430 0x7f374806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.644+0000 7f37617fa640 1 -- 172.21.15.31:0/921076061 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37580aa6b0 con 0x7f3754003970 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.644+0000 7f3763fff640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f374806a430 0x7f374806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.645+0000 7f3763fff640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f374806a430 0x7f374806c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f376414e620 tx=0x7f3750009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.645+0000 7f376d98b740 1 Processor -- start 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.645+0000 7f376d98b740 1 -- start start 2023-12-22T08:41:31.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f376d98b740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d91420 0x5628b0d555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f376d98b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d55af0 0x5628b0d867c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f376d98b740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d86d00 0x5628b0d87180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f376d98b740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b0cc5030 con 0x5628b0d86d00 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f376d98b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b0cc27c0 con 0x5628b0d55af0 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f376d98b740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628b0cbe0b0 con 0x5628b0d91420 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d86d00 0x5628b0d87180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d86d00 0x5628b0d87180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34908/0 (socket says 172.21.15.31:34908) 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 -- 172.21.15.31:0/1977451241 learned_addr learned my addr 172.21.15.31:0/1977451241 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f3763fff640 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d55af0 0x5628b0d867c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f3768ae4640 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d91420 0x5628b0d555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 -- 172.21.15.31:0/1977451241 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d91420 msgr2=0x5628b0d555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d91420 0x5628b0d555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 -- 172.21.15.31:0/1977451241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d55af0 msgr2=0x5628b0d867c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d55af0 0x5628b0d867c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 -- 172.21.15.31:0/1977451241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628b0c78bc0 con 0x5628b0d86d00 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.646+0000 7f37692e5640 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d86d00 0x5628b0d87180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f375c000f80 tx=0x7f375c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3213cc2f9b360ae5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f374e7fc640 1 -- 172.21.15.31:0/1977451241 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0078a0 con 0x5628b0d86d00 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f374e7fc640 1 -- 172.21.15.31:0/1977451241 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c007a00 con 0x5628b0d86d00 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f374e7fc640 1 -- 172.21.15.31:0/1977451241 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c015660 con 0x5628b0d86d00 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 -- 172.21.15.31:0/1977451241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d86d00 msgr2=0x5628b0d87180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d86d00 0x5628b0d87180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f375c000f80 tx=0x7f375c00a060 comp rx=0 tx=0).stop 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 -- 172.21.15.31:0/1977451241 shutdown_connections 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d86d00 0x5628b0d87180 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d55af0 0x5628b0d867c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 --2- 172.21.15.31:0/1977451241 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d91420 0x5628b0d555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 -- 172.21.15.31:0/1977451241 >> 172.21.15.31:0/1977451241 conn(0x5628b0d56f80 msgr2=0x5628b0d90b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 -- 172.21.15.31:0/1977451241 shutdown_connections 2023-12-22T08:41:31.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.647+0000 7f376d98b740 1 -- 172.21.15.31:0/1977451241 wait complete. 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.648+0000 7f376d98b740 1 -- start start 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.648+0000 7f376d98b740 1 Processor -- start 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.648+0000 7f376d98b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 0x5628b0d7f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0d807a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 0x5628b0d80ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b0c7c7c0 con 0x5628b0d91420 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b0c7c460 con 0x5628b0d86d00 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628b0c421b0 con 0x5628b0d7db50 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 10 client.0 _ll_register_callbacks cb 0x5628b0c456d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0d807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0d807a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34910/0 (socket says 172.21.15.31:34910) 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 -- 172.21.15.31:0/3895443723 learned_addr learned my addr 172.21.15.31:0/3895443723 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:31.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3768ae4640 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 0x5628b0d7f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f37692e5640 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 0x5628b0d80ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 -- 172.21.15.31:0/3895443723 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 msgr2=0x5628b0d80ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 0x5628b0d80ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 -- 172.21.15.31:0/3895443723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 msgr2=0x5628b0d7f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 0x5628b0d7f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 -- 172.21.15.31:0/3895443723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3764069e30 con 0x5628b0d91420 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f3763fff640 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0d807a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f37500036c0 tx=0x7f37500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee6e6a136c3c0f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f37437fe640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f37437fe640 1 -- 172.21.15.31:0/3895443723 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500238d0 con 0x5628b0d91420 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 1 -- 172.21.15.31:0/3895443723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628b0caf9e0 con 0x5628b0d91420 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f37437fe640 1 -- 172.21.15.31:0/3895443723 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f375002daf0 con 0x5628b0d91420 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f37437fe640 1 -- 172.21.15.31:0/3895443723 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f375002dcb0 con 0x5628b0d91420 2023-12-22T08:41:31.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 10 client.5148 fetch_fsmap learned FSMap version 13 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.649+0000 7f376d98b740 1 -- 172.21.15.31:0/3895443723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x5628b0cbc730 con 0x5628b0d91420 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f37437fe640 1 -- 172.21.15.31:0/3895443723 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628b0caf9e0 con 0x5628b0d91420 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f37437fe640 1 -- 172.21.15.31:0/3895443723 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 13) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f375001d030 con 0x5628b0d91420 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f376d98b740 10 client.5148 fetch_fsmap finished waiting for FSMap version 13 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f376d98b740 10 client.5148 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f376d98b740 20 client.5148 populate_metadata read hostname 'smithi031' 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f376d98b740 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] conn(0x5628b0da9f00 0x5628b0dac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f376d98b740 4 client.5148 mds_command: new command op to 4974 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f376d98b740 1 -- 172.21.15.31:0/3895443723 --> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628b0cb7130 con 0x5628b0da9f00 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f3768ae4640 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] conn(0x5628b0da9f00 0x5628b0dac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f37437fe640 10 client.5148 ms_handle_connect on v2:172.21.15.31:6832/3038519921 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.650+0000 7f3768ae4640 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] conn(0x5628b0da9f00 0x5628b0dac2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7137391dfc32990c server_cookie=8390c8e11ea9522 in_seq=0 out_seq=0 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f37437fe640 1 -- 172.21.15.31:0/3895443723 <== mds.0 v2:172.21.15.31:6832/3038519921 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5628b0cb7130 con 0x5628b0da9f00 2023-12-22T08:41:31.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f37437fe640 10 client.5148 handle_command_reply: tid=0 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 client.5148 shutdown 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 -- 172.21.15.31:0/3895443723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 msgr2=0x5628b0d807a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0d807a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f37500036c0 tx=0x7f37500046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 -- 172.21.15.31:0/3895443723 shutdown_connections 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] conn(0x5628b0da9f00 0x5628b0dac2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 0x5628b0d80ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f37437fe640 0 client.5148 ms_handle_reset on v2:172.21.15.31:6832/3038519921 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0d807a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 --2- 172.21.15.31:0/3895443723 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 0x5628b0d7f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 -- 172.21.15.31:0/3895443723 >> 172.21.15.31:0/3895443723 conn(0x5628b0d55af0 msgr2=0x5628b0d81d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 -- 172.21.15.31:0/3895443723 shutdown_connections 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 1 -- 172.21.15.31:0/3895443723 wait complete. 2023-12-22T08:41:31.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.651+0000 7f376d98b740 20 client.5148 trim_cache size 0 max 16384 2023-12-22T08:41:31.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.666+0000 7f376d98b740 1 Processor -- start 2023-12-22T08:41:31.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.666+0000 7f376d98b740 1 -- start start 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f376d98b740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d7db50 0x5628b0d80c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f376d98b740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d86d00 0x5628b0d81cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f376d98b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d91420 0x5628b0d82200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f376d98b740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b0d51050 con 0x5628b0d7db50 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f376d98b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b0d50b20 con 0x5628b0d91420 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f376d98b740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628b0db0a20 con 0x5628b0d86d00 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d7db50 0x5628b0d80c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d7db50 0x5628b0d80c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34924/0 (socket says 172.21.15.31:34924) 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 -- 172.21.15.31:0/163111979 learned_addr learned my addr 172.21.15.31:0/163111979 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3763fff640 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d86d00 0x5628b0d81cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f37692e5640 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d91420 0x5628b0d82200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 -- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d86d00 msgr2=0x5628b0d81cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d86d00 0x5628b0d81cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 -- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d91420 msgr2=0x5628b0d82200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d91420 0x5628b0d82200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 -- 172.21.15.31:0/163111979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628b0d56240 con 0x5628b0d7db50 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f37692e5640 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d91420 0x5628b0d82200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f3768ae4640 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d7db50 0x5628b0d80c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3758075f10 tx=0x7f37580a8ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375772fb3f1eab44 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f374effd640 1 -- 172.21.15.31:0/163111979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758081940 con 0x5628b0d7db50 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f374effd640 1 -- 172.21.15.31:0/163111979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758077b50 con 0x5628b0d7db50 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.667+0000 7f374effd640 1 -- 172.21.15.31:0/163111979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758009690 con 0x5628b0d7db50 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 -- 172.21.15.31:0/163111979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d7db50 msgr2=0x5628b0d80c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d7db50 0x5628b0d80c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3758075f10 tx=0x7f37580a8ab0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 -- 172.21.15.31:0/163111979 shutdown_connections 2023-12-22T08:41:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d91420 0x5628b0d82200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d86d00 0x5628b0d81cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 --2- 172.21.15.31:0/163111979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d7db50 0x5628b0d80c30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 -- 172.21.15.31:0/163111979 >> 172.21.15.31:0/163111979 conn(0x5628b0d55af0 msgr2=0x5628b0db0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 -- 172.21.15.31:0/163111979 shutdown_connections 2023-12-22T08:41:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 -- 172.21.15.31:0/163111979 wait complete. 2023-12-22T08:41:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.668+0000 7f376d98b740 1 -- start start 2023-12-22T08:41:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f376d98b740 1 Processor -- start 2023-12-22T08:41:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f376d98b740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 0x5628b0d8cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f376d98b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 0x5628b0de6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f376d98b740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0de71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f376d98b740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b0d8f1a0 con 0x5628b0d91420 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f376d98b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628b0d8d090 con 0x5628b0d86d00 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f376d98b740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628b0d90320 con 0x5628b0d7db50 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f376d98b740 10 client.0 _ll_register_callbacks cb 0x7f375c001870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f37692e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0de71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f37692e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0de71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34932/0 (socket says 172.21.15.31:34932) 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f37692e5640 1 -- 172.21.15.31:0/1482964539 learned_addr learned my addr 172.21.15.31:0/1482964539 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f3763fff640 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 0x5628b0de6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.669+0000 7f3768ae4640 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 0x5628b0d8cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37692e5640 1 -- 172.21.15.31:0/1482964539 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 msgr2=0x5628b0d8cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37692e5640 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 0x5628b0d8cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37692e5640 1 -- 172.21.15.31:0/1482964539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 msgr2=0x5628b0de6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37692e5640 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 0x5628b0de6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37692e5640 1 -- 172.21.15.31:0/1482964539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37640b68b0 con 0x5628b0d91420 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37692e5640 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0de71a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3764072460 tx=0x7f375c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dd74097a682424 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37437fe640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37437fe640 1 -- 172.21.15.31:0/1482964539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c026070 con 0x5628b0d91420 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37437fe640 1 -- 172.21.15.31:0/1482964539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f375c015db0 con 0x5628b0d91420 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 1 -- 172.21.15.31:0/1482964539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f375c007a00 con 0x5628b0d91420 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37437fe640 1 -- 172.21.15.31:0/1482964539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f375c0078a0 con 0x5628b0d91420 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 10 client.5154 fetch_fsmap learned FSMap version 13 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 1 -- 172.21.15.31:0/1482964539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x5628b0c5eb60 con 0x5628b0d91420 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37437fe640 1 -- 172.21.15.31:0/1482964539 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c007a00 con 0x5628b0d91420 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f37437fe640 1 -- 172.21.15.31:0/1482964539 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 13) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f375c012050 con 0x5628b0d91420 2023-12-22T08:41:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 10 client.5154 fetch_fsmap finished waiting for FSMap version 13 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 10 client.5154 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 20 client.5154 populate_metadata read hostname 'smithi031' 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] conn(0x5628b0df6f00 0x5628b0d8de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 4 client.5154 mds_command: new command op to 4974 tid=0[{"prefix": "status"}] 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f376d98b740 1 -- 172.21.15.31:0/1482964539 --> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5628b0cb6e50 con 0x5628b0df6f00 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.670+0000 7f3768ae4640 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] conn(0x5628b0df6f00 0x5628b0d8de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f37437fe640 10 client.5154 ms_handle_connect on v2:172.21.15.31:6832/3038519921 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f3768ae4640 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] conn(0x5628b0df6f00 0x5628b0d8de20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5045f2197f1c60cf server_cookie=7cdf78dc73738d92 in_seq=0 out_seq=0 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f37437fe640 1 -- 172.21.15.31:0/1482964539 <== mds.0 v2:172.21.15.31:6832/3038519921 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5628b0cb6e50 con 0x5628b0df6f00 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f37437fe640 10 client.5154 handle_command_reply: tid=0 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 client.5154 shutdown 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 -- 172.21.15.31:0/1482964539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 msgr2=0x5628b0de71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0de71a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3764072460 tx=0x7f375c001d80 comp rx=0 tx=0).stop 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 -- 172.21.15.31:0/1482964539 shutdown_connections 2023-12-22T08:41:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.31:6832/3038519921,v1:172.21.15.31:6834/3038519921] conn(0x5628b0df6f00 0x5628b0d8de20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5628b0d91420 0x5628b0de71a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5628b0d86d00 0x5628b0de6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f37437fe640 0 client.5154 ms_handle_reset on v2:172.21.15.31:6832/3038519921 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 --2- 172.21.15.31:0/1482964539 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5628b0d7db50 0x5628b0d8cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 -- 172.21.15.31:0/1482964539 >> 172.21.15.31:0/1482964539 conn(0x5628b0d55af0 msgr2=0x5628b0d80c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 -- 172.21.15.31:0/1482964539 shutdown_connections 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 1 -- 172.21.15.31:0/1482964539 wait complete. 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.671+0000 7f376d98b740 20 client.5154 trim_cache size 0 max 16384 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e4a54bac-4042-4984-af5f-75635705de5c", 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4974, 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 4.5665442699999996, 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 13, 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 31, 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 31, 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 11.791006858999999 2023-12-22T08:41:31.681 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:31.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 -- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f374806a430 msgr2=0x7f374806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f374806a430 0x7f374806c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f376414e620 tx=0x7f3750009190 comp rx=0 tx=0).stop 2023-12-22T08:41:31.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 -- 172.21.15.31:0/921076061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 msgr2=0x7f376414a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f376414a850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3758009ac0 tx=0x7f3758004730 comp rx=0 tx=0).stop 2023-12-22T08:41:31.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 -- 172.21.15.31:0/921076061 shutdown_connections 2023-12-22T08:41:31.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f374806a430 0x7f374806c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37640b6420 0x7f37641e2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37640a07e0 0x7f376414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 --2- 172.21.15.31:0/921076061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3754003970 0x7f376414a850 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 -- 172.21.15.31:0/921076061 >> 172.21.15.31:0/921076061 conn(0x7f376406ae10 msgr2=0x7f376406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 -- 172.21.15.31:0/921076061 shutdown_connections 2023-12-22T08:41:31.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.672+0000 7f376ad48640 1 -- 172.21.15.31:0/921076061 wait complete. 2023-12-22T08:41:31.685 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-22T08:41:31.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.789+0000 7f6ae94e7640 1 Processor -- start 2023-12-22T08:41:31.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.789+0000 7f6ae94e7640 1 -- start start 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6ae94e7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba550 0x7f6ae40b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6ae94e7640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6ae40ba000 0x7f6ae41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6ae94e7640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae40bb310 con 0x7f6ae406a6d0 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6ae94e7640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae40bf960 con 0x7f6ae40ba000 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6ae94e7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40bb5b0 con 0x7f6ae40ba550 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6adbfff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba550 0x7f6ae40b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6ae37fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6ae40ba000 0x7f6ae41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6adbfff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba550 0x7f6ae40b9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:54632/0 (socket says 172.21.15.31:54632) 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6adbfff640 1 -- 172.21.15.31:0/1046671072 learned_addr learned my addr 172.21.15.31:0/1046671072 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6ae37fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6ae40ba000 0x7f6ae41554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:50936/0 (socket says 172.21.15.31:50936) 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6ae2ffd640 1 --1- 172.21.15.31:0/1046671072 >> v1:172.21.15.69:6789/0 conn(0x7f6ae406a6d0 0x7f6ae414acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:36716/0 (socket says 172.21.15.31:36716) 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6adbfff640 1 -- 172.21.15.31:0/1046671072 >> v2:172.21.15.69:3300/0 conn(0x7f6ae40ba000 msgr2=0x7f6ae41554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6adbfff640 1 --2- 172.21.15.31:0/1046671072 >> v2:172.21.15.69:3300/0 conn(0x7f6ae40ba000 0x7f6ae41554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6adbfff640 1 -- 172.21.15.31:0/1046671072 >> v1:172.21.15.69:6789/0 conn(0x7f6ae406a6d0 legacy=0x7f6ae414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.790+0000 7f6adbfff640 1 -- 172.21.15.31:0/1046671072 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae40c0120 con 0x7f6ae40ba550 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.791+0000 7f6adbfff640 1 --2- 172.21.15.31:0/1046671072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba550 0x7f6ae40b9ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009870 tx=0x7f6acc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=280f1bd2cf9b6ebc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.791+0000 7f6ae27fc640 1 -- 172.21.15.31:0/1046671072 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc030840 con 0x7f6ae40ba550 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.791+0000 7f6ae27fc640 1 -- 172.21.15.31:0/1046671072 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc0309a0 con 0x7f6ae40ba550 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.791+0000 7f6ae27fc640 1 -- 172.21.15.31:0/1046671072 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc030d30 con 0x7f6ae40ba550 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.792+0000 7f6ae94e7640 1 -- 172.21.15.31:0/1046671072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba550 msgr2=0x7f6ae40b9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.792+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/1046671072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba550 0x7f6ae40b9ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009870 tx=0x7f6acc02b980 comp rx=0 tx=0).stop 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.792+0000 7f6ae94e7640 1 -- 172.21.15.31:0/1046671072 shutdown_connections 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.792+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/1046671072 >> v2:172.21.15.69:3300/0 conn(0x7f6ae40ba000 0x7f6ae41554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.792+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/1046671072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba550 0x7f6ae40b9ac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.792+0000 7f6ae94e7640 1 -- 172.21.15.31:0/1046671072 >> 172.21.15.31:0/1046671072 conn(0x7f6ae40c0350 msgr2=0x7f6ae40c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.792+0000 7f6ae94e7640 1 -- 172.21.15.31:0/1046671072 shutdown_connections 2023-12-22T08:41:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.792+0000 7f6ae94e7640 1 -- 172.21.15.31:0/1046671072 wait complete. 2023-12-22T08:41:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae94e7640 1 Processor -- start 2023-12-22T08:41:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae94e7640 1 -- start start 2023-12-22T08:41:31.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae94e7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae406a6d0 0x7f6ae4149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae94e7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba000 0x7f6ae409cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae94e7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae40ba550 0x7f6ae409d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae94e7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae409dc30 con 0x7f6ae40ba550 2023-12-22T08:41:31.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae94e7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae409f310 con 0x7f6ae406a6d0 2023-12-22T08:41:31.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae94e7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae409f5f0 con 0x7f6ae40ba000 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae40ba550 0x7f6ae409d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae40ba550 0x7f6ae409d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34942/0 (socket says 172.21.15.31:34942) 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.793+0000 7f6ae37fe640 1 -- 172.21.15.31:0/3892860030 learned_addr learned my addr 172.21.15.31:0/3892860030 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6adbfff640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba000 0x7f6ae409cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae2ffd640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae406a6d0 0x7f6ae4149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae37fe640 1 -- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba000 msgr2=0x7f6ae409cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae37fe640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba000 0x7f6ae409cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae37fe640 1 -- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae406a6d0 msgr2=0x7f6ae4149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae37fe640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae406a6d0 0x7f6ae4149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae37fe640 1 -- 172.21.15.31:0/3892860030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0094d0 con 0x7f6ae40ba550 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae37fe640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae40ba550 0x7f6ae409d530 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00efc0 tx=0x7f6adc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6adb7fe640 1 -- 172.21.15.31:0/3892860030 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc014480 con 0x7f6ae40ba550 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6adb7fe640 1 -- 172.21.15.31:0/3892860030 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc00f040 con 0x7f6ae40ba550 2023-12-22T08:41:31.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6adb7fe640 1 -- 172.21.15.31:0/3892860030 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc014820 con 0x7f6ae40ba550 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae414a9f0 con 0x7f6ae40ba550 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.794+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae41dfd70 con 0x7f6ae40ba550 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.795+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae4073a40 con 0x7f6ae40ba550 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.796+0000 7f6adb7fe640 1 -- 172.21.15.31:0/3892860030 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6adc014980 con 0x7f6ae40ba550 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.796+0000 7f6adb7fe640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6ac406a430 0x7f6ac406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.796+0000 7f6adb7fe640 1 -- 172.21.15.31:0/3892860030 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6adc0892c0 con 0x7f6ae40ba550 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.796+0000 7f6ae2ffd640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6ac406a430 0x7f6ac406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.797+0000 7f6ae2ffd640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6ac406a430 0x7f6ac406c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4000f60 tx=0x7f6ad4000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:31.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:31.801+0000 7f6adb7fe640 1 -- 172.21.15.31:0/3892860030 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6adc0549f0 con 0x7f6ae40ba550 2023-12-22T08:41:32.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.012+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ae40bba70 con 0x7f6ae40ba550 2023-12-22T08:41:32.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.013+0000 7f6adb7fe640 1 -- 172.21.15.31:0/3892860030 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6adc05e070 con 0x7f6ae40ba550 2023-12-22T08:41:32.015 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T08:41:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.014+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6ac406a430 msgr2=0x7f6ac406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.014+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6ac406a430 0x7f6ac406c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4000f60 tx=0x7f6ad4000ed0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae40ba550 msgr2=0x7f6ae409d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae40ba550 0x7f6ae409d530 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00efc0 tx=0x7f6adc00c490 comp rx=0 tx=0).stop 2023-12-22T08:41:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 shutdown_connections 2023-12-22T08:41:32.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f6ac406a430 0x7f6ac406c8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae40ba550 0x7f6ae409d530 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6ae40ba000 0x7f6ae409cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 --2- 172.21.15.31:0/3892860030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ae406a6d0 0x7f6ae4149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:32.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 >> 172.21.15.31:0/3892860030 conn(0x7f6ae40c0350 msgr2=0x7f6ae40b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:32.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 shutdown_connections 2023-12-22T08:41:32.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:32.015+0000 7f6ae94e7640 1 -- 172.21.15.31:0/3892860030 wait complete. 2023-12-22T08:41:32.027 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-22T08:41:32.027 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T08:41:32.028 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-12-22T08:41:32.028 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T08:41:32.028 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:32.028 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-22T08:41:32.028 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-22T08:41:32.028 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T08:41:32.028 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:41:32.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.028 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-12-22T08:41:32.090 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T08:41:32.090 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T08:41:32.090 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T08:41:32.090 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:32.090 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-12-22T08:41:32.090 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-12-22T08:41:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 8a:b4:6c:f8:40:bd brd ff:ff:ff:ff:ff:ff 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5041:afff:fef3:ccad/64 scope link 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 8a:b4:6c:f8:40:bd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::88b4:6cff:fef8:40bd/64 scope link 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-22T08:41:32.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.092 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T08:41:32.185 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-12-22T08:41:32.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.190 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-12-22T08:41:32.245 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-12-22T08:41:32.245 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T08:41:32.246 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T08:41:32.246 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-22T08:41:32.246 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T08:41:32.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.246 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-22T08:41:32.246 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-22T08:41:32.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T08:41:32.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T08:41:32.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T08:41:32.247 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-22T08:41:32.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.428 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-12-22T08:41:32.480 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:41:32.480 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:41:32.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-12-22T08:41:32.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:41:32.574 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:32.625 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T08:41:32.625 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-22T08:41:32.625 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:32.674 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-22T08:41:32.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T08:41:32.808 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T08:41:32.808 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T08:41:32.808 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-22T08:41:32.829 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T08:41:32.830 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T08:41:32.830 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-22T08:41:32.830 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.69:3300,172.21.15.69:3301" 2023-12-22T08:41:32.830 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T08:41:32.857 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-22T08:41:32.857 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-22T08:41:32.857 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-22T08:41:32.857 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.69:3300,172.21.15.69:3301" 2023-12-22T08:41:32.858 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-22T08:41:32.858 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.69:6789,172.21.15.69:6790" 2023-12-22T08:41:32.858 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.69:6789,172.21.15.69:6790:/ 2023-12-22T08:41:32.858 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e4a54bac-4042-4984-af5f-75635705de5c" will pass to kernel 2023-12-22T08:41:32.860 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-22T08:41:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2023-12-22T08:41:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-22T08:41:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2023-12-22T08:41:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-22T08:41:32.864 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-22T08:41:32.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:32.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:32.950 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-22T08:41:33.010 INFO:teuthology.orchestra.run.smithi081.stdout:client4945 2023-12-22T08:41:33.011 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:41:33.011 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:33.060 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=xfstests-dev 2023-12-22T08:41:33.159 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.26ccZnR7IAxfstests-dev 2023-12-22T08:41:33.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:33.159 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.26ccZnR7IAxfstests-dev) 2023-12-22T08:41:33.220 INFO:teuthology.orchestra.run.smithi081.stderr:Cloning into '/tmp/tmp.26ccZnR7IAxfstests-dev'... 2023-12-22T08:41:34.272 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=xfsprogs-dev 2023-12-22T08:41:34.325 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.2NZrMjeJsIxfsprogs-dev 2023-12-22T08:41:34.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:34.325 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.2NZrMjeJsIxfsprogs-dev) 2023-12-22T08:41:34.381 INFO:teuthology.orchestra.run.smithi081.stderr:Cloning into '/tmp/tmp.2NZrMjeJsIxfsprogs-dev'... 2023-12-22T08:41:35.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:35.037 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-22T08:41:35.099 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=test 2023-12-22T08:41:35.150 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.u3noGEKG7Ltest 2023-12-22T08:41:35.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:35.151 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-22T08:41:35.207 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=scratch 2023-12-22T08:41:35.255 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.iJTxP95Zx8scratch 2023-12-22T08:41:35.256 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-22T08:41:35.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-12-22T08:41:36.100 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:04:33 ago on Fri 22 Dec 2023 08:37:03 AM UTC. 2023-12-22T08:41:36.203 INFO:teuthology.orchestra.run.smithi081.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-22T08:41:36.204 INFO:teuthology.orchestra.run.smithi081.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T08:41:36.204 INFO:teuthology.orchestra.run.smithi081.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-22T08:41:36.205 INFO:teuthology.orchestra.run.smithi081.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-22T08:41:36.206 INFO:teuthology.orchestra.run.smithi081.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-22T08:41:36.208 INFO:teuthology.orchestra.run.smithi081.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-22T08:41:36.210 INFO:teuthology.orchestra.run.smithi081.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-22T08:41:36.211 INFO:teuthology.orchestra.run.smithi081.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-22T08:41:36.213 INFO:teuthology.orchestra.run.smithi081.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-22T08:41:36.213 INFO:teuthology.orchestra.run.smithi081.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-22T08:41:36.214 INFO:teuthology.orchestra.run.smithi081.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-22T08:41:36.215 INFO:teuthology.orchestra.run.smithi081.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-22T08:41:36.216 INFO:teuthology.orchestra.run.smithi081.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-22T08:41:36.217 INFO:teuthology.orchestra.run.smithi081.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-22T08:41:36.218 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2023-12-22T08:41:36.219 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2023-12-22T08:41:36.220 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-22T08:41:36.221 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-22T08:41:36.222 INFO:teuthology.orchestra.run.smithi081.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-22T08:41:36.223 INFO:teuthology.orchestra.run.smithi081.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-22T08:41:36.224 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-devel-6.3.0-1.el9.x86_64 is already installed. 2023-12-22T08:41:36.225 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-22T08:41:36.229 INFO:teuthology.orchestra.run.smithi081.stdout:Package gettext-0.21-8.el9.x86_64 is already installed. 2023-12-22T08:41:36.235 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2023-12-22T08:41:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:Error: 2023-12-22T08:41:36.304 INFO:teuthology.orchestra.run.smithi081.stderr: Problem: package device-mapper-devel-9:1.02.195-3.el9.x86_64 from crb requires device-mapper = 9:1.02.195-3.el9, but none of the providers can be installed 2023-12-22T08:41:36.304 INFO:teuthology.orchestra.run.smithi081.stderr: - cannot install both device-mapper-9:1.02.197-1.el9.x86_64 from CentOS-BaseOS and device-mapper-9:1.02.195-3.el9.x86_64 from @System 2023-12-22T08:41:36.304 INFO:teuthology.orchestra.run.smithi081.stderr: - cannot install both device-mapper-9:1.02.195-3.el9.x86_64 from baseos and device-mapper-9:1.02.197-1.el9.x86_64 from CentOS-BaseOS 2023-12-22T08:41:36.304 INFO:teuthology.orchestra.run.smithi081.stderr: - package device-mapper-event-9:1.02.197-1.el9.x86_64 from CentOS-BaseOS requires device-mapper = 9:1.02.197-1.el9, but none of the providers can be installed 2023-12-22T08:41:36.305 INFO:teuthology.orchestra.run.smithi081.stderr: - package lvm2-9:2.03.23-1.el9.x86_64 from CentOS-BaseOS requires lvm2-libs = 9:2.03.23-1.el9, but none of the providers can be installed 2023-12-22T08:41:36.305 INFO:teuthology.orchestra.run.smithi081.stderr: - package lvm2-libs-9:2.03.23-1.el9.i686 from CentOS-BaseOS requires device-mapper-event = 9:1.02.197-1.el9, but none of the providers can be installed 2023-12-22T08:41:36.305 INFO:teuthology.orchestra.run.smithi081.stderr: - package lvm2-libs-9:2.03.23-1.el9.x86_64 from CentOS-BaseOS requires device-mapper-event = 9:1.02.197-1.el9, but none of the providers can be installed 2023-12-22T08:41:36.305 INFO:teuthology.orchestra.run.smithi081.stderr: - cannot install the best candidate for the job 2023-12-22T08:41:36.305 INFO:teuthology.orchestra.run.smithi081.stdout:(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) 2023-12-22T08:41:36.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:41:36.355 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... ERROR 2023-12-22T08:41:36.355 INFO:tasks.cephfs_test_runner: 2023-12-22T08:41:36.355 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner:ERROR: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs/xfstests_dev.py", line 25, in setUp 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs/xfstests_dev.py", line 39, in prepare_xfstests_devs 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: self.install_deps() 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs/xfstests_dev.py", line 219, in install_deps 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/remote.py", line 523, in run 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 455, in run 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 161, in wait 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-22T08:41:36.356 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel' 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner: 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner:Ran 1 test in 28.158s 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner: 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner: 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner:ERROR: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs/xfstests_dev.py", line 25, in setUp 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2023-12-22T08:41:36.357 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs/xfstests_dev.py", line 39, in prepare_xfstests_devs 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: self.install_deps() 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs/xfstests_dev.py", line 219, in install_deps 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/remote.py", line 523, in run 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 455, in run 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 161, in wait 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi081 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel' 2023-12-22T08:41:36.358 INFO:tasks.cephfs_test_runner: 2023-12-22T08:41:36.358 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-22T08:41:36.430 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1893386c348a4d6eabd364402b51184a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-22T08:41:36.432 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-22T08:41:36.441 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-22T08:41:36.461 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-22T08:41:36.462 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:41:36.462 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:36.523 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-22T08:41:36.523 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-22T08:41:36.574 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:36.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.690+0000 7f3f40210640 1 Processor -- start 2023-12-22T08:41:36.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.690+0000 7f3f40210640 1 -- start start 2023-12-22T08:41:36.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f40210640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f380ba550 0x7f3f380b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f40210640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f380ba000 0x7f3f381554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f40210640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380bb310 con 0x7f3f3806a6d0 2023-12-22T08:41:36.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f40210640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f380bf960 con 0x7f3f380ba000 2023-12-22T08:41:36.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f40210640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380bb5b0 con 0x7f3f380ba550 2023-12-22T08:41:36.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f3e7ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f380ba000 0x7f3f381554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f3e7ad640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f380ba000 0x7f3f381554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45762/0 (socket says 172.21.15.31:45762) 2023-12-22T08:41:36.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f3e7ad640 1 -- 172.21.15.31:0/713010994 learned_addr learned my addr 172.21.15.31:0/713010994 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:36.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f3d7ab640 1 --2- 172.21.15.31:0/713010994 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f380ba550 0x7f3f380b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f3e7ad640 1 -- 172.21.15.31:0/713010994 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f380ba550 msgr2=0x7f3f380b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f3e7ad640 1 --2- 172.21.15.31:0/713010994 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f380ba550 0x7f3f380b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f3e7ad640 1 -- 172.21.15.31:0/713010994 >> v1:172.21.15.69:6789/0 conn(0x7f3f3806a6d0 legacy=0x7f3f3814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:36.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.691+0000 7f3f3e7ad640 1 -- 172.21.15.31:0/713010994 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380c0120 con 0x7f3f380ba000 2023-12-22T08:41:36.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.692+0000 7f3f3e7ad640 1 --2- 172.21.15.31:0/713010994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba000 0x7f3f381554e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009e50 tx=0x7f3f3002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d70c06d1510bc8a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.692+0000 7f3f3cfaa640 1 -- 172.21.15.31:0/713010994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3002ca70 con 0x7f3f380ba000 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.692+0000 7f3f3cfaa640 1 -- 172.21.15.31:0/713010994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3002cbd0 con 0x7f3f380ba000 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.692+0000 7f3f3cfaa640 1 -- 172.21.15.31:0/713010994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300343f0 con 0x7f3f380ba000 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.693+0000 7f3f40210640 1 -- 172.21.15.31:0/713010994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba000 msgr2=0x7f3f381554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.693+0000 7f3f40210640 1 --2- 172.21.15.31:0/713010994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba000 0x7f3f381554e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009e50 tx=0x7f3f3002bed0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.693+0000 7f3f40210640 1 -- 172.21.15.31:0/713010994 shutdown_connections 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.693+0000 7f3f40210640 1 --2- 172.21.15.31:0/713010994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba000 0x7f3f381554e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.693+0000 7f3f40210640 1 --2- 172.21.15.31:0/713010994 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f380ba550 0x7f3f380b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.693+0000 7f3f40210640 1 -- 172.21.15.31:0/713010994 >> 172.21.15.31:0/713010994 conn(0x7f3f380c0350 msgr2=0x7f3f380c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.693+0000 7f3f40210640 1 -- 172.21.15.31:0/713010994 shutdown_connections 2023-12-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.693+0000 7f3f40210640 1 -- 172.21.15.31:0/713010994 wait complete. 2023-12-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.694+0000 7f3f40210640 1 Processor -- start 2023-12-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.694+0000 7f3f40210640 1 -- start start 2023-12-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f40210640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f3806a6d0 0x7f3f3814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f40210640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380ba000 0x7f3f380b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f40210640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba550 0x7f3f38099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f40210640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3814ee40 con 0x7f3f380ba550 2023-12-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f40210640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380b5f30 con 0x7f3f380ba000 2023-12-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f40210640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380b3f20 con 0x7f3f3806a6d0 2023-12-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba550 0x7f3f38099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba550 0x7f3f38099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45768/0 (socket says 172.21.15.31:45768) 2023-12-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 -- 172.21.15.31:0/1130384290 learned_addr learned my addr 172.21.15.31:0/1130384290 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3dfac640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f3806a6d0 0x7f3f3814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3d7ab640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380ba000 0x7f3f380b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 -- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f3806a6d0 msgr2=0x7f3f3814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f3806a6d0 0x7f3f3814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 -- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380ba000 msgr2=0x7f3f380b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380ba000 0x7f3f380b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 -- 172.21.15.31:0/1130384290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30009b30 con 0x7f3f380ba550 2023-12-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f3e7ad640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba550 0x7f3f38099a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3f30036040 tx=0x7f3f30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.695+0000 7f3f2e7fc640 1 -- 172.21.15.31:0/1130384290 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30009510 con 0x7f3f380ba550 2023-12-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.696+0000 7f3f2e7fc640 1 -- 172.21.15.31:0/1130384290 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3003e450 con 0x7f3f380ba550 2023-12-22T08:41:36.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.696+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f380b4200 con 0x7f3f380ba550 2023-12-22T08:41:36.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.696+0000 7f3f2e7fc640 1 -- 172.21.15.31:0/1130384290 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3003e7e0 con 0x7f3f380ba550 2023-12-22T08:41:36.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.696+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f380b47c0 con 0x7f3f380ba550 2023-12-22T08:41:36.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.697+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3809fad0 con 0x7f3f380ba550 2023-12-22T08:41:36.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.697+0000 7f3f2e7fc640 1 -- 172.21.15.31:0/1130384290 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f3003e940 con 0x7f3f380ba550 2023-12-22T08:41:36.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.697+0000 7f3f2e7fc640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:36.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.697+0000 7f3f2e7fc640 1 -- 172.21.15.31:0/1130384290 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f300ab4f0 con 0x7f3f380ba550 2023-12-22T08:41:36.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.698+0000 7f3f3dfac640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:36.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.698+0000 7f3f3dfac640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3f34004f60 tx=0x7f3f34007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:36.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.702+0000 7f3f2e7fc640 1 -- 172.21.15.31:0/1130384290 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3f30076c20 con 0x7f3f380ba550 2023-12-22T08:41:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.879+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f38073a40 con 0x7f3f380ba550 2023-12-22T08:41:36.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.880+0000 7f3f2e7fc640 1 -- 172.21.15.31:0/1130384290 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f3f3007a240 con 0x7f3f380ba550 2023-12-22T08:41:36.882 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:36.883 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:41:28.105217+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:24.856244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:26.086679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:36.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3f1c06a430 msgr2=0x7f3f1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3f34004f60 tx=0x7f3f34007e30 comp rx=0 tx=0).stop 2023-12-22T08:41:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba550 msgr2=0x7f3f38099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba550 0x7f3f38099a40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3f30036040 tx=0x7f3f30004a40 comp rx=0 tx=0).stop 2023-12-22T08:41:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 shutdown_connections 2023-12-22T08:41:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f380ba550 0x7f3f38099a40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f380ba000 0x7f3f380b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 --2- 172.21.15.31:0/1130384290 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f3806a6d0 0x7f3f3814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:36.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 >> 172.21.15.31:0/1130384290 conn(0x7f3f380c0350 msgr2=0x7f3f380c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:36.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 shutdown_connections 2023-12-22T08:41:36.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:36.882+0000 7f3f40210640 1 -- 172.21.15.31:0/1130384290 wait complete. 2023-12-22T08:41:36.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-22T08:40:33.839141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T08:41:24.856244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T08:41:26.086679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-22T08:41:36.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-22T08:41:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.003+0000 7f72a091b640 1 Processor -- start 2023-12-22T08:41:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.003+0000 7f72a091b640 1 -- start start 2023-12-22T08:41:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f72a091b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f729c141520 0x7f729c0bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f72a091b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c0b7740 0x7f729c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f72a091b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c0b83d0 con 0x7f729c0b8b40 2023-12-22T08:41:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f72a091b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c141900 con 0x7f729c141520 2023-12-22T08:41:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f72a091b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0b86b0 con 0x7f729c0b7740 2023-12-22T08:41:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f729ad9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c0b7740 0x7f729c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f729a59c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f729c141520 0x7f729c0bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f729ad9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c0b7740 0x7f729c1552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.31:55032/0 (socket says 172.21.15.31:55032) 2023-12-22T08:41:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f729ad9d640 1 -- 172.21.15.31:0/1317310646 learned_addr learned my addr 172.21.15.31:0/1317310646 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f729ad9d640 1 -- 172.21.15.31:0/1317310646 >> v2:172.21.15.69:3300/0 conn(0x7f729c141520 msgr2=0x7f729c0bc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f7299d9b640 1 -- 172.21.15.31:0/1317310646 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506473426 0 0) 0x7f729c0b83d0 con 0x7f729c0b8b40 2023-12-22T08:41:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f729ad9d640 1 --2- 172.21.15.31:0/1317310646 >> v2:172.21.15.69:3300/0 conn(0x7f729c141520 0x7f729c0bc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f729ad9d640 1 -- 172.21.15.31:0/1317310646 >> v1:172.21.15.69:6789/0 conn(0x7f729c0b8b40 legacy=0x7f729c14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.004+0000 7f729ad9d640 1 -- 172.21.15.31:0/1317310646 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0bc0c0 con 0x7f729c0b7740 2023-12-22T08:41:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.005+0000 7f729ad9d640 1 --2- 172.21.15.31:0/1317310646 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c0b7740 0x7f729c1552e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7294009e50 tx=0x7f729402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8cf6030ea2ea21b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.005+0000 7f7299d9b640 1 -- 172.21.15.31:0/1317310646 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729402ca70 con 0x7f729c0b7740 2023-12-22T08:41:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.005+0000 7f7299d9b640 1 -- 172.21.15.31:0/1317310646 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729402cbd0 con 0x7f729c0b7740 2023-12-22T08:41:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.005+0000 7f7299d9b640 1 -- 172.21.15.31:0/1317310646 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72940343f0 con 0x7f729c0b7740 2023-12-22T08:41:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.006+0000 7f72a091b640 1 -- 172.21.15.31:0/1317310646 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c0b7740 msgr2=0x7f729c1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.006+0000 7f72a091b640 1 --2- 172.21.15.31:0/1317310646 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c0b7740 0x7f729c1552e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7294009e50 tx=0x7f729402bed0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.006+0000 7f72a091b640 1 -- 172.21.15.31:0/1317310646 shutdown_connections 2023-12-22T08:41:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.006+0000 7f72a091b640 1 --2- 172.21.15.31:0/1317310646 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c0b7740 0x7f729c1552e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.006+0000 7f72a091b640 1 --2- 172.21.15.31:0/1317310646 >> v2:172.21.15.69:3300/0 conn(0x7f729c141520 0x7f729c0bc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.006+0000 7f72a091b640 1 -- 172.21.15.31:0/1317310646 >> 172.21.15.31:0/1317310646 conn(0x7f729c0c0300 msgr2=0x7f729c0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.006+0000 7f72a091b640 1 -- 172.21.15.31:0/1317310646 shutdown_connections 2023-12-22T08:41:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.006+0000 7f72a091b640 1 -- 172.21.15.31:0/1317310646 wait complete. 2023-12-22T08:41:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.007+0000 7f72a091b640 1 Processor -- start 2023-12-22T08:41:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.007+0000 7f72a091b640 1 -- start start 2023-12-22T08:41:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f72a091b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f729c0b7740 0x7f729c140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f72a091b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f729c0b8b40 0x7f729c1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f72a091b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c141520 0x7f729c141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f72a091b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c140670 con 0x7f729c0b8b40 2023-12-22T08:41:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f72a091b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c143a10 con 0x7f729c0b7740 2023-12-22T08:41:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f72a091b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c144ba0 con 0x7f729c141520 2023-12-22T08:41:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f7291d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f729c0b8b40 0x7f729c1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f7291d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f729c0b8b40 0x7f729c1434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45770/0 (socket says 172.21.15.31:45770) 2023-12-22T08:41:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f7291d9b640 1 -- 172.21.15.31:0/3367566659 learned_addr learned my addr 172.21.15.31:0/3367566659 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f729a59c640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f729c0b7740 0x7f729c140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f729ad9d640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c141520 0x7f729c141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f7291d9b640 1 -- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c141520 msgr2=0x7f729c141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f7291d9b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c141520 0x7f729c141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f7291d9b640 1 -- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f729c0b7740 msgr2=0x7f729c140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f7291d9b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f729c0b7740 0x7f729c140130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.008+0000 7f7291d9b640 1 -- 172.21.15.31:0/3367566659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7294009b30 con 0x7f729c0b8b40 2023-12-22T08:41:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.009+0000 7f7291d9b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f729c0b8b40 0x7f729c1434d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f728400c4b0 tx=0x7f728400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.009+0000 7f72937fe640 1 -- 172.21.15.31:0/3367566659 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7284005480 con 0x7f729c0b8b40 2023-12-22T08:41:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.009+0000 7f72937fe640 1 -- 172.21.15.31:0/3367566659 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72840035f0 con 0x7f729c0b8b40 2023-12-22T08:41:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.009+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c145340 con 0x7f729c0b8b40 2023-12-22T08:41:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.009+0000 7f72937fe640 1 -- 172.21.15.31:0/3367566659 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840039e0 con 0x7f729c0b8b40 2023-12-22T08:41:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.009+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c145930 con 0x7f729c0b8b40 2023-12-22T08:41:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.010+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c143230 con 0x7f729c0b8b40 2023-12-22T08:41:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.010+0000 7f72937fe640 1 -- 172.21.15.31:0/3367566659 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7284003b40 con 0x7f729c0b8b40 2023-12-22T08:41:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.011+0000 7f72937fe640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f727c06a430 0x7f727c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.011+0000 7f72937fe640 1 -- 172.21.15.31:0/3367566659 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7284087e60 con 0x7f729c0b8b40 2023-12-22T08:41:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.011+0000 7f729a59c640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f727c06a430 0x7f727c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.011+0000 7f729a59c640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f727c06a430 0x7f727c06c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f728c009aa0 tx=0x7f728c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.015+0000 7f72937fe640 1 -- 172.21.15.31:0/3367566659 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7284053510 con 0x7f729c0b8b40 2023-12-22T08:41:37.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.192+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f729c145760 con 0x7f729c0b8b40 2023-12-22T08:41:37.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.192+0000 7f72937fe640 1 -- 172.21.15.31:0/3367566659 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72840170a0 con 0x7f729c0b8b40 2023-12-22T08:41:37.195 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-12-22T08:41:37.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f727c06a430 msgr2=0x7f727c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f727c06a430 0x7f727c06c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f728c009aa0 tx=0x7f728c009190 comp rx=0 tx=0).stop 2023-12-22T08:41:37.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f729c0b8b40 msgr2=0x7f729c1434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f729c0b8b40 0x7f729c1434d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f728400c4b0 tx=0x7f728400c970 comp rx=0 tx=0).stop 2023-12-22T08:41:37.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 shutdown_connections 2023-12-22T08:41:37.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f727c06a430 0x7f727c06c8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f729c141520 0x7f729c141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f729c0b8b40 0x7f729c1434d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 --2- 172.21.15.31:0/3367566659 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f729c0b7740 0x7f729c140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 >> 172.21.15.31:0/3367566659 conn(0x7f729c0c0300 msgr2=0x7f729c0bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 shutdown_connections 2023-12-22T08:41:37.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.194+0000 7f72a091b640 1 -- 172.21.15.31:0/3367566659 wait complete. 2023-12-22T08:41:37.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T08:41:37.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.313+0000 7f52f2f6e640 1 Processor -- start 2023-12-22T08:41:37.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.313+0000 7f52f2f6e640 1 -- start start 2023-12-22T08:41:37.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f2f6e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52ec0b8690 0x7f52ec0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f2f6e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec144d80 0x7f52ec14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f2f6e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec14ab10 con 0x7f52ec0b77d0 2023-12-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f2f6e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec06c2f0 con 0x7f52ec0b8690 2023-12-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f2f6e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0ba620 con 0x7f52ec144d80 2023-12-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f0d0a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52ec0b8690 0x7f52ec0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f0d0a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52ec0b8690 0x7f52ec0b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45774/0 (socket says 172.21.15.31:45774) 2023-12-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f0d0a640 1 -- 172.21.15.31:0/3417457622 learned_addr learned my addr 172.21.15.31:0/3417457622 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:37.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52ebfff640 1 --1- 172.21.15.31:0/3417457622 >> v1:172.21.15.31:6789/0 conn(0x7f52ec0b77d0 0x7f52ec144670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33576/0 (socket says 172.21.15.31:33576) 2023-12-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f150b640 1 --2- 172.21.15.31:0/3417457622 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec144d80 0x7f52ec14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f0d0a640 1 -- 172.21.15.31:0/3417457622 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec144d80 msgr2=0x7f52ec14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f0d0a640 1 --2- 172.21.15.31:0/3417457622 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec144d80 0x7f52ec14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f0d0a640 1 -- 172.21.15.31:0/3417457622 >> v1:172.21.15.31:6789/0 conn(0x7f52ec0b77d0 legacy=0x7f52ec144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52f0d0a640 1 -- 172.21.15.31:0/3417457622 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0b9e60 con 0x7f52ec0b8690 2023-12-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.314+0000 7f52eb7fe640 1 -- 172.21.15.31:0/3417457622 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363078350 0 0) 0x7f52ec14ab10 con 0x7f52ec0b77d0 2023-12-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.315+0000 7f52f0d0a640 1 --2- 172.21.15.31:0/3417457622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec0b8690 0x7f52ec0b8a70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009870 tx=0x7f52e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da463158038dbbd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.315+0000 7f52eb7fe640 1 -- 172.21.15.31:0/3417457622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4031640 con 0x7f52ec0b8690 2023-12-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.315+0000 7f52eb7fe640 1 -- 172.21.15.31:0/3417457622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e40317a0 con 0x7f52ec0b8690 2023-12-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.315+0000 7f52eb7fe640 1 -- 172.21.15.31:0/3417457622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4031b30 con 0x7f52ec0b8690 2023-12-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.316+0000 7f52f2f6e640 1 -- 172.21.15.31:0/3417457622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec0b8690 msgr2=0x7f52ec0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.316+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/3417457622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec0b8690 0x7f52ec0b8a70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009870 tx=0x7f52e402b8f0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.316+0000 7f52f2f6e640 1 -- 172.21.15.31:0/3417457622 shutdown_connections 2023-12-22T08:41:37.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.316+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/3417457622 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec144d80 0x7f52ec14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.316+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/3417457622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec0b8690 0x7f52ec0b8a70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.316+0000 7f52f2f6e640 1 -- 172.21.15.31:0/3417457622 >> 172.21.15.31:0/3417457622 conn(0x7f52ec06b6a0 msgr2=0x7f52ec06bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.316+0000 7f52f2f6e640 1 -- 172.21.15.31:0/3417457622 shutdown_connections 2023-12-22T08:41:37.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.316+0000 7f52f2f6e640 1 -- 172.21.15.31:0/3417457622 wait complete. 2023-12-22T08:41:37.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.317+0000 7f52f2f6e640 1 Processor -- start 2023-12-22T08:41:37.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.317+0000 7f52f2f6e640 1 -- start start 2023-12-22T08:41:37.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f2f6e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52ec0b77d0 0x7f52ec149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f2f6e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec0b8690 0x7f52ec1e00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f2f6e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec144d80 0x7f52ec13bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f2f6e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1490f0 con 0x7f52ec144d80 2023-12-22T08:41:37.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f2f6e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec145460 con 0x7f52ec0b77d0 2023-12-22T08:41:37.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f2f6e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec148b30 con 0x7f52ec0b8690 2023-12-22T08:41:37.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec144d80 0x7f52ec13bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec144d80 0x7f52ec13bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45784/0 (socket says 172.21.15.31:45784) 2023-12-22T08:41:37.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 -- 172.21.15.31:0/2679036385 learned_addr learned my addr 172.21.15.31:0/2679036385 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:37.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52ebfff640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec0b8690 0x7f52ec1e00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.327 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f0d0a640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52ec0b77d0 0x7f52ec149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 -- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec0b8690 msgr2=0x7f52ec1e00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec0b8690 0x7f52ec1e00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 -- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52ec0b77d0 msgr2=0x7f52ec149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52ec0b77d0 0x7f52ec149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 -- 172.21.15.31:0/2679036385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40094d0 con 0x7f52ec144d80 2023-12-22T08:41:37.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f0d0a640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52ec0b77d0 0x7f52ec149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:37.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f150b640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec144d80 0x7f52ec13bf10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f52d400d510 tx=0x7f52d400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52e97fa640 1 -- 172.21.15.31:0/2679036385 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d40125f0 con 0x7f52ec144d80 2023-12-22T08:41:37.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52e97fa640 1 -- 172.21.15.31:0/2679036385 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d4012770 con 0x7f52ec144d80 2023-12-22T08:41:37.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec148e10 con 0x7f52ec144d80 2023-12-22T08:41:37.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.318+0000 7f52e97fa640 1 -- 172.21.15.31:0/2679036385 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4012b20 con 0x7f52ec144d80 2023-12-22T08:41:37.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.319+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec148080 con 0x7f52ec144d80 2023-12-22T08:41:37.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.320+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec1df9f0 con 0x7f52ec144d80 2023-12-22T08:41:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.320+0000 7f52e97fa640 1 -- 172.21.15.31:0/2679036385 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f52d4012c80 con 0x7f52ec144d80 2023-12-22T08:41:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.320+0000 7f52e97fa640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f52cc06a430 0x7f52cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.321+0000 7f52e97fa640 1 -- 172.21.15.31:0/2679036385 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52d4088d20 con 0x7f52ec144d80 2023-12-22T08:41:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.321+0000 7f52f0d0a640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f52cc06a430 0x7f52cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.321+0000 7f52f0d0a640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f52cc06a430 0x7f52cc06c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f52e4036000 tx=0x7f52e4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.325+0000 7f52e97fa640 1 -- 172.21.15.31:0/2679036385 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f52ec1df9f0 con 0x7f52ec144d80 2023-12-22T08:41:37.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.500+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52ec1dfdd0 con 0x7f52ec144d80 2023-12-22T08:41:37.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.500+0000 7f52e97fa640 1 -- 172.21.15.31:0/2679036385 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52ec1dfdd0 con 0x7f52ec144d80 2023-12-22T08:41:37.503 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-12-22T08:41:37.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f52cc06a430 msgr2=0x7f52cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f52cc06a430 0x7f52cc06c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f52e4036000 tx=0x7f52e4008030 comp rx=0 tx=0).stop 2023-12-22T08:41:37.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec144d80 msgr2=0x7f52ec13bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec144d80 0x7f52ec13bf10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f52d400d510 tx=0x7f52d400d9d0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 shutdown_connections 2023-12-22T08:41:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f52cc06a430 0x7f52cc06c8f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ec144d80 0x7f52ec13bf10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f52ec0b8690 0x7f52ec1e00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 --2- 172.21.15.31:0/2679036385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52ec0b77d0 0x7f52ec149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 >> 172.21.15.31:0/2679036385 conn(0x7f52ec06b6a0 msgr2=0x7f52ec1432a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 shutdown_connections 2023-12-22T08:41:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.502+0000 7f52f2f6e640 1 -- 172.21.15.31:0/2679036385 wait complete. 2023-12-22T08:41:37.515 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T08:41:37.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.622+0000 7f58326ec640 1 Processor -- start 2023-12-22T08:41:37.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.622+0000 7f58326ec640 1 -- start start 2023-12-22T08:41:37.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f58326ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f582c1489c0 0x7f582c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f58326ec640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0b7a10 con 0x7f582c0b9450 2023-12-22T08:41:37.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f58326ec640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c070fd0 con 0x7f582c06a1e0 2023-12-22T08:41:37.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f58326ec640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0713f0 con 0x7f582c1489c0 2023-12-22T08:41:37.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f5830c89640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f582c1489c0 0x7f582c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f582bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f582c0b9450 0x7f582c0b7ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33578/0 (socket says 172.21.15.31:33578) 2023-12-22T08:41:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f5830c89640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f582c1489c0 0x7f582c1542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45790/0 (socket says 172.21.15.31:45790) 2023-12-22T08:41:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f582bfff640 1 -- 172.21.15.31:0/365459924 learned_addr learned my addr 172.21.15.31:0/365459924 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f5830c89640 1 -- 172.21.15.31:0/365459924 >> v1:172.21.15.69:6789/0 conn(0x7f582c06a1e0 legacy=0x7f582c149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f5830c89640 1 -- 172.21.15.31:0/365459924 >> v1:172.21.15.31:6789/0 conn(0x7f582c0b9450 legacy=0x7f582c0b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f5830c89640 1 -- 172.21.15.31:0/365459924 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c071690 con 0x7f582c1489c0 2023-12-22T08:41:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.623+0000 7f582affd640 1 -- 172.21.15.31:0/365459924 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209678757 0 0) 0x7f582c0b7a10 con 0x7f582c0b9450 2023-12-22T08:41:37.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f5830c89640 1 --2- 172.21.15.31:0/365459924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c1489c0 0x7f582c1542b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5824009d90 tx=0x7f582402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cf9b69e08b98a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f582affd640 1 -- 172.21.15.31:0/365459924 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582402cd80 con 0x7f582c1489c0 2023-12-22T08:41:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f582affd640 1 -- 172.21.15.31:0/365459924 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824034440 con 0x7f582c1489c0 2023-12-22T08:41:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f582affd640 1 -- 172.21.15.31:0/365459924 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240347d0 con 0x7f582c1489c0 2023-12-22T08:41:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f58326ec640 1 -- 172.21.15.31:0/365459924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c1489c0 msgr2=0x7f582c1542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f58326ec640 1 --2- 172.21.15.31:0/365459924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c1489c0 0x7f582c1542b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5824009d90 tx=0x7f582402bfd0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f58326ec640 1 -- 172.21.15.31:0/365459924 shutdown_connections 2023-12-22T08:41:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f58326ec640 1 --2- 172.21.15.31:0/365459924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c1489c0 0x7f582c1542b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.624+0000 7f58326ec640 1 -- 172.21.15.31:0/365459924 >> 172.21.15.31:0/365459924 conn(0x7f582c0bd090 msgr2=0x7f582c0bd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.625+0000 7f58326ec640 1 -- 172.21.15.31:0/365459924 shutdown_connections 2023-12-22T08:41:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.625+0000 7f58326ec640 1 -- 172.21.15.31:0/365459924 wait complete. 2023-12-22T08:41:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f58326ec640 1 Processor -- start 2023-12-22T08:41:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f58326ec640 1 -- start start 2023-12-22T08:41:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f58326ec640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f582c06a1e0 0x7f582c09f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f58326ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c0b9450 0x7f582c1d3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f58326ec640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582c1489c0 0x7f582c1e0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f58326ec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1d4360 con 0x7f582c0b9450 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f58326ec640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0b3860 con 0x7f582c1489c0 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f58326ec640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0b3b40 con 0x7f582c06a1e0 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f582b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c0b9450 0x7f582c1d3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f582b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c0b9450 0x7f582c1d3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45802/0 (socket says 172.21.15.31:45802) 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.626+0000 7f582b7fe640 1 -- 172.21.15.31:0/2243944001 learned_addr learned my addr 172.21.15.31:0/2243944001 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f582bfff640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f582c06a1e0 0x7f582c09f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f5830c89640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582c1489c0 0x7f582c1e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f582b7fe640 1 -- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f582c06a1e0 msgr2=0x7f582c09f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f582b7fe640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f582c06a1e0 0x7f582c09f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f582b7fe640 1 -- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582c1489c0 msgr2=0x7f582c1e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f582b7fe640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582c1489c0 0x7f582c1e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f582b7fe640 1 -- 172.21.15.31:0/2243944001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824009a70 con 0x7f582c0b9450 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f582bfff640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f582c06a1e0 0x7f582c09f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f5830c89640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582c1489c0 0x7f582c1e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f582b7fe640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c0b9450 0x7f582c1d3e20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f582000c450 tx=0x7f582000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f5828ff9640 1 -- 172.21.15.31:0/2243944001 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200052d0 con 0x7f582c0b9450 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f5828ff9640 1 -- 172.21.15.31:0/2243944001 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820005430 con 0x7f582c0b9450 2023-12-22T08:41:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c0b3e20 con 0x7f582c0b9450 2023-12-22T08:41:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f5828ff9640 1 -- 172.21.15.31:0/2243944001 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820012870 con 0x7f582c0b9450 2023-12-22T08:41:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.627+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c1d46f0 con 0x7f582c0b9450 2023-12-22T08:41:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.628+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c0707e0 con 0x7f582c0b9450 2023-12-22T08:41:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.628+0000 7f5828ff9640 1 -- 172.21.15.31:0/2243944001 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f58200129d0 con 0x7f582c0b9450 2023-12-22T08:41:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.629+0000 7f5828ff9640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f581806a430 0x7f581806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.629+0000 7f5828ff9640 1 -- 172.21.15.31:0/2243944001 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58200883e0 con 0x7f582c0b9450 2023-12-22T08:41:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.629+0000 7f582bfff640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f581806a430 0x7f581806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.630+0000 7f582bfff640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f581806a430 0x7f581806c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f581c000f60 tx=0x7f581c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.633+0000 7f5828ff9640 1 -- 172.21.15.31:0/2243944001 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f58200539d0 con 0x7f582c0b9450 2023-12-22T08:41:37.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.808+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f582c1d4880 con 0x7f582c0b9450 2023-12-22T08:41:37.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.809+0000 7f5828ff9640 1 -- 172.21.15.31:0/2243944001 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5820056ff0 con 0x7f582c0b9450 2023-12-22T08:41:37.811 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-12-22T08:41:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f581806a430 msgr2=0x7f581806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f581806a430 0x7f581806c8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f581c000f60 tx=0x7f581c009040 comp rx=0 tx=0).stop 2023-12-22T08:41:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c0b9450 msgr2=0x7f582c1d3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c0b9450 0x7f582c1d3e20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f582000c450 tx=0x7f582000c910 comp rx=0 tx=0).stop 2023-12-22T08:41:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 shutdown_connections 2023-12-22T08:41:37.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f581806a430 0x7f581806c8f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582c1489c0 0x7f582c1e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f582c0b9450 0x7f582c1d3e20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 --2- 172.21.15.31:0/2243944001 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f582c06a1e0 0x7f582c09f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 >> 172.21.15.31:0/2243944001 conn(0x7f582c0bd090 msgr2=0x7f582c0ba3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 shutdown_connections 2023-12-22T08:41:37.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.811+0000 7f58326ec640 1 -- 172.21.15.31:0/2243944001 wait complete. 2023-12-22T08:41:37.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-22T08:41:37.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.929+0000 7fc5291ab640 1 Processor -- start 2023-12-22T08:41:37.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.929+0000 7fc5291ab640 1 -- start start 2023-12-22T08:41:37.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc5291ab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc52414aa00 0x7fc5240bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc5291ab640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5240bacc0 con 0x7fc5240b79f0 2023-12-22T08:41:37.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc5291ab640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5240bbe60 con 0x7fc524140ef0 2023-12-22T08:41:37.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc5291ab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240bbca0 con 0x7fc52414aa00 2023-12-22T08:41:37.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc522d9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc5240b79f0 0x7fc5240b83a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33592/0 (socket says 172.21.15.31:33592) 2023-12-22T08:41:37.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc522d9d640 1 -- 172.21.15.31:0/3605970703 learned_addr learned my addr 172.21.15.31:0/3605970703 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:37.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc51bfff640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc52414aa00 0x7fc5240bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657902685 0 0) 0x7fc5240bacc0 con 0x7fc5240b79f0 2023-12-22T08:41:37.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc510003520 con 0x7fc5240b79f0 2023-12-22T08:41:37.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142970956 0 0) 0x7fc5240bbe60 con 0x7fc524140ef0 2023-12-22T08:41:37.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5240bacc0 con 0x7fc524140ef0 2023-12-22T08:41:37.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4276469540 0 0) 0x7fc510003520 con 0x7fc5240b79f0 2023-12-22T08:41:37.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc52414aa00 msgr2=0x7fc5240bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:37.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc52414aa00 0x7fc5240bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 >> v1:172.21.15.69:6789/0 conn(0x7fc524140ef0 legacy=0x7fc524141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240b8bc0 con 0x7fc5240b79f0 2023-12-22T08:41:37.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7fc514001670 con 0x7fc5240b79f0 2023-12-22T08:41:37.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 >> v1:172.21.15.31:6789/0 conn(0x7fc5240b79f0 legacy=0x7fc5240b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc510003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5100047c0 0x7fc510004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc52414aa00 0x7fc510005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51000ba30 con 0x7fc510003b30 2023-12-22T08:41:37.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51000bba0 con 0x7fc5100047c0 2023-12-22T08:41:37.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51000bd60 con 0x7fc52414aa00 2023-12-22T08:41:37.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.930+0000 7fc522d9d640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc510003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.931+0000 7fc51bfff640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5100047c0 0x7fc510004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.931+0000 7fc52359e640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc52414aa00 0x7fc510005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.931+0000 7fc522d9d640 1 -- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc52414aa00 msgr2=0x7fc510005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:37.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.931+0000 7fc522d9d640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc52414aa00 0x7fc510005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.931+0000 7fc522d9d640 1 -- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5100047c0 msgr2=0x7fc510004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:37.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.931+0000 7fc522d9d640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5100047c0 0x7fc510004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.931+0000 7fc522d9d640 1 -- 172.21.15.31:0/3605970703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510003520 con 0x7fc510003b30 2023-12-22T08:41:37.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.931+0000 7fc522d9d640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc510003f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc514007f90 tx=0x7fc5100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81d2246c0f959a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514005ad0 con 0x7fc510003b30 2023-12-22T08:41:37.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc514005c30 con 0x7fc510003b30 2023-12-22T08:41:37.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc52259c640 1 -- 172.21.15.31:0/3605970703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51402c790 con 0x7fc510003b30 2023-12-22T08:41:37.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc5291ab640 1 -- 172.21.15.31:0/3605970703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 msgr2=0x7fc510003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc5291ab640 1 --2- 172.21.15.31:0/3605970703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc510003f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc514007f90 tx=0x7fc5100057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc52359e640 1 -- 172.21.15.31:0/3605970703 reap_dead start 2023-12-22T08:41:37.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc5291ab640 1 -- 172.21.15.31:0/3605970703 shutdown_connections 2023-12-22T08:41:37.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc5291ab640 1 -- 172.21.15.31:0/3605970703 >> 172.21.15.31:0/3605970703 conn(0x7fc5240c0340 msgr2=0x7fc5240c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:37.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc5291ab640 1 -- 172.21.15.31:0/3605970703 shutdown_connections 2023-12-22T08:41:37.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.932+0000 7fc5291ab640 1 -- 172.21.15.31:0/3605970703 wait complete. 2023-12-22T08:41:37.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.933+0000 7fc5291ab640 1 Processor -- start 2023-12-22T08:41:37.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.933+0000 7fc5291ab640 1 -- start start 2023-12-22T08:41:37.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc5291ab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc524149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc5291ab640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5241498c0 0x7fc5241dfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc5291ab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc5241e00b0 0x7fc52413ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc5291ab640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241487e0 con 0x7fc510003b30 2023-12-22T08:41:37.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc5291ab640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241df690 con 0x7fc5241498c0 2023-12-22T08:41:37.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc5291ab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc524148500 con 0x7fc5241e00b0 2023-12-22T08:41:37.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc522d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc524149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc522d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc524149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45816/0 (socket says 172.21.15.31:45816) 2023-12-22T08:41:37.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc522d9d640 1 -- 172.21.15.31:0/2909743332 learned_addr learned my addr 172.21.15.31:0/2909743332 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:37.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc522d9d640 1 -- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc5241e00b0 msgr2=0x7fc52413ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc522d9d640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc5241e00b0 0x7fc52413ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc522d9d640 1 -- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5241498c0 msgr2=0x7fc5241dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:37.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc522d9d640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5241498c0 0x7fc5241dfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:37.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.934+0000 7fc522d9d640 1 -- 172.21.15.31:0/2909743332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5241481d0 con 0x7fc510003b30 2023-12-22T08:41:37.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.935+0000 7fc522d9d640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc524149380 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc514007f90 tx=0x7fc514001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.935+0000 7fc51b7fe640 1 -- 172.21.15.31:0/2909743332 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514039070 con 0x7fc510003b30 2023-12-22T08:41:37.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.935+0000 7fc51b7fe640 1 -- 172.21.15.31:0/2909743332 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51402dc30 con 0x7fc510003b30 2023-12-22T08:41:37.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.935+0000 7fc51b7fe640 1 -- 172.21.15.31:0/2909743332 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51403c040 con 0x7fc510003b30 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.935+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52413c730 con 0x7fc510003b30 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.935+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc524148a10 con 0x7fc510003b30 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.936+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc524148360 con 0x7fc510003b30 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.936+0000 7fc51b7fe640 1 -- 172.21.15.31:0/2909743332 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc514032070 con 0x7fc510003b30 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.936+0000 7fc51b7fe640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc50406a430 0x7fc50406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.937+0000 7fc51b7fe640 1 -- 172.21.15.31:0/2909743332 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5140a9e00 con 0x7fc510003b30 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.937+0000 7fc51bfff640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc50406a430 0x7fc50406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.937+0000 7fc51bfff640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc50406a430 0x7fc50406c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc524146ef0 tx=0x7fc50c0095d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:37.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:37.941+0000 7fc51b7fe640 1 -- 172.21.15.31:0/2909743332 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc524148360 con 0x7fc510003b30 2023-12-22T08:41:38.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.129+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc524148360 con 0x7fc510003b30 2023-12-22T08:41:38.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.129+0000 7fc51b7fe640 1 -- 172.21.15.31:0/2909743332 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc524148360 con 0x7fc510003b30 2023-12-22T08:41:38.132 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2023-12-22T08:41:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc50406a430 msgr2=0x7fc50406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc50406a430 0x7fc50406c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc524146ef0 tx=0x7fc50c0095d0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 msgr2=0x7fc524149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc524149380 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc514007f90 tx=0x7fc514001930 comp rx=0 tx=0).stop 2023-12-22T08:41:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 shutdown_connections 2023-12-22T08:41:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc50406a430 0x7fc50406c8f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc5241e00b0 0x7fc52413ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5241498c0 0x7fc5241dfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 --2- 172.21.15.31:0/2909743332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc510003b30 0x7fc524149380 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 >> 172.21.15.31:0/2909743332 conn(0x7fc5240c0340 msgr2=0x7fc52413e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:38.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 shutdown_connections 2023-12-22T08:41:38.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.131+0000 7fc5291ab640 1 -- 172.21.15.31:0/2909743332 wait complete. 2023-12-22T08:41:38.144 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-22T08:41:38.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:38.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-22T08:41:38.259 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-12-22T08:41:38.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:38.260 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T08:41:38.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:38.312 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-12-22T08:41:38.359 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T08:41:38.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:38.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T08:41:38.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T08:41:38.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-12-22T08:41:38.582 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-22T08:41:38.591 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-22T08:41:38.592 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:38.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.698+0000 7fdb9b3ab640 1 Processor -- start 2023-12-22T08:41:38.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.698+0000 7fdb9b3ab640 1 -- start start 2023-12-22T08:41:38.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.698+0000 7fdb9b3ab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9406a6d0 0x7fdb9414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.698+0000 7fdb9b3ab640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdb9414b1f0 0x7fdb940b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.698+0000 7fdb9b3ab640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb940bb310 con 0x7fdb940ba550 2023-12-22T08:41:38.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.698+0000 7fdb9b3ab640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb940bf960 con 0x7fdb9414b1f0 2023-12-22T08:41:38.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.698+0000 7fdb9b3ab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940bb5b0 con 0x7fdb9406a6d0 2023-12-22T08:41:38.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb99948640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdb940ba550 0x7fdb9414e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33594/0 (socket says 172.21.15.31:33594) 2023-12-22T08:41:38.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb99948640 1 -- 172.21.15.31:0/3230089192 learned_addr learned my addr 172.21.15.31:0/3230089192 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:38.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb98946640 1 --2- 172.21.15.31:0/3230089192 >> v2:172.21.15.69:3300/0 conn(0x7fdb9414b1f0 0x7fdb940b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb99147640 1 --2- 172.21.15.31:0/3230089192 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9406a6d0 0x7fdb9414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb8bfff640 1 -- 172.21.15.31:0/3230089192 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421556550 0 0) 0x7fdb940bb310 con 0x7fdb940ba550 2023-12-22T08:41:38.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb8bfff640 1 -- 172.21.15.31:0/3230089192 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb80003520 con 0x7fdb940ba550 2023-12-22T08:41:38.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb99147640 1 -- 172.21.15.31:0/3230089192 >> v2:172.21.15.69:3300/0 conn(0x7fdb9414b1f0 msgr2=0x7fdb940b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:38.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb99147640 1 --2- 172.21.15.31:0/3230089192 >> v2:172.21.15.69:3300/0 conn(0x7fdb9414b1f0 0x7fdb940b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb99147640 1 -- 172.21.15.31:0/3230089192 >> v1:172.21.15.31:6789/0 conn(0x7fdb940ba550 legacy=0x7fdb9414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb8bfff640 1 -- 172.21.15.31:0/3230089192 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1302936324 0 0) 0x7fdb80003520 con 0x7fdb940ba550 2023-12-22T08:41:38.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb99147640 1 -- 172.21.15.31:0/3230089192 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb940c0120 con 0x7fdb9406a6d0 2023-12-22T08:41:38.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.699+0000 7fdb98946640 1 --2- 172.21.15.31:0/3230089192 >> v2:172.21.15.69:3300/0 conn(0x7fdb9414b1f0 0x7fdb940b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:38.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.700+0000 7fdb99147640 1 --2- 172.21.15.31:0/3230089192 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9406a6d0 0x7fdb9414acb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdb900097a0 tx=0x7fdb9002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b22fd341fed6ab server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:38.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.700+0000 7fdb8bfff640 1 -- 172.21.15.31:0/3230089192 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0019f0 con 0x7fdb9406a6d0 2023-12-22T08:41:38.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.700+0000 7fdb8bfff640 1 -- 172.21.15.31:0/3230089192 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9002e050 con 0x7fdb9406a6d0 2023-12-22T08:41:38.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.700+0000 7fdb8bfff640 1 -- 172.21.15.31:0/3230089192 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90030730 con 0x7fdb9406a6d0 2023-12-22T08:41:38.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.701+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/3230089192 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9406a6d0 msgr2=0x7fdb9414acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.701+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/3230089192 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9406a6d0 0x7fdb9414acb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdb900097a0 tx=0x7fdb9002b790 comp rx=0 tx=0).stop 2023-12-22T08:41:38.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.701+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/3230089192 shutdown_connections 2023-12-22T08:41:38.708 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.701+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/3230089192 >> v2:172.21.15.69:3300/0 conn(0x7fdb9414b1f0 0x7fdb940b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.701+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/3230089192 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9406a6d0 0x7fdb9414acb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.701+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/3230089192 >> 172.21.15.31:0/3230089192 conn(0x7fdb940c0350 msgr2=0x7fdb940c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:38.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.701+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/3230089192 shutdown_connections 2023-12-22T08:41:38.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.701+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/3230089192 wait complete. 2023-12-22T08:41:38.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.702+0000 7fdb9b3ab640 1 Processor -- start 2023-12-22T08:41:38.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.702+0000 7fdb9b3ab640 1 -- start start 2023-12-22T08:41:38.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb9b3ab640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9406a6d0 0x7fdb94146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb9b3ab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940ba550 0x7fdb941e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb9b3ab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9414b1f0 0x7fdb9414e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb9b3ab640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb94147180 con 0x7fdb940ba550 2023-12-22T08:41:38.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb9b3ab640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9414cf90 con 0x7fdb9406a6d0 2023-12-22T08:41:38.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb9b3ab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb941e3cf0 con 0x7fdb9414b1f0 2023-12-22T08:41:38.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940ba550 0x7fdb941e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940ba550 0x7fdb941e37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45828/0 (socket says 172.21.15.31:45828) 2023-12-22T08:41:38.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 -- 172.21.15.31:0/179961969 learned_addr learned my addr 172.21.15.31:0/179961969 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:38.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb99147640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9406a6d0 0x7fdb94146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb99948640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9414b1f0 0x7fdb9414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 -- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9414b1f0 msgr2=0x7fdb9414e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9414b1f0 0x7fdb9414e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 -- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9406a6d0 msgr2=0x7fdb94146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9406a6d0 0x7fdb94146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 -- 172.21.15.31:0/179961969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb84009400 con 0x7fdb940ba550 2023-12-22T08:41:38.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb99948640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9414b1f0 0x7fdb9414e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:38.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb98946640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940ba550 0x7fdb941e37b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400e930 tx=0x7fdb8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:38.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb89ffb640 1 -- 172.21.15.31:0/179961969 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84009660 con 0x7fdb940ba550 2023-12-22T08:41:38.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb89ffb640 1 -- 172.21.15.31:0/179961969 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8400c9a0 con 0x7fdb940ba550 2023-12-22T08:41:38.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb90009400 con 0x7fdb940ba550 2023-12-22T08:41:38.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.703+0000 7fdb89ffb640 1 -- 172.21.15.31:0/179961969 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8400cd50 con 0x7fdb940ba550 2023-12-22T08:41:38.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.704+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb941e2d60 con 0x7fdb940ba550 2023-12-22T08:41:38.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.705+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9414eda0 con 0x7fdb940ba550 2023-12-22T08:41:38.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.705+0000 7fdb89ffb640 1 -- 172.21.15.31:0/179961969 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb84013470 con 0x7fdb940ba550 2023-12-22T08:41:38.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.705+0000 7fdb89ffb640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdb7806a430 0x7fdb7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:38.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.705+0000 7fdb89ffb640 1 -- 172.21.15.31:0/179961969 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb84088c60 con 0x7fdb940ba550 2023-12-22T08:41:38.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.706+0000 7fdb99147640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdb7806a430 0x7fdb7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:38.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.706+0000 7fdb99147640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdb7806a430 0x7fdb7806c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb90034000 tx=0x7fdb9002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:38.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.709+0000 7fdb89ffb640 1 -- 172.21.15.31:0/179961969 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdb84054150 con 0x7fdb940ba550 2023-12-22T08:41:38.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.880+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb940bfc00 con 0x7fdb7806a430 2023-12-22T08:41:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.888+0000 7fdb89ffb640 1 -- 172.21.15.31:0/179961969 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270735 (secure 0 0 0) 0x7fdb90030800 con 0x7fdb7806a430 2023-12-22T08:41:38.896 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:38.898 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:41:38.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdb7806a430 msgr2=0x7fdb7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdb7806a430 0x7fdb7806c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb90034000 tx=0x7fdb9002f000 comp rx=0 tx=0).stop 2023-12-22T08:41:38.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940ba550 msgr2=0x7fdb941e37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:38.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940ba550 0x7fdb941e37b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400e930 tx=0x7fdb8400edf0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 shutdown_connections 2023-12-22T08:41:38.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fdb7806a430 0x7fdb7806c8f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb9414b1f0 0x7fdb9414e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940ba550 0x7fdb941e37b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 --2- 172.21.15.31:0/179961969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb9406a6d0 0x7fdb94146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:38.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 >> 172.21.15.31:0/179961969 conn(0x7fdb940c0350 msgr2=0x7fdb940a1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:38.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 shutdown_connections 2023-12-22T08:41:38.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:38.891+0000 7fdb9b3ab640 1 -- 172.21.15.31:0/179961969 wait complete. 2023-12-22T08:41:38.903 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-12-22T08:41:37.796008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592984,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3944,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":4038656,"data_stored":2260064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2616,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002528"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801980+0000","last_change":"2023-12-22T08:41:27.129975+0000","last_active":"2023-12-22T08:41:28.801980+0000","last_peered":"2023-12-22T08:41:28.801980+0000","last_clean":"2023-12-22T08:41:28.801980+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:41:28.801980+0000","last_undegraded":"2023-12-22T08:41:28.801980+0000","last_fullsized":"2023-12-22T08:41:28.801980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:55.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803164+0000","last_change":"2023-12-22T08:41:27.132308+0000","last_active":"2023-12-22T08:41:28.803164+0000","last_peered":"2023-12-22T08:41:28.803164+0000","last_clean":"2023-12-22T08:41:28.803164+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:41:28.803164+0000","last_undegraded":"2023-12-22T08:41:28.803164+0000","last_fullsized":"2023-12-22T08:41:28.803164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111813+0000","last_change":"2023-12-22T08:41:27.117719+0000","last_active":"2023-12-22T08:41:28.111813+0000","last_peered":"2023-12-22T08:41:28.111813+0000","last_clean":"2023-12-22T08:41:28.111813+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:41:28.111813+0000","last_undegraded":"2023-12-22T08:41:28.111813+0000","last_fullsized":"2023-12-22T08:41:28.111813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112687+0000","last_change":"2023-12-22T08:41:27.126330+0000","last_active":"2023-12-22T08:41:28.112687+0000","last_peered":"2023-12-22T08:41:28.112687+0000","last_clean":"2023-12-22T08:41:28.112687+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:41:28.112687+0000","last_undegraded":"2023-12-22T08:41:28.112687+0000","last_fullsized":"2023-12-22T08:41:28.112687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802393+0000","last_change":"2023-12-22T08:41:27.131419+0000","last_active":"2023-12-22T08:41:28.802393+0000","last_peered":"2023-12-22T08:41:28.802393+0000","last_clean":"2023-12-22T08:41:28.802393+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:41:28.802393+0000","last_undegraded":"2023-12-22T08:41:28.802393+0000","last_fullsized":"2023-12-22T08:41:28.802393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.722212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803093+0000","last_change":"2023-12-22T08:41:27.125465+0000","last_active":"2023-12-22T08:41:28.803093+0000","last_peered":"2023-12-22T08:41:28.803093+0000","last_clean":"2023-12-22T08:41:28.803093+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:41:28.803093+0000","last_undegraded":"2023-12-22T08:41:28.803093+0000","last_fullsized":"2023-12-22T08:41:28.803093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807522+0000","last_change":"2023-12-22T08:41:27.127918+0000","last_active":"2023-12-22T08:41:28.807522+0000","last_peered":"2023-12-22T08:41:28.807522+0000","last_clean":"2023-12-22T08:41:28.807522+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:41:28.807522+0000","last_undegraded":"2023-12-22T08:41:28.807522+0000","last_fullsized":"2023-12-22T08:41:28.807522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807397+0000","last_change":"2023-12-22T08:41:27.128397+0000","last_active":"2023-12-22T08:41:28.807397+0000","last_peered":"2023-12-22T08:41:28.807397+0000","last_clean":"2023-12-22T08:41:28.807397+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:41:28.807397+0000","last_undegraded":"2023-12-22T08:41:28.807397+0000","last_fullsized":"2023-12-22T08:41:28.807397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111299+0000","last_change":"2023-12-22T08:41:27.115975+0000","last_active":"2023-12-22T08:41:28.111299+0000","last_peered":"2023-12-22T08:41:28.111299+0000","last_clean":"2023-12-22T08:41:28.111299+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:41:28.111299+0000","last_undegraded":"2023-12-22T08:41:28.111299+0000","last_fullsized":"2023-12-22T08:41:28.111299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112929+0000","last_change":"2023-12-22T08:41:27.133760+0000","last_active":"2023-12-22T08:41:28.112929+0000","last_peered":"2023-12-22T08:41:28.112929+0000","last_clean":"2023-12-22T08:41:28.112929+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:41:28.112929+0000","last_undegraded":"2023-12-22T08:41:28.112929+0000","last_fullsized":"2023-12-22T08:41:28.112929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807594+0000","last_change":"2023-12-22T08:41:27.121357+0000","last_active":"2023-12-22T08:41:28.807594+0000","last_peered":"2023-12-22T08:41:28.807594+0000","last_clean":"2023-12-22T08:41:28.807594+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:41:28.807594+0000","last_undegraded":"2023-12-22T08:41:28.807594+0000","last_fullsized":"2023-12-22T08:41:28.807594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111645+0000","last_change":"2023-12-22T08:41:27.131986+0000","last_active":"2023-12-22T08:41:28.111645+0000","last_peered":"2023-12-22T08:41:28.111645+0000","last_clean":"2023-12-22T08:41:28.111645+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:41:28.111645+0000","last_undegraded":"2023-12-22T08:41:28.111645+0000","last_fullsized":"2023-12-22T08:41:28.111645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802404+0000","last_change":"2023-12-22T08:41:27.120741+0000","last_active":"2023-12-22T08:41:28.802404+0000","last_peered":"2023-12-22T08:41:28.802404+0000","last_clean":"2023-12-22T08:41:28.802404+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:28.802404+0000","last_undegraded":"2023-12-22T08:41:28.802404+0000","last_fullsized":"2023-12-22T08:41:28.802404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:46.823109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803102+0000","last_change":"2023-12-22T08:41:27.127642+0000","last_active":"2023-12-22T08:41:28.803102+0000","last_peered":"2023-12-22T08:41:28.803102+0000","last_clean":"2023-12-22T08:41:28.803102+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:28.803102+0000","last_undegraded":"2023-12-22T08:41:28.803102+0000","last_fullsized":"2023-12-22T08:41:28.803102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111013+0000","last_change":"2023-12-22T08:41:27.124240+0000","last_active":"2023-12-22T08:41:28.111013+0000","last_peered":"2023-12-22T08:41:28.111013+0000","last_clean":"2023-12-22T08:41:28.111013+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:28.111013+0000","last_undegraded":"2023-12-22T08:41:28.111013+0000","last_fullsized":"2023-12-22T08:41:28.111013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807472+0000","last_change":"2023-12-22T08:41:27.131917+0000","last_active":"2023-12-22T08:41:28.807472+0000","last_peered":"2023-12-22T08:41:28.807472+0000","last_clean":"2023-12-22T08:41:28.807472+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:41:28.807472+0000","last_undegraded":"2023-12-22T08:41:28.807472+0000","last_fullsized":"2023-12-22T08:41:28.807472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807612+0000","last_change":"2023-12-22T08:41:27.126772+0000","last_active":"2023-12-22T08:41:28.807612+0000","last_peered":"2023-12-22T08:41:28.807612+0000","last_clean":"2023-12-22T08:41:28.807612+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:28.807612+0000","last_undegraded":"2023-12-22T08:41:28.807612+0000","last_fullsized":"2023-12-22T08:41:28.807612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803173+0000","last_change":"2023-12-22T08:41:27.132073+0000","last_active":"2023-12-22T08:41:28.803173+0000","last_peered":"2023-12-22T08:41:28.803173+0000","last_clean":"2023-12-22T08:41:28.803173+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:41:28.803173+0000","last_undegraded":"2023-12-22T08:41:28.803173+0000","last_fullsized":"2023-12-22T08:41:28.803173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803140+0000","last_change":"2023-12-22T08:41:27.128462+0000","last_active":"2023-12-22T08:41:28.803140+0000","last_peered":"2023-12-22T08:41:28.803140+0000","last_clean":"2023-12-22T08:41:28.803140+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:41:28.803140+0000","last_undegraded":"2023-12-22T08:41:28.803140+0000","last_fullsized":"2023-12-22T08:41:28.803140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802424+0000","last_change":"2023-12-22T08:41:27.124709+0000","last_active":"2023-12-22T08:41:28.802424+0000","last_peered":"2023-12-22T08:41:28.802424+0000","last_clean":"2023-12-22T08:41:28.802424+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:28.802424+0000","last_undegraded":"2023-12-22T08:41:28.802424+0000","last_fullsized":"2023-12-22T08:41:28.802424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:26.745936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111759+0000","last_change":"2023-12-22T08:41:27.120855+0000","last_active":"2023-12-22T08:41:28.111759+0000","last_peered":"2023-12-22T08:41:28.111759+0000","last_clean":"2023-12-22T08:41:28.111759+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:41:28.111759+0000","last_undegraded":"2023-12-22T08:41:28.111759+0000","last_fullsized":"2023-12-22T08:41:28.111759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:04.575089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111532+0000","last_change":"2023-12-22T08:41:27.129305+0000","last_active":"2023-12-22T08:41:28.111532+0000","last_peered":"2023-12-22T08:41:28.111532+0000","last_clean":"2023-12-22T08:41:28.111532+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:41:28.111532+0000","last_undegraded":"2023-12-22T08:41:28.111532+0000","last_fullsized":"2023-12-22T08:41:28.111532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801633+0000","last_change":"2023-12-22T08:41:27.123800+0000","last_active":"2023-12-22T08:41:28.801633+0000","last_peered":"2023-12-22T08:41:28.801633+0000","last_clean":"2023-12-22T08:41:28.801633+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:28.801633+0000","last_undegraded":"2023-12-22T08:41:28.801633+0000","last_fullsized":"2023-12-22T08:41:28.801633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110929+0000","last_change":"2023-12-22T08:41:27.114600+0000","last_active":"2023-12-22T08:41:28.110929+0000","last_peered":"2023-12-22T08:41:28.110929+0000","last_clean":"2023-12-22T08:41:28.110929+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:41:28.110929+0000","last_undegraded":"2023-12-22T08:41:28.110929+0000","last_fullsized":"2023-12-22T08:41:28.110929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113130+0000","last_change":"2023-12-22T08:41:27.121608+0000","last_active":"2023-12-22T08:41:28.113130+0000","last_peered":"2023-12-22T08:41:28.113130+0000","last_clean":"2023-12-22T08:41:28.113130+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:41:28.113130+0000","last_undegraded":"2023-12-22T08:41:28.113130+0000","last_fullsized":"2023-12-22T08:41:28.113130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803181+0000","last_change":"2023-12-22T08:41:27.131698+0000","last_active":"2023-12-22T08:41:28.803181+0000","last_peered":"2023-12-22T08:41:28.803181+0000","last_clean":"2023-12-22T08:41:28.803181+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:41:28.803181+0000","last_undegraded":"2023-12-22T08:41:28.803181+0000","last_fullsized":"2023-12-22T08:41:28.803181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113081+0000","last_change":"2023-12-22T08:41:27.121328+0000","last_active":"2023-12-22T08:41:28.113081+0000","last_peered":"2023-12-22T08:41:28.113081+0000","last_clean":"2023-12-22T08:41:28.113081+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:41:28.113081+0000","last_undegraded":"2023-12-22T08:41:28.113081+0000","last_fullsized":"2023-12-22T08:41:28.113081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111750+0000","last_change":"2023-12-22T08:41:27.117153+0000","last_active":"2023-12-22T08:41:28.111750+0000","last_peered":"2023-12-22T08:41:28.111750+0000","last_clean":"2023-12-22T08:41:28.111750+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:28.111750+0000","last_undegraded":"2023-12-22T08:41:28.111750+0000","last_fullsized":"2023-12-22T08:41:28.111750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111857+0000","last_change":"2023-12-22T08:41:27.128755+0000","last_active":"2023-12-22T08:41:28.111857+0000","last_peered":"2023-12-22T08:41:28.111857+0000","last_clean":"2023-12-22T08:41:28.111857+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:41:28.111857+0000","last_undegraded":"2023-12-22T08:41:28.111857+0000","last_fullsized":"2023-12-22T08:41:28.111857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807539+0000","last_change":"2023-12-22T08:41:27.126203+0000","last_active":"2023-12-22T08:41:28.807539+0000","last_peered":"2023-12-22T08:41:28.807539+0000","last_clean":"2023-12-22T08:41:28.807539+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:41:28.807539+0000","last_undegraded":"2023-12-22T08:41:28.807539+0000","last_fullsized":"2023-12-22T08:41:28.807539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801882+0000","last_change":"2023-12-22T08:41:27.127519+0000","last_active":"2023-12-22T08:41:28.801882+0000","last_peered":"2023-12-22T08:41:28.801882+0000","last_clean":"2023-12-22T08:41:28.801882+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:41:28.801882+0000","last_undegraded":"2023-12-22T08:41:28.801882+0000","last_fullsized":"2023-12-22T08:41:28.801882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:50.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807417+0000","last_change":"2023-12-22T08:41:27.122823+0000","last_active":"2023-12-22T08:41:28.807417+0000","last_peered":"2023-12-22T08:41:28.807417+0000","last_clean":"2023-12-22T08:41:28.807417+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:41:28.807417+0000","last_undegraded":"2023-12-22T08:41:28.807417+0000","last_fullsized":"2023-12-22T08:41:28.807417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801686+0000","last_change":"2023-12-22T08:41:27.121742+0000","last_active":"2023-12-22T08:41:28.801686+0000","last_peered":"2023-12-22T08:41:28.801686+0000","last_clean":"2023-12-22T08:41:28.801686+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:28.801686+0000","last_undegraded":"2023-12-22T08:41:28.801686+0000","last_fullsized":"2023-12-22T08:41:28.801686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802016+0000","last_change":"2023-12-22T08:41:26.742786+0000","last_active":"2023-12-22T08:41:28.802016+0000","last_peered":"2023-12-22T08:41:28.802016+0000","last_clean":"2023-12-22T08:41:28.802016+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:28.802016+0000","last_undegraded":"2023-12-22T08:41:28.802016+0000","last_fullsized":"2023-12-22T08:41:28.802016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801996+0000","last_change":"2023-12-22T08:41:27.130511+0000","last_active":"2023-12-22T08:41:28.801996+0000","last_peered":"2023-12-22T08:41:28.801996+0000","last_clean":"2023-12-22T08:41:28.801996+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:41:28.801996+0000","last_undegraded":"2023-12-22T08:41:28.801996+0000","last_fullsized":"2023-12-22T08:41:28.801996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:18.765379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801698+0000","last_change":"2023-12-22T08:41:26.743569+0000","last_active":"2023-12-22T08:41:28.801698+0000","last_peered":"2023-12-22T08:41:28.801698+0000","last_clean":"2023-12-22T08:41:28.801698+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:28.801698+0000","last_undegraded":"2023-12-22T08:41:28.801698+0000","last_fullsized":"2023-12-22T08:41:28.801698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111545+0000","last_change":"2023-12-22T08:41:27.128744+0000","last_active":"2023-12-22T08:41:28.111545+0000","last_peered":"2023-12-22T08:41:28.111545+0000","last_clean":"2023-12-22T08:41:28.111545+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:41:28.111545+0000","last_undegraded":"2023-12-22T08:41:28.111545+0000","last_fullsized":"2023-12-22T08:41:28.111545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803153+0000","last_change":"2023-12-22T08:41:26.747403+0000","last_active":"2023-12-22T08:41:28.803153+0000","last_peered":"2023-12-22T08:41:28.803153+0000","last_clean":"2023-12-22T08:41:28.803153+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:28.803153+0000","last_undegraded":"2023-12-22T08:41:28.803153+0000","last_fullsized":"2023-12-22T08:41:28.803153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:17.763510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113171+0000","last_change":"2023-12-22T08:41:27.121058+0000","last_active":"2023-12-22T08:41:28.113171+0000","last_peered":"2023-12-22T08:41:28.113171+0000","last_clean":"2023-12-22T08:41:28.113171+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:41:28.113171+0000","last_undegraded":"2023-12-22T08:41:28.113171+0000","last_fullsized":"2023-12-22T08:41:28.113171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802433+0000","last_change":"2023-12-22T08:41:26.747241+0000","last_active":"2023-12-22T08:41:28.802433+0000","last_peered":"2023-12-22T08:41:28.802433+0000","last_clean":"2023-12-22T08:41:28.802433+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:28.802433+0000","last_undegraded":"2023-12-22T08:41:28.802433+0000","last_fullsized":"2023-12-22T08:41:28.802433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:52.257765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807557+0000","last_change":"2023-12-22T08:41:27.123533+0000","last_active":"2023-12-22T08:41:28.807557+0000","last_peered":"2023-12-22T08:41:28.807557+0000","last_clean":"2023-12-22T08:41:28.807557+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:41:28.807557+0000","last_undegraded":"2023-12-22T08:41:28.807557+0000","last_fullsized":"2023-12-22T08:41:28.807557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111846+0000","last_change":"2023-12-22T08:41:26.750084+0000","last_active":"2023-12-22T08:41:28.111846+0000","last_peered":"2023-12-22T08:41:28.111846+0000","last_clean":"2023-12-22T08:41:28.111846+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:41:28.111846+0000","last_undegraded":"2023-12-22T08:41:28.111846+0000","last_fullsized":"2023-12-22T08:41:28.111846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111151+0000","last_change":"2023-12-22T08:41:27.125421+0000","last_active":"2023-12-22T08:41:28.111151+0000","last_peered":"2023-12-22T08:41:28.111151+0000","last_clean":"2023-12-22T08:41:28.111151+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:41:28.111151+0000","last_undegraded":"2023-12-22T08:41:28.111151+0000","last_fullsized":"2023-12-22T08:41:28.111151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:39.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111620+0000","last_change":"2023-12-22T08:41:26.743416+0000","last_active":"2023-12-22T08:41:28.111620+0000","last_peered":"2023-12-22T08:41:28.111620+0000","last_clean":"2023-12-22T08:41:28.111620+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:41:28.111620+0000","last_undegraded":"2023-12-22T08:41:28.111620+0000","last_fullsized":"2023-12-22T08:41:28.111620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:42.994044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111016+0000","last_change":"2023-12-22T08:41:27.123904+0000","last_active":"2023-12-22T08:41:28.111016+0000","last_peered":"2023-12-22T08:41:28.111016+0000","last_clean":"2023-12-22T08:41:28.111016+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:41:28.111016+0000","last_undegraded":"2023-12-22T08:41:28.111016+0000","last_fullsized":"2023-12-22T08:41:28.111016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803073+0000","last_change":"2023-12-22T08:41:26.745648+0000","last_active":"2023-12-22T08:41:28.803073+0000","last_peered":"2023-12-22T08:41:28.803073+0000","last_clean":"2023-12-22T08:41:28.803073+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:41:28.803073+0000","last_undegraded":"2023-12-22T08:41:28.803073+0000","last_fullsized":"2023-12-22T08:41:28.803073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112566+0000","last_change":"2023-12-22T08:41:27.126166+0000","last_active":"2023-12-22T08:41:28.112566+0000","last_peered":"2023-12-22T08:41:28.112566+0000","last_clean":"2023-12-22T08:41:28.112566+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:28.112566+0000","last_undegraded":"2023-12-22T08:41:28.112566+0000","last_fullsized":"2023-12-22T08:41:28.112566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111017+0000","last_change":"2023-12-22T08:41:26.739716+0000","last_active":"2023-12-22T08:41:28.111017+0000","last_peered":"2023-12-22T08:41:28.111017+0000","last_clean":"2023-12-22T08:41:28.111017+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:28.111017+0000","last_undegraded":"2023-12-22T08:41:28.111017+0000","last_fullsized":"2023-12-22T08:41:28.111017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:25.744068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111505+0000","last_change":"2023-12-22T08:41:27.133504+0000","last_active":"2023-12-22T08:41:28.111505+0000","last_peered":"2023-12-22T08:41:28.111505+0000","last_clean":"2023-12-22T08:41:28.111505+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:41:28.111505+0000","last_undegraded":"2023-12-22T08:41:28.111505+0000","last_fullsized":"2023-12-22T08:41:28.111505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803207+0000","last_change":"2023-12-22T08:41:26.743175+0000","last_active":"2023-12-22T08:41:28.803207+0000","last_peered":"2023-12-22T08:41:28.803207+0000","last_clean":"2023-12-22T08:41:28.803207+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:28.803207+0000","last_undegraded":"2023-12-22T08:41:28.803207+0000","last_fullsized":"2023-12-22T08:41:28.803207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:03.573220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803190+0000","last_change":"2023-12-22T08:41:27.129547+0000","last_active":"2023-12-22T08:41:28.803190+0000","last_peered":"2023-12-22T08:41:28.803190+0000","last_clean":"2023-12-22T08:41:28.803190+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:41:28.803190+0000","last_undegraded":"2023-12-22T08:41:28.803190+0000","last_fullsized":"2023-12-22T08:41:28.803190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801721+0000","last_change":"2023-12-22T08:41:26.743757+0000","last_active":"2023-12-22T08:41:28.801721+0000","last_peered":"2023-12-22T08:41:28.801721+0000","last_clean":"2023-12-22T08:41:28.801721+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:28.801721+0000","last_undegraded":"2023-12-22T08:41:28.801721+0000","last_fullsized":"2023-12-22T08:41:28.801721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803120+0000","last_change":"2023-12-22T08:41:27.131773+0000","last_active":"2023-12-22T08:41:28.803120+0000","last_peered":"2023-12-22T08:41:28.803120+0000","last_clean":"2023-12-22T08:41:28.803120+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:41:28.803120+0000","last_undegraded":"2023-12-22T08:41:28.803120+0000","last_fullsized":"2023-12-22T08:41:28.803120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111905+0000","last_change":"2023-12-22T08:41:26.745597+0000","last_active":"2023-12-22T08:41:28.111905+0000","last_peered":"2023-12-22T08:41:28.111905+0000","last_clean":"2023-12-22T08:41:28.111905+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:28.111905+0000","last_undegraded":"2023-12-22T08:41:28.111905+0000","last_fullsized":"2023-12-22T08:41:28.111905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111718+0000","last_change":"2023-12-22T08:41:27.118227+0000","last_active":"2023-12-22T08:41:28.111718+0000","last_peered":"2023-12-22T08:41:28.111718+0000","last_clean":"2023-12-22T08:41:28.111718+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:41:28.111718+0000","last_undegraded":"2023-12-22T08:41:28.111718+0000","last_fullsized":"2023-12-22T08:41:28.111718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'7","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880717+0000","last_change":"2023-12-22T08:41:26.748072+0000","last_active":"2023-12-22T08:41:28.880717+0000","last_peered":"2023-12-22T08:41:28.880717+0000","last_clean":"2023-12-22T08:41:28.880717+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:28.880717+0000","last_undegraded":"2023-12-22T08:41:28.880717+0000","last_fullsized":"2023-12-22T08:41:28.880717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:05.371284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1818,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112579+0000","last_change":"2023-12-22T08:41:27.120378+0000","last_active":"2023-12-22T08:41:28.112579+0000","last_peered":"2023-12-22T08:41:28.112579+0000","last_clean":"2023-12-22T08:41:28.112579+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:28.112579+0000","last_undegraded":"2023-12-22T08:41:28.112579+0000","last_fullsized":"2023-12-22T08:41:28.112579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111924+0000","last_change":"2023-12-22T08:41:26.740501+0000","last_active":"2023-12-22T08:41:28.111924+0000","last_peered":"2023-12-22T08:41:28.111924+0000","last_clean":"2023-12-22T08:41:28.111924+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:28.111924+0000","last_undegraded":"2023-12-22T08:41:28.111924+0000","last_fullsized":"2023-12-22T08:41:28.111924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803112+0000","last_change":"2023-12-22T08:41:27.127482+0000","last_active":"2023-12-22T08:41:28.803112+0000","last_peered":"2023-12-22T08:41:28.803112+0000","last_clean":"2023-12-22T08:41:28.803112+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:41:28.803112+0000","last_undegraded":"2023-12-22T08:41:28.803112+0000","last_fullsized":"2023-12-22T08:41:28.803112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112604+0000","last_change":"2023-12-22T08:41:26.746743+0000","last_active":"2023-12-22T08:41:28.112604+0000","last_peered":"2023-12-22T08:41:28.112604+0000","last_clean":"2023-12-22T08:41:28.112604+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:28.112604+0000","last_undegraded":"2023-12-22T08:41:28.112604+0000","last_fullsized":"2023-12-22T08:41:28.112604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807455+0000","last_change":"2023-12-22T08:41:27.123864+0000","last_active":"2023-12-22T08:41:28.807455+0000","last_peered":"2023-12-22T08:41:28.807455+0000","last_clean":"2023-12-22T08:41:28.807455+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:41:28.807455+0000","last_undegraded":"2023-12-22T08:41:28.807455+0000","last_fullsized":"2023-12-22T08:41:28.807455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803082+0000","last_change":"2023-12-22T08:41:26.742515+0000","last_active":"2023-12-22T08:41:28.803082+0000","last_peered":"2023-12-22T08:41:28.803082+0000","last_clean":"2023-12-22T08:41:28.803082+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:28.803082+0000","last_undegraded":"2023-12-22T08:41:28.803082+0000","last_fullsized":"2023-12-22T08:41:28.803082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:32.527496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801907+0000","last_change":"2023-12-22T08:41:27.122673+0000","last_active":"2023-12-22T08:41:28.801907+0000","last_peered":"2023-12-22T08:41:28.801907+0000","last_clean":"2023-12-22T08:41:28.801907+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:41:28.801907+0000","last_undegraded":"2023-12-22T08:41:28.801907+0000","last_fullsized":"2023-12-22T08:41:28.801907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:06.373152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803052+0000","last_change":"2023-12-22T08:41:26.748785+0000","last_active":"2023-12-22T08:41:28.803052+0000","last_peered":"2023-12-22T08:41:28.803052+0000","last_clean":"2023-12-22T08:41:28.803052+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:41:28.803052+0000","last_undegraded":"2023-12-22T08:41:28.803052+0000","last_fullsized":"2023-12-22T08:41:28.803052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111273+0000","last_change":"2023-12-22T08:41:27.118299+0000","last_active":"2023-12-22T08:41:28.111273+0000","last_peered":"2023-12-22T08:41:28.111273+0000","last_clean":"2023-12-22T08:41:28.111273+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:41:28.111273+0000","last_undegraded":"2023-12-22T08:41:28.111273+0000","last_fullsized":"2023-12-22T08:41:28.111273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113208+0000","last_change":"2023-12-22T08:41:26.751813+0000","last_active":"2023-12-22T08:41:28.113208+0000","last_peered":"2023-12-22T08:41:28.113208+0000","last_clean":"2023-12-22T08:41:28.113208+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:28.113208+0000","last_undegraded":"2023-12-22T08:41:28.113208+0000","last_fullsized":"2023-12-22T08:41:28.113208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111455+0000","last_change":"2023-12-22T08:41:27.122998+0000","last_active":"2023-12-22T08:41:28.111455+0000","last_peered":"2023-12-22T08:41:28.111455+0000","last_clean":"2023-12-22T08:41:28.111455+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:41:28.111455+0000","last_undegraded":"2023-12-22T08:41:28.111455+0000","last_fullsized":"2023-12-22T08:41:28.111455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111193+0000","last_change":"2023-12-22T08:41:26.740945+0000","last_active":"2023-12-22T08:41:28.111193+0000","last_peered":"2023-12-22T08:41:28.111193+0000","last_clean":"2023-12-22T08:41:28.111193+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:41:28.111193+0000","last_undegraded":"2023-12-22T08:41:28.111193+0000","last_fullsized":"2023-12-22T08:41:28.111193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112745+0000","last_change":"2023-12-22T08:41:27.125917+0000","last_active":"2023-12-22T08:41:28.112745+0000","last_peered":"2023-12-22T08:41:28.112745+0000","last_clean":"2023-12-22T08:41:28.112745+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:41:28.112745+0000","last_undegraded":"2023-12-22T08:41:28.112745+0000","last_fullsized":"2023-12-22T08:41:28.112745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111940+0000","last_change":"2023-12-22T08:41:26.743117+0000","last_active":"2023-12-22T08:41:28.111940+0000","last_peered":"2023-12-22T08:41:28.111940+0000","last_clean":"2023-12-22T08:41:28.111940+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:41:28.111940+0000","last_undegraded":"2023-12-22T08:41:28.111940+0000","last_fullsized":"2023-12-22T08:41:28.111940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802452+0000","last_change":"2023-12-22T08:41:27.125969+0000","last_active":"2023-12-22T08:41:28.802452+0000","last_peered":"2023-12-22T08:41:28.802452+0000","last_clean":"2023-12-22T08:41:28.802452+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:28.802452+0000","last_undegraded":"2023-12-22T08:41:28.802452+0000","last_fullsized":"2023-12-22T08:41:28.802452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:34.167113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111633+0000","last_change":"2023-12-22T08:41:26.744095+0000","last_active":"2023-12-22T08:41:28.111633+0000","last_peered":"2023-12-22T08:41:28.111633+0000","last_clean":"2023-12-22T08:41:28.111633+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:41:28.111633+0000","last_undegraded":"2023-12-22T08:41:28.111633+0000","last_fullsized":"2023-12-22T08:41:28.111633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:11.707505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802382+0000","last_change":"2023-12-22T08:41:27.125387+0000","last_active":"2023-12-22T08:41:28.802382+0000","last_peered":"2023-12-22T08:41:28.802382+0000","last_clean":"2023-12-22T08:41:28.802382+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:28.802382+0000","last_undegraded":"2023-12-22T08:41:28.802382+0000","last_fullsized":"2023-12-22T08:41:28.802382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:31.788205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801658+0000","last_change":"2023-12-22T08:41:26.747215+0000","last_active":"2023-12-22T08:41:28.801658+0000","last_peered":"2023-12-22T08:41:28.801658+0000","last_clean":"2023-12-22T08:41:28.801658+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:28.801658+0000","last_undegraded":"2023-12-22T08:41:28.801658+0000","last_fullsized":"2023-12-22T08:41:28.801658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802415+0000","last_change":"2023-12-22T08:41:27.122152+0000","last_active":"2023-12-22T08:41:28.802415+0000","last_peered":"2023-12-22T08:41:28.802415+0000","last_clean":"2023-12-22T08:41:28.802415+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:28.802415+0000","last_undegraded":"2023-12-22T08:41:28.802415+0000","last_fullsized":"2023-12-22T08:41:28.802415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.709373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801943+0000","last_change":"2023-12-22T08:41:26.746895+0000","last_active":"2023-12-22T08:41:28.801943+0000","last_peered":"2023-12-22T08:41:28.801943+0000","last_clean":"2023-12-22T08:41:28.801943+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:28.801943+0000","last_undegraded":"2023-12-22T08:41:28.801943+0000","last_fullsized":"2023-12-22T08:41:28.801943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802368+0000","last_change":"2023-12-22T08:41:27.121179+0000","last_active":"2023-12-22T08:41:28.802368+0000","last_peered":"2023-12-22T08:41:28.802368+0000","last_clean":"2023-12-22T08:41:28.802368+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:28.802368+0000","last_undegraded":"2023-12-22T08:41:28.802368+0000","last_fullsized":"2023-12-22T08:41:28.802368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:53.573498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111334+0000","last_change":"2023-12-22T08:41:26.744242+0000","last_active":"2023-12-22T08:41:28.111334+0000","last_peered":"2023-12-22T08:41:28.111334+0000","last_clean":"2023-12-22T08:41:28.111334+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:28.111334+0000","last_undegraded":"2023-12-22T08:41:28.111334+0000","last_fullsized":"2023-12-22T08:41:28.111334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807504+0000","last_change":"2023-12-22T08:41:27.125910+0000","last_active":"2023-12-22T08:41:28.807504+0000","last_peered":"2023-12-22T08:41:28.807504+0000","last_clean":"2023-12-22T08:41:28.807504+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:41:28.807504+0000","last_undegraded":"2023-12-22T08:41:28.807504+0000","last_fullsized":"2023-12-22T08:41:28.807504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110836+0000","last_change":"2023-12-22T08:41:26.747152+0000","last_active":"2023-12-22T08:41:28.110836+0000","last_peered":"2023-12-22T08:41:28.110836+0000","last_clean":"2023-12-22T08:41:28.110836+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:28.110836+0000","last_undegraded":"2023-12-22T08:41:28.110836+0000","last_fullsized":"2023-12-22T08:41:28.110836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802474+0000","last_change":"2023-12-22T08:41:27.122069+0000","last_active":"2023-12-22T08:41:28.802474+0000","last_peered":"2023-12-22T08:41:28.802474+0000","last_clean":"2023-12-22T08:41:28.802474+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:28.802474+0000","last_undegraded":"2023-12-22T08:41:28.802474+0000","last_fullsized":"2023-12-22T08:41:28.802474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:04.235137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113220+0000","last_change":"2023-12-22T08:41:26.748464+0000","last_active":"2023-12-22T08:41:28.113220+0000","last_peered":"2023-12-22T08:41:28.113220+0000","last_clean":"2023-12-22T08:41:28.113220+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:28.113220+0000","last_undegraded":"2023-12-22T08:41:28.113220+0000","last_fullsized":"2023-12-22T08:41:28.113220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111578+0000","last_change":"2023-12-22T08:41:27.117970+0000","last_active":"2023-12-22T08:41:28.111578+0000","last_peered":"2023-12-22T08:41:28.111578+0000","last_clean":"2023-12-22T08:41:28.111578+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:41:28.111578+0000","last_undegraded":"2023-12-22T08:41:28.111578+0000","last_fullsized":"2023-12-22T08:41:28.111578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.885010+0000","last_change":"2023-12-22T08:41:26.744425+0000","last_active":"2023-12-22T08:41:29.885010+0000","last_peered":"2023-12-22T08:41:29.885010+0000","last_clean":"2023-12-22T08:41:29.885010+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:29.885010+0000","last_undegraded":"2023-12-22T08:41:29.885010+0000","last_fullsized":"2023-12-22T08:41:29.885010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:17.007353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801677+0000","last_change":"2023-12-22T08:41:27.121596+0000","last_active":"2023-12-22T08:41:28.801677+0000","last_peered":"2023-12-22T08:41:28.801677+0000","last_clean":"2023-12-22T08:41:28.801677+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:28.801677+0000","last_undegraded":"2023-12-22T08:41:28.801677+0000","last_fullsized":"2023-12-22T08:41:28.801677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112784+0000","last_change":"2023-12-22T08:41:26.748558+0000","last_active":"2023-12-22T08:41:28.112784+0000","last_peered":"2023-12-22T08:41:28.112784+0000","last_clean":"2023-12-22T08:41:28.112784+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:28.112784+0000","last_undegraded":"2023-12-22T08:41:28.112784+0000","last_fullsized":"2023-12-22T08:41:28.112784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801927+0000","last_change":"2023-12-22T08:41:27.124314+0000","last_active":"2023-12-22T08:41:28.801927+0000","last_peered":"2023-12-22T08:41:28.801927+0000","last_clean":"2023-12-22T08:41:28.801927+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:28.801927+0000","last_undegraded":"2023-12-22T08:41:28.801927+0000","last_fullsized":"2023-12-22T08:41:28.801927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:18.009221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801668+0000","last_change":"2023-12-22T08:41:26.740301+0000","last_active":"2023-12-22T08:41:28.801668+0000","last_peered":"2023-12-22T08:41:28.801668+0000","last_clean":"2023-12-22T08:41:28.801668+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:28.801668+0000","last_undegraded":"2023-12-22T08:41:28.801668+0000","last_fullsized":"2023-12-22T08:41:28.801668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801647+0000","last_change":"2023-12-22T08:41:27.121048+0000","last_active":"2023-12-22T08:41:28.801647+0000","last_peered":"2023-12-22T08:41:28.801647+0000","last_clean":"2023-12-22T08:41:28.801647+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:28.801647+0000","last_undegraded":"2023-12-22T08:41:28.801647+0000","last_fullsized":"2023-12-22T08:41:28.801647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112660+0000","last_change":"2023-12-22T08:41:26.747176+0000","last_active":"2023-12-22T08:41:28.112660+0000","last_peered":"2023-12-22T08:41:28.112660+0000","last_clean":"2023-12-22T08:41:28.112660+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:28.112660+0000","last_undegraded":"2023-12-22T08:41:28.112660+0000","last_fullsized":"2023-12-22T08:41:28.112660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803023+0000","last_change":"2023-12-22T08:41:27.122915+0000","last_active":"2023-12-22T08:41:28.803023+0000","last_peered":"2023-12-22T08:41:28.803023+0000","last_clean":"2023-12-22T08:41:28.803023+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:41:28.803023+0000","last_undegraded":"2023-12-22T08:41:28.803023+0000","last_fullsized":"2023-12-22T08:41:28.803023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:27.533832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111422+0000","last_change":"2023-12-22T08:41:26.739638+0000","last_active":"2023-12-22T08:41:28.111422+0000","last_peered":"2023-12-22T08:41:28.111422+0000","last_clean":"2023-12-22T08:41:28.111422+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:28.111422+0000","last_undegraded":"2023-12-22T08:41:28.111422+0000","last_fullsized":"2023-12-22T08:41:28.111422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:03.233269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111243+0000","last_change":"2023-12-22T08:41:27.131013+0000","last_active":"2023-12-22T08:41:28.111243+0000","last_peered":"2023-12-22T08:41:28.111243+0000","last_clean":"2023-12-22T08:41:28.111243+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:41:28.111243+0000","last_undegraded":"2023-12-22T08:41:28.111243+0000","last_fullsized":"2023-12-22T08:41:28.111243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803063+0000","last_change":"2023-12-22T08:41:26.745042+0000","last_active":"2023-12-22T08:41:28.803063+0000","last_peered":"2023-12-22T08:41:28.803063+0000","last_clean":"2023-12-22T08:41:28.803063+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:28.803063+0000","last_undegraded":"2023-12-22T08:41:28.803063+0000","last_fullsized":"2023-12-22T08:41:28.803063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807574+0000","last_change":"2023-12-22T08:41:27.128761+0000","last_active":"2023-12-22T08:41:28.807574+0000","last_peered":"2023-12-22T08:41:28.807574+0000","last_clean":"2023-12-22T08:41:28.807574+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:28.807574+0000","last_undegraded":"2023-12-22T08:41:28.807574+0000","last_fullsized":"2023-12-22T08:41:28.807574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801962+0000","last_change":"2023-12-22T08:41:26.742603+0000","last_active":"2023-12-22T08:41:28.801962+0000","last_peered":"2023-12-22T08:41:28.801962+0000","last_clean":"2023-12-22T08:41:28.801962+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:28.801962+0000","last_undegraded":"2023-12-22T08:41:28.801962+0000","last_fullsized":"2023-12-22T08:41:28.801962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.117407+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:41:27.117407+0000","last_peered":"2023-12-22T08:41:27.117407+0000","last_clean":"2023-12-22T08:41:27.117407+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:27.117407+0000","last_undegraded":"2023-12-22T08:41:27.117407+0000","last_fullsized":"2023-12-22T08:41:27.117407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2616,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":136102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":136102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.377},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.31}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.433},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.75800000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:41:38.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.048+0000 7f07a4838640 1 Processor -- start 2023-12-22T08:41:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.048+0000 7f07a4838640 1 -- start start 2023-12-22T08:41:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f07a4838640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f07a006a390 0x7f07a0070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f07a4838640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07a00b2ed0 0x7f07a01480e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f07a4838640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a0071c80 con 0x7f07a0141680 2023-12-22T08:41:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f07a4838640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a00715e0 con 0x7f07a00b2ed0 2023-12-22T08:41:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f07a4838640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a00718c0 con 0x7f07a006a390 2023-12-22T08:41:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f0797fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07a00b2ed0 0x7f07a01480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f0797fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07a00b2ed0 0x7f07a01480e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45832/0 (socket says 172.21.15.31:45832) 2023-12-22T08:41:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f0797fff640 1 -- 172.21.15.31:0/528543156 learned_addr learned my addr 172.21.15.31:0/528543156 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f0797fff640 1 -- 172.21.15.31:0/528543156 >> v2:172.21.15.69:3300/0 conn(0x7f07a006a390 msgr2=0x7f07a0070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f0797fff640 1 --2- 172.21.15.31:0/528543156 >> v2:172.21.15.69:3300/0 conn(0x7f07a006a390 0x7f07a0070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f0797fff640 1 -- 172.21.15.31:0/528543156 >> v1:172.21.15.69:6789/0 conn(0x7f07a0141680 legacy=0x7f07a014adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.049+0000 7f0797fff640 1 -- 172.21.15.31:0/528543156 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a01478e0 con 0x7f07a00b2ed0 2023-12-22T08:41:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f0797fff640 1 --2- 172.21.15.31:0/528543156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b2ed0 0x7f07a01480e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f07a00b8150 tx=0x7f078802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6d9289e9acbe8b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f079dd9b640 1 -- 172.21.15.31:0/528543156 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788031870 con 0x7f07a00b2ed0 2023-12-22T08:41:39.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f079dd9b640 1 -- 172.21.15.31:0/528543156 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880319d0 con 0x7f07a00b2ed0 2023-12-22T08:41:39.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f079dd9b640 1 -- 172.21.15.31:0/528543156 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788031d60 con 0x7f07a00b2ed0 2023-12-22T08:41:39.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f07a4838640 1 -- 172.21.15.31:0/528543156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b2ed0 msgr2=0x7f07a01480e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f07a4838640 1 --2- 172.21.15.31:0/528543156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b2ed0 0x7f07a01480e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f07a00b8150 tx=0x7f078802b910 comp rx=0 tx=0).stop 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f07a4838640 1 -- 172.21.15.31:0/528543156 shutdown_connections 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f07a4838640 1 --2- 172.21.15.31:0/528543156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a00b2ed0 0x7f07a01480e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f07a4838640 1 --2- 172.21.15.31:0/528543156 >> v2:172.21.15.69:3300/0 conn(0x7f07a006a390 0x7f07a0070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.050+0000 7f07a4838640 1 -- 172.21.15.31:0/528543156 >> 172.21.15.31:0/528543156 conn(0x7f07a00bc330 msgr2=0x7f07a00bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.051+0000 7f07a4838640 1 -- 172.21.15.31:0/528543156 shutdown_connections 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.051+0000 7f07a4838640 1 -- 172.21.15.31:0/528543156 wait complete. 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f07a4838640 1 Processor -- start 2023-12-22T08:41:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f07a4838640 1 -- start start 2023-12-22T08:41:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f07a4838640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07a006a390 0x7f07a0155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f07a4838640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f07a0141680 0x7f07a01374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f07a4838640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a0154960 0x7f07a01e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f07a4838640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a0146880 con 0x7f07a0154960 2023-12-22T08:41:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f07a4838640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a0146ad0 con 0x7f07a006a390 2023-12-22T08:41:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f07a4838640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a0137b00 con 0x7f07a0141680 2023-12-22T08:41:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.052+0000 7f079ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a0154960 0x7f07a01e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079ed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a0154960 0x7f07a01e3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45840/0 (socket says 172.21.15.31:45840) 2023-12-22T08:41:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079ed9d640 1 -- 172.21.15.31:0/2897556484 learned_addr learned my addr 172.21.15.31:0/2897556484 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079e59c640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07a006a390 0x7f07a0155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f0797fff640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f07a0141680 0x7f07a01374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079ed9d640 1 -- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f07a0141680 msgr2=0x7f07a01374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079ed9d640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f07a0141680 0x7f07a01374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079ed9d640 1 -- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07a006a390 msgr2=0x7f07a0155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079ed9d640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07a006a390 0x7f07a0155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079ed9d640 1 -- 172.21.15.31:0/2897556484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880094d0 con 0x7f07a0154960 2023-12-22T08:41:39.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f079ed9d640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a0154960 0x7f07a01e3c20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f079800b990 tx=0x7f079800bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f0796ffd640 1 -- 172.21.15.31:0/2897556484 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800caa0 con 0x7f07a0154960 2023-12-22T08:41:39.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f0796ffd640 1 -- 172.21.15.31:0/2897556484 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800cc00 con 0x7f07a0154960 2023-12-22T08:41:39.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a01e3420 con 0x7f07a0154960 2023-12-22T08:41:39.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f0796ffd640 1 -- 172.21.15.31:0/2897556484 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798014440 con 0x7f07a0154960 2023-12-22T08:41:39.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.053+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a01e4160 con 0x7f07a0154960 2023-12-22T08:41:39.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.054+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a01e3940 con 0x7f07a0154960 2023-12-22T08:41:39.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.055+0000 7f0796ffd640 1 -- 172.21.15.31:0/2897556484 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f079801d3b0 con 0x7f07a0154960 2023-12-22T08:41:39.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.055+0000 7f0796ffd640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f078006a430 0x7f078006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.055+0000 7f0796ffd640 1 -- 172.21.15.31:0/2897556484 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0798088710 con 0x7f07a0154960 2023-12-22T08:41:39.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.055+0000 7f079e59c640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f078006a430 0x7f078006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.056+0000 7f079e59c640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f078006a430 0x7f078006c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0790009990 tx=0x7f0790009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.059+0000 7f0796ffd640 1 -- 172.21.15.31:0/2897556484 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f07a01e3940 con 0x7f07a0154960 2023-12-22T08:41:39.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.235+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07a0147bc0 con 0x7f078006a430 2023-12-22T08:41:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.243+0000 7f0796ffd640 1 -- 172.21.15.31:0/2897556484 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270735 (secure 0 0 0) 0x7f079000e850 con 0x7f078006a430 2023-12-22T08:41:39.248 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:39.249 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:41:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f078006a430 msgr2=0x7f078006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f078006a430 0x7f078006c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0790009990 tx=0x7f0790009110 comp rx=0 tx=0).stop 2023-12-22T08:41:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a0154960 msgr2=0x7f07a01e3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a0154960 0x7f07a01e3c20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f079800b990 tx=0x7f079800bd90 comp rx=0 tx=0).stop 2023-12-22T08:41:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 shutdown_connections 2023-12-22T08:41:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f078006a430 0x7f078006c8f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07a0154960 0x7f07a01e3c20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f07a0141680 0x7f07a01374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 --2- 172.21.15.31:0/2897556484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07a006a390 0x7f07a0155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 >> 172.21.15.31:0/2897556484 conn(0x7f07a00bc330 msgr2=0x7f07a013e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 shutdown_connections 2023-12-22T08:41:39.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.246+0000 7f07a4838640 1 -- 172.21.15.31:0/2897556484 wait complete. 2023-12-22T08:41:39.259 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-12-22T08:41:37.796008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592984,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3944,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":4038656,"data_stored":2260064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2616,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002528"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801980+0000","last_change":"2023-12-22T08:41:27.129975+0000","last_active":"2023-12-22T08:41:28.801980+0000","last_peered":"2023-12-22T08:41:28.801980+0000","last_clean":"2023-12-22T08:41:28.801980+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:41:28.801980+0000","last_undegraded":"2023-12-22T08:41:28.801980+0000","last_fullsized":"2023-12-22T08:41:28.801980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:55.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803164+0000","last_change":"2023-12-22T08:41:27.132308+0000","last_active":"2023-12-22T08:41:28.803164+0000","last_peered":"2023-12-22T08:41:28.803164+0000","last_clean":"2023-12-22T08:41:28.803164+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:41:28.803164+0000","last_undegraded":"2023-12-22T08:41:28.803164+0000","last_fullsized":"2023-12-22T08:41:28.803164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111813+0000","last_change":"2023-12-22T08:41:27.117719+0000","last_active":"2023-12-22T08:41:28.111813+0000","last_peered":"2023-12-22T08:41:28.111813+0000","last_clean":"2023-12-22T08:41:28.111813+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:41:28.111813+0000","last_undegraded":"2023-12-22T08:41:28.111813+0000","last_fullsized":"2023-12-22T08:41:28.111813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112687+0000","last_change":"2023-12-22T08:41:27.126330+0000","last_active":"2023-12-22T08:41:28.112687+0000","last_peered":"2023-12-22T08:41:28.112687+0000","last_clean":"2023-12-22T08:41:28.112687+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:41:28.112687+0000","last_undegraded":"2023-12-22T08:41:28.112687+0000","last_fullsized":"2023-12-22T08:41:28.112687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802393+0000","last_change":"2023-12-22T08:41:27.131419+0000","last_active":"2023-12-22T08:41:28.802393+0000","last_peered":"2023-12-22T08:41:28.802393+0000","last_clean":"2023-12-22T08:41:28.802393+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:41:28.802393+0000","last_undegraded":"2023-12-22T08:41:28.802393+0000","last_fullsized":"2023-12-22T08:41:28.802393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.722212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803093+0000","last_change":"2023-12-22T08:41:27.125465+0000","last_active":"2023-12-22T08:41:28.803093+0000","last_peered":"2023-12-22T08:41:28.803093+0000","last_clean":"2023-12-22T08:41:28.803093+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:41:28.803093+0000","last_undegraded":"2023-12-22T08:41:28.803093+0000","last_fullsized":"2023-12-22T08:41:28.803093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807522+0000","last_change":"2023-12-22T08:41:27.127918+0000","last_active":"2023-12-22T08:41:28.807522+0000","last_peered":"2023-12-22T08:41:28.807522+0000","last_clean":"2023-12-22T08:41:28.807522+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:41:28.807522+0000","last_undegraded":"2023-12-22T08:41:28.807522+0000","last_fullsized":"2023-12-22T08:41:28.807522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807397+0000","last_change":"2023-12-22T08:41:27.128397+0000","last_active":"2023-12-22T08:41:28.807397+0000","last_peered":"2023-12-22T08:41:28.807397+0000","last_clean":"2023-12-22T08:41:28.807397+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:41:28.807397+0000","last_undegraded":"2023-12-22T08:41:28.807397+0000","last_fullsized":"2023-12-22T08:41:28.807397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111299+0000","last_change":"2023-12-22T08:41:27.115975+0000","last_active":"2023-12-22T08:41:28.111299+0000","last_peered":"2023-12-22T08:41:28.111299+0000","last_clean":"2023-12-22T08:41:28.111299+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:41:28.111299+0000","last_undegraded":"2023-12-22T08:41:28.111299+0000","last_fullsized":"2023-12-22T08:41:28.111299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112929+0000","last_change":"2023-12-22T08:41:27.133760+0000","last_active":"2023-12-22T08:41:28.112929+0000","last_peered":"2023-12-22T08:41:28.112929+0000","last_clean":"2023-12-22T08:41:28.112929+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:41:28.112929+0000","last_undegraded":"2023-12-22T08:41:28.112929+0000","last_fullsized":"2023-12-22T08:41:28.112929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807594+0000","last_change":"2023-12-22T08:41:27.121357+0000","last_active":"2023-12-22T08:41:28.807594+0000","last_peered":"2023-12-22T08:41:28.807594+0000","last_clean":"2023-12-22T08:41:28.807594+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:41:28.807594+0000","last_undegraded":"2023-12-22T08:41:28.807594+0000","last_fullsized":"2023-12-22T08:41:28.807594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111645+0000","last_change":"2023-12-22T08:41:27.131986+0000","last_active":"2023-12-22T08:41:28.111645+0000","last_peered":"2023-12-22T08:41:28.111645+0000","last_clean":"2023-12-22T08:41:28.111645+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:41:28.111645+0000","last_undegraded":"2023-12-22T08:41:28.111645+0000","last_fullsized":"2023-12-22T08:41:28.111645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802404+0000","last_change":"2023-12-22T08:41:27.120741+0000","last_active":"2023-12-22T08:41:28.802404+0000","last_peered":"2023-12-22T08:41:28.802404+0000","last_clean":"2023-12-22T08:41:28.802404+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:28.802404+0000","last_undegraded":"2023-12-22T08:41:28.802404+0000","last_fullsized":"2023-12-22T08:41:28.802404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:46.823109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803102+0000","last_change":"2023-12-22T08:41:27.127642+0000","last_active":"2023-12-22T08:41:28.803102+0000","last_peered":"2023-12-22T08:41:28.803102+0000","last_clean":"2023-12-22T08:41:28.803102+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:28.803102+0000","last_undegraded":"2023-12-22T08:41:28.803102+0000","last_fullsized":"2023-12-22T08:41:28.803102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111013+0000","last_change":"2023-12-22T08:41:27.124240+0000","last_active":"2023-12-22T08:41:28.111013+0000","last_peered":"2023-12-22T08:41:28.111013+0000","last_clean":"2023-12-22T08:41:28.111013+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:28.111013+0000","last_undegraded":"2023-12-22T08:41:28.111013+0000","last_fullsized":"2023-12-22T08:41:28.111013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807472+0000","last_change":"2023-12-22T08:41:27.131917+0000","last_active":"2023-12-22T08:41:28.807472+0000","last_peered":"2023-12-22T08:41:28.807472+0000","last_clean":"2023-12-22T08:41:28.807472+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:41:28.807472+0000","last_undegraded":"2023-12-22T08:41:28.807472+0000","last_fullsized":"2023-12-22T08:41:28.807472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807612+0000","last_change":"2023-12-22T08:41:27.126772+0000","last_active":"2023-12-22T08:41:28.807612+0000","last_peered":"2023-12-22T08:41:28.807612+0000","last_clean":"2023-12-22T08:41:28.807612+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:28.807612+0000","last_undegraded":"2023-12-22T08:41:28.807612+0000","last_fullsized":"2023-12-22T08:41:28.807612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803173+0000","last_change":"2023-12-22T08:41:27.132073+0000","last_active":"2023-12-22T08:41:28.803173+0000","last_peered":"2023-12-22T08:41:28.803173+0000","last_clean":"2023-12-22T08:41:28.803173+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:41:28.803173+0000","last_undegraded":"2023-12-22T08:41:28.803173+0000","last_fullsized":"2023-12-22T08:41:28.803173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803140+0000","last_change":"2023-12-22T08:41:27.128462+0000","last_active":"2023-12-22T08:41:28.803140+0000","last_peered":"2023-12-22T08:41:28.803140+0000","last_clean":"2023-12-22T08:41:28.803140+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:41:28.803140+0000","last_undegraded":"2023-12-22T08:41:28.803140+0000","last_fullsized":"2023-12-22T08:41:28.803140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802424+0000","last_change":"2023-12-22T08:41:27.124709+0000","last_active":"2023-12-22T08:41:28.802424+0000","last_peered":"2023-12-22T08:41:28.802424+0000","last_clean":"2023-12-22T08:41:28.802424+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:28.802424+0000","last_undegraded":"2023-12-22T08:41:28.802424+0000","last_fullsized":"2023-12-22T08:41:28.802424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:26.745936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111759+0000","last_change":"2023-12-22T08:41:27.120855+0000","last_active":"2023-12-22T08:41:28.111759+0000","last_peered":"2023-12-22T08:41:28.111759+0000","last_clean":"2023-12-22T08:41:28.111759+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:41:28.111759+0000","last_undegraded":"2023-12-22T08:41:28.111759+0000","last_fullsized":"2023-12-22T08:41:28.111759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:04.575089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111532+0000","last_change":"2023-12-22T08:41:27.129305+0000","last_active":"2023-12-22T08:41:28.111532+0000","last_peered":"2023-12-22T08:41:28.111532+0000","last_clean":"2023-12-22T08:41:28.111532+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:41:28.111532+0000","last_undegraded":"2023-12-22T08:41:28.111532+0000","last_fullsized":"2023-12-22T08:41:28.111532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801633+0000","last_change":"2023-12-22T08:41:27.123800+0000","last_active":"2023-12-22T08:41:28.801633+0000","last_peered":"2023-12-22T08:41:28.801633+0000","last_clean":"2023-12-22T08:41:28.801633+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:28.801633+0000","last_undegraded":"2023-12-22T08:41:28.801633+0000","last_fullsized":"2023-12-22T08:41:28.801633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110929+0000","last_change":"2023-12-22T08:41:27.114600+0000","last_active":"2023-12-22T08:41:28.110929+0000","last_peered":"2023-12-22T08:41:28.110929+0000","last_clean":"2023-12-22T08:41:28.110929+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:41:28.110929+0000","last_undegraded":"2023-12-22T08:41:28.110929+0000","last_fullsized":"2023-12-22T08:41:28.110929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113130+0000","last_change":"2023-12-22T08:41:27.121608+0000","last_active":"2023-12-22T08:41:28.113130+0000","last_peered":"2023-12-22T08:41:28.113130+0000","last_clean":"2023-12-22T08:41:28.113130+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:41:28.113130+0000","last_undegraded":"2023-12-22T08:41:28.113130+0000","last_fullsized":"2023-12-22T08:41:28.113130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803181+0000","last_change":"2023-12-22T08:41:27.131698+0000","last_active":"2023-12-22T08:41:28.803181+0000","last_peered":"2023-12-22T08:41:28.803181+0000","last_clean":"2023-12-22T08:41:28.803181+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:41:28.803181+0000","last_undegraded":"2023-12-22T08:41:28.803181+0000","last_fullsized":"2023-12-22T08:41:28.803181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113081+0000","last_change":"2023-12-22T08:41:27.121328+0000","last_active":"2023-12-22T08:41:28.113081+0000","last_peered":"2023-12-22T08:41:28.113081+0000","last_clean":"2023-12-22T08:41:28.113081+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:41:28.113081+0000","last_undegraded":"2023-12-22T08:41:28.113081+0000","last_fullsized":"2023-12-22T08:41:28.113081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111750+0000","last_change":"2023-12-22T08:41:27.117153+0000","last_active":"2023-12-22T08:41:28.111750+0000","last_peered":"2023-12-22T08:41:28.111750+0000","last_clean":"2023-12-22T08:41:28.111750+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:28.111750+0000","last_undegraded":"2023-12-22T08:41:28.111750+0000","last_fullsized":"2023-12-22T08:41:28.111750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111857+0000","last_change":"2023-12-22T08:41:27.128755+0000","last_active":"2023-12-22T08:41:28.111857+0000","last_peered":"2023-12-22T08:41:28.111857+0000","last_clean":"2023-12-22T08:41:28.111857+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:41:28.111857+0000","last_undegraded":"2023-12-22T08:41:28.111857+0000","last_fullsized":"2023-12-22T08:41:28.111857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807539+0000","last_change":"2023-12-22T08:41:27.126203+0000","last_active":"2023-12-22T08:41:28.807539+0000","last_peered":"2023-12-22T08:41:28.807539+0000","last_clean":"2023-12-22T08:41:28.807539+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:41:28.807539+0000","last_undegraded":"2023-12-22T08:41:28.807539+0000","last_fullsized":"2023-12-22T08:41:28.807539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801882+0000","last_change":"2023-12-22T08:41:27.127519+0000","last_active":"2023-12-22T08:41:28.801882+0000","last_peered":"2023-12-22T08:41:28.801882+0000","last_clean":"2023-12-22T08:41:28.801882+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:41:28.801882+0000","last_undegraded":"2023-12-22T08:41:28.801882+0000","last_fullsized":"2023-12-22T08:41:28.801882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:50.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807417+0000","last_change":"2023-12-22T08:41:27.122823+0000","last_active":"2023-12-22T08:41:28.807417+0000","last_peered":"2023-12-22T08:41:28.807417+0000","last_clean":"2023-12-22T08:41:28.807417+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:41:28.807417+0000","last_undegraded":"2023-12-22T08:41:28.807417+0000","last_fullsized":"2023-12-22T08:41:28.807417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801686+0000","last_change":"2023-12-22T08:41:27.121742+0000","last_active":"2023-12-22T08:41:28.801686+0000","last_peered":"2023-12-22T08:41:28.801686+0000","last_clean":"2023-12-22T08:41:28.801686+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:28.801686+0000","last_undegraded":"2023-12-22T08:41:28.801686+0000","last_fullsized":"2023-12-22T08:41:28.801686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802016+0000","last_change":"2023-12-22T08:41:26.742786+0000","last_active":"2023-12-22T08:41:28.802016+0000","last_peered":"2023-12-22T08:41:28.802016+0000","last_clean":"2023-12-22T08:41:28.802016+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:28.802016+0000","last_undegraded":"2023-12-22T08:41:28.802016+0000","last_fullsized":"2023-12-22T08:41:28.802016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801996+0000","last_change":"2023-12-22T08:41:27.130511+0000","last_active":"2023-12-22T08:41:28.801996+0000","last_peered":"2023-12-22T08:41:28.801996+0000","last_clean":"2023-12-22T08:41:28.801996+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:41:28.801996+0000","last_undegraded":"2023-12-22T08:41:28.801996+0000","last_fullsized":"2023-12-22T08:41:28.801996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:18.765379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801698+0000","last_change":"2023-12-22T08:41:26.743569+0000","last_active":"2023-12-22T08:41:28.801698+0000","last_peered":"2023-12-22T08:41:28.801698+0000","last_clean":"2023-12-22T08:41:28.801698+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:28.801698+0000","last_undegraded":"2023-12-22T08:41:28.801698+0000","last_fullsized":"2023-12-22T08:41:28.801698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111545+0000","last_change":"2023-12-22T08:41:27.128744+0000","last_active":"2023-12-22T08:41:28.111545+0000","last_peered":"2023-12-22T08:41:28.111545+0000","last_clean":"2023-12-22T08:41:28.111545+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:41:28.111545+0000","last_undegraded":"2023-12-22T08:41:28.111545+0000","last_fullsized":"2023-12-22T08:41:28.111545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803153+0000","last_change":"2023-12-22T08:41:26.747403+0000","last_active":"2023-12-22T08:41:28.803153+0000","last_peered":"2023-12-22T08:41:28.803153+0000","last_clean":"2023-12-22T08:41:28.803153+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:28.803153+0000","last_undegraded":"2023-12-22T08:41:28.803153+0000","last_fullsized":"2023-12-22T08:41:28.803153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:17.763510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113171+0000","last_change":"2023-12-22T08:41:27.121058+0000","last_active":"2023-12-22T08:41:28.113171+0000","last_peered":"2023-12-22T08:41:28.113171+0000","last_clean":"2023-12-22T08:41:28.113171+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:41:28.113171+0000","last_undegraded":"2023-12-22T08:41:28.113171+0000","last_fullsized":"2023-12-22T08:41:28.113171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802433+0000","last_change":"2023-12-22T08:41:26.747241+0000","last_active":"2023-12-22T08:41:28.802433+0000","last_peered":"2023-12-22T08:41:28.802433+0000","last_clean":"2023-12-22T08:41:28.802433+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:28.802433+0000","last_undegraded":"2023-12-22T08:41:28.802433+0000","last_fullsized":"2023-12-22T08:41:28.802433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:52.257765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807557+0000","last_change":"2023-12-22T08:41:27.123533+0000","last_active":"2023-12-22T08:41:28.807557+0000","last_peered":"2023-12-22T08:41:28.807557+0000","last_clean":"2023-12-22T08:41:28.807557+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:41:28.807557+0000","last_undegraded":"2023-12-22T08:41:28.807557+0000","last_fullsized":"2023-12-22T08:41:28.807557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111846+0000","last_change":"2023-12-22T08:41:26.750084+0000","last_active":"2023-12-22T08:41:28.111846+0000","last_peered":"2023-12-22T08:41:28.111846+0000","last_clean":"2023-12-22T08:41:28.111846+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:41:28.111846+0000","last_undegraded":"2023-12-22T08:41:28.111846+0000","last_fullsized":"2023-12-22T08:41:28.111846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111151+0000","last_change":"2023-12-22T08:41:27.125421+0000","last_active":"2023-12-22T08:41:28.111151+0000","last_peered":"2023-12-22T08:41:28.111151+0000","last_clean":"2023-12-22T08:41:28.111151+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:41:28.111151+0000","last_undegraded":"2023-12-22T08:41:28.111151+0000","last_fullsized":"2023-12-22T08:41:28.111151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:39.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111620+0000","last_change":"2023-12-22T08:41:26.743416+0000","last_active":"2023-12-22T08:41:28.111620+0000","last_peered":"2023-12-22T08:41:28.111620+0000","last_clean":"2023-12-22T08:41:28.111620+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:41:28.111620+0000","last_undegraded":"2023-12-22T08:41:28.111620+0000","last_fullsized":"2023-12-22T08:41:28.111620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:42.994044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111016+0000","last_change":"2023-12-22T08:41:27.123904+0000","last_active":"2023-12-22T08:41:28.111016+0000","last_peered":"2023-12-22T08:41:28.111016+0000","last_clean":"2023-12-22T08:41:28.111016+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:41:28.111016+0000","last_undegraded":"2023-12-22T08:41:28.111016+0000","last_fullsized":"2023-12-22T08:41:28.111016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803073+0000","last_change":"2023-12-22T08:41:26.745648+0000","last_active":"2023-12-22T08:41:28.803073+0000","last_peered":"2023-12-22T08:41:28.803073+0000","last_clean":"2023-12-22T08:41:28.803073+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:41:28.803073+0000","last_undegraded":"2023-12-22T08:41:28.803073+0000","last_fullsized":"2023-12-22T08:41:28.803073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112566+0000","last_change":"2023-12-22T08:41:27.126166+0000","last_active":"2023-12-22T08:41:28.112566+0000","last_peered":"2023-12-22T08:41:28.112566+0000","last_clean":"2023-12-22T08:41:28.112566+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:28.112566+0000","last_undegraded":"2023-12-22T08:41:28.112566+0000","last_fullsized":"2023-12-22T08:41:28.112566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111017+0000","last_change":"2023-12-22T08:41:26.739716+0000","last_active":"2023-12-22T08:41:28.111017+0000","last_peered":"2023-12-22T08:41:28.111017+0000","last_clean":"2023-12-22T08:41:28.111017+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:28.111017+0000","last_undegraded":"2023-12-22T08:41:28.111017+0000","last_fullsized":"2023-12-22T08:41:28.111017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:25.744068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111505+0000","last_change":"2023-12-22T08:41:27.133504+0000","last_active":"2023-12-22T08:41:28.111505+0000","last_peered":"2023-12-22T08:41:28.111505+0000","last_clean":"2023-12-22T08:41:28.111505+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:41:28.111505+0000","last_undegraded":"2023-12-22T08:41:28.111505+0000","last_fullsized":"2023-12-22T08:41:28.111505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803207+0000","last_change":"2023-12-22T08:41:26.743175+0000","last_active":"2023-12-22T08:41:28.803207+0000","last_peered":"2023-12-22T08:41:28.803207+0000","last_clean":"2023-12-22T08:41:28.803207+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:28.803207+0000","last_undegraded":"2023-12-22T08:41:28.803207+0000","last_fullsized":"2023-12-22T08:41:28.803207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:03.573220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803190+0000","last_change":"2023-12-22T08:41:27.129547+0000","last_active":"2023-12-22T08:41:28.803190+0000","last_peered":"2023-12-22T08:41:28.803190+0000","last_clean":"2023-12-22T08:41:28.803190+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:41:28.803190+0000","last_undegraded":"2023-12-22T08:41:28.803190+0000","last_fullsized":"2023-12-22T08:41:28.803190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801721+0000","last_change":"2023-12-22T08:41:26.743757+0000","last_active":"2023-12-22T08:41:28.801721+0000","last_peered":"2023-12-22T08:41:28.801721+0000","last_clean":"2023-12-22T08:41:28.801721+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:28.801721+0000","last_undegraded":"2023-12-22T08:41:28.801721+0000","last_fullsized":"2023-12-22T08:41:28.801721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803120+0000","last_change":"2023-12-22T08:41:27.131773+0000","last_active":"2023-12-22T08:41:28.803120+0000","last_peered":"2023-12-22T08:41:28.803120+0000","last_clean":"2023-12-22T08:41:28.803120+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:41:28.803120+0000","last_undegraded":"2023-12-22T08:41:28.803120+0000","last_fullsized":"2023-12-22T08:41:28.803120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111905+0000","last_change":"2023-12-22T08:41:26.745597+0000","last_active":"2023-12-22T08:41:28.111905+0000","last_peered":"2023-12-22T08:41:28.111905+0000","last_clean":"2023-12-22T08:41:28.111905+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:28.111905+0000","last_undegraded":"2023-12-22T08:41:28.111905+0000","last_fullsized":"2023-12-22T08:41:28.111905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111718+0000","last_change":"2023-12-22T08:41:27.118227+0000","last_active":"2023-12-22T08:41:28.111718+0000","last_peered":"2023-12-22T08:41:28.111718+0000","last_clean":"2023-12-22T08:41:28.111718+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:41:28.111718+0000","last_undegraded":"2023-12-22T08:41:28.111718+0000","last_fullsized":"2023-12-22T08:41:28.111718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'7","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880717+0000","last_change":"2023-12-22T08:41:26.748072+0000","last_active":"2023-12-22T08:41:28.880717+0000","last_peered":"2023-12-22T08:41:28.880717+0000","last_clean":"2023-12-22T08:41:28.880717+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:28.880717+0000","last_undegraded":"2023-12-22T08:41:28.880717+0000","last_fullsized":"2023-12-22T08:41:28.880717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:05.371284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1818,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112579+0000","last_change":"2023-12-22T08:41:27.120378+0000","last_active":"2023-12-22T08:41:28.112579+0000","last_peered":"2023-12-22T08:41:28.112579+0000","last_clean":"2023-12-22T08:41:28.112579+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:28.112579+0000","last_undegraded":"2023-12-22T08:41:28.112579+0000","last_fullsized":"2023-12-22T08:41:28.112579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111924+0000","last_change":"2023-12-22T08:41:26.740501+0000","last_active":"2023-12-22T08:41:28.111924+0000","last_peered":"2023-12-22T08:41:28.111924+0000","last_clean":"2023-12-22T08:41:28.111924+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:28.111924+0000","last_undegraded":"2023-12-22T08:41:28.111924+0000","last_fullsized":"2023-12-22T08:41:28.111924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803112+0000","last_change":"2023-12-22T08:41:27.127482+0000","last_active":"2023-12-22T08:41:28.803112+0000","last_peered":"2023-12-22T08:41:28.803112+0000","last_clean":"2023-12-22T08:41:28.803112+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:41:28.803112+0000","last_undegraded":"2023-12-22T08:41:28.803112+0000","last_fullsized":"2023-12-22T08:41:28.803112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112604+0000","last_change":"2023-12-22T08:41:26.746743+0000","last_active":"2023-12-22T08:41:28.112604+0000","last_peered":"2023-12-22T08:41:28.112604+0000","last_clean":"2023-12-22T08:41:28.112604+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:28.112604+0000","last_undegraded":"2023-12-22T08:41:28.112604+0000","last_fullsized":"2023-12-22T08:41:28.112604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807455+0000","last_change":"2023-12-22T08:41:27.123864+0000","last_active":"2023-12-22T08:41:28.807455+0000","last_peered":"2023-12-22T08:41:28.807455+0000","last_clean":"2023-12-22T08:41:28.807455+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:41:28.807455+0000","last_undegraded":"2023-12-22T08:41:28.807455+0000","last_fullsized":"2023-12-22T08:41:28.807455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803082+0000","last_change":"2023-12-22T08:41:26.742515+0000","last_active":"2023-12-22T08:41:28.803082+0000","last_peered":"2023-12-22T08:41:28.803082+0000","last_clean":"2023-12-22T08:41:28.803082+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:28.803082+0000","last_undegraded":"2023-12-22T08:41:28.803082+0000","last_fullsized":"2023-12-22T08:41:28.803082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:32.527496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801907+0000","last_change":"2023-12-22T08:41:27.122673+0000","last_active":"2023-12-22T08:41:28.801907+0000","last_peered":"2023-12-22T08:41:28.801907+0000","last_clean":"2023-12-22T08:41:28.801907+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:41:28.801907+0000","last_undegraded":"2023-12-22T08:41:28.801907+0000","last_fullsized":"2023-12-22T08:41:28.801907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:06.373152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803052+0000","last_change":"2023-12-22T08:41:26.748785+0000","last_active":"2023-12-22T08:41:28.803052+0000","last_peered":"2023-12-22T08:41:28.803052+0000","last_clean":"2023-12-22T08:41:28.803052+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:41:28.803052+0000","last_undegraded":"2023-12-22T08:41:28.803052+0000","last_fullsized":"2023-12-22T08:41:28.803052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111273+0000","last_change":"2023-12-22T08:41:27.118299+0000","last_active":"2023-12-22T08:41:28.111273+0000","last_peered":"2023-12-22T08:41:28.111273+0000","last_clean":"2023-12-22T08:41:28.111273+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:41:28.111273+0000","last_undegraded":"2023-12-22T08:41:28.111273+0000","last_fullsized":"2023-12-22T08:41:28.111273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113208+0000","last_change":"2023-12-22T08:41:26.751813+0000","last_active":"2023-12-22T08:41:28.113208+0000","last_peered":"2023-12-22T08:41:28.113208+0000","last_clean":"2023-12-22T08:41:28.113208+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:28.113208+0000","last_undegraded":"2023-12-22T08:41:28.113208+0000","last_fullsized":"2023-12-22T08:41:28.113208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111455+0000","last_change":"2023-12-22T08:41:27.122998+0000","last_active":"2023-12-22T08:41:28.111455+0000","last_peered":"2023-12-22T08:41:28.111455+0000","last_clean":"2023-12-22T08:41:28.111455+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:41:28.111455+0000","last_undegraded":"2023-12-22T08:41:28.111455+0000","last_fullsized":"2023-12-22T08:41:28.111455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111193+0000","last_change":"2023-12-22T08:41:26.740945+0000","last_active":"2023-12-22T08:41:28.111193+0000","last_peered":"2023-12-22T08:41:28.111193+0000","last_clean":"2023-12-22T08:41:28.111193+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:41:28.111193+0000","last_undegraded":"2023-12-22T08:41:28.111193+0000","last_fullsized":"2023-12-22T08:41:28.111193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112745+0000","last_change":"2023-12-22T08:41:27.125917+0000","last_active":"2023-12-22T08:41:28.112745+0000","last_peered":"2023-12-22T08:41:28.112745+0000","last_clean":"2023-12-22T08:41:28.112745+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:41:28.112745+0000","last_undegraded":"2023-12-22T08:41:28.112745+0000","last_fullsized":"2023-12-22T08:41:28.112745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111940+0000","last_change":"2023-12-22T08:41:26.743117+0000","last_active":"2023-12-22T08:41:28.111940+0000","last_peered":"2023-12-22T08:41:28.111940+0000","last_clean":"2023-12-22T08:41:28.111940+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:41:28.111940+0000","last_undegraded":"2023-12-22T08:41:28.111940+0000","last_fullsized":"2023-12-22T08:41:28.111940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802452+0000","last_change":"2023-12-22T08:41:27.125969+0000","last_active":"2023-12-22T08:41:28.802452+0000","last_peered":"2023-12-22T08:41:28.802452+0000","last_clean":"2023-12-22T08:41:28.802452+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:28.802452+0000","last_undegraded":"2023-12-22T08:41:28.802452+0000","last_fullsized":"2023-12-22T08:41:28.802452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:34.167113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111633+0000","last_change":"2023-12-22T08:41:26.744095+0000","last_active":"2023-12-22T08:41:28.111633+0000","last_peered":"2023-12-22T08:41:28.111633+0000","last_clean":"2023-12-22T08:41:28.111633+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:41:28.111633+0000","last_undegraded":"2023-12-22T08:41:28.111633+0000","last_fullsized":"2023-12-22T08:41:28.111633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:11.707505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802382+0000","last_change":"2023-12-22T08:41:27.125387+0000","last_active":"2023-12-22T08:41:28.802382+0000","last_peered":"2023-12-22T08:41:28.802382+0000","last_clean":"2023-12-22T08:41:28.802382+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:28.802382+0000","last_undegraded":"2023-12-22T08:41:28.802382+0000","last_fullsized":"2023-12-22T08:41:28.802382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:31.788205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801658+0000","last_change":"2023-12-22T08:41:26.747215+0000","last_active":"2023-12-22T08:41:28.801658+0000","last_peered":"2023-12-22T08:41:28.801658+0000","last_clean":"2023-12-22T08:41:28.801658+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:28.801658+0000","last_undegraded":"2023-12-22T08:41:28.801658+0000","last_fullsized":"2023-12-22T08:41:28.801658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802415+0000","last_change":"2023-12-22T08:41:27.122152+0000","last_active":"2023-12-22T08:41:28.802415+0000","last_peered":"2023-12-22T08:41:28.802415+0000","last_clean":"2023-12-22T08:41:28.802415+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:28.802415+0000","last_undegraded":"2023-12-22T08:41:28.802415+0000","last_fullsized":"2023-12-22T08:41:28.802415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.709373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801943+0000","last_change":"2023-12-22T08:41:26.746895+0000","last_active":"2023-12-22T08:41:28.801943+0000","last_peered":"2023-12-22T08:41:28.801943+0000","last_clean":"2023-12-22T08:41:28.801943+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:28.801943+0000","last_undegraded":"2023-12-22T08:41:28.801943+0000","last_fullsized":"2023-12-22T08:41:28.801943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802368+0000","last_change":"2023-12-22T08:41:27.121179+0000","last_active":"2023-12-22T08:41:28.802368+0000","last_peered":"2023-12-22T08:41:28.802368+0000","last_clean":"2023-12-22T08:41:28.802368+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:28.802368+0000","last_undegraded":"2023-12-22T08:41:28.802368+0000","last_fullsized":"2023-12-22T08:41:28.802368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:53.573498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111334+0000","last_change":"2023-12-22T08:41:26.744242+0000","last_active":"2023-12-22T08:41:28.111334+0000","last_peered":"2023-12-22T08:41:28.111334+0000","last_clean":"2023-12-22T08:41:28.111334+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:28.111334+0000","last_undegraded":"2023-12-22T08:41:28.111334+0000","last_fullsized":"2023-12-22T08:41:28.111334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807504+0000","last_change":"2023-12-22T08:41:27.125910+0000","last_active":"2023-12-22T08:41:28.807504+0000","last_peered":"2023-12-22T08:41:28.807504+0000","last_clean":"2023-12-22T08:41:28.807504+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:41:28.807504+0000","last_undegraded":"2023-12-22T08:41:28.807504+0000","last_fullsized":"2023-12-22T08:41:28.807504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110836+0000","last_change":"2023-12-22T08:41:26.747152+0000","last_active":"2023-12-22T08:41:28.110836+0000","last_peered":"2023-12-22T08:41:28.110836+0000","last_clean":"2023-12-22T08:41:28.110836+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:28.110836+0000","last_undegraded":"2023-12-22T08:41:28.110836+0000","last_fullsized":"2023-12-22T08:41:28.110836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802474+0000","last_change":"2023-12-22T08:41:27.122069+0000","last_active":"2023-12-22T08:41:28.802474+0000","last_peered":"2023-12-22T08:41:28.802474+0000","last_clean":"2023-12-22T08:41:28.802474+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:28.802474+0000","last_undegraded":"2023-12-22T08:41:28.802474+0000","last_fullsized":"2023-12-22T08:41:28.802474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:04.235137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113220+0000","last_change":"2023-12-22T08:41:26.748464+0000","last_active":"2023-12-22T08:41:28.113220+0000","last_peered":"2023-12-22T08:41:28.113220+0000","last_clean":"2023-12-22T08:41:28.113220+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:28.113220+0000","last_undegraded":"2023-12-22T08:41:28.113220+0000","last_fullsized":"2023-12-22T08:41:28.113220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111578+0000","last_change":"2023-12-22T08:41:27.117970+0000","last_active":"2023-12-22T08:41:28.111578+0000","last_peered":"2023-12-22T08:41:28.111578+0000","last_clean":"2023-12-22T08:41:28.111578+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:41:28.111578+0000","last_undegraded":"2023-12-22T08:41:28.111578+0000","last_fullsized":"2023-12-22T08:41:28.111578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.885010+0000","last_change":"2023-12-22T08:41:26.744425+0000","last_active":"2023-12-22T08:41:29.885010+0000","last_peered":"2023-12-22T08:41:29.885010+0000","last_clean":"2023-12-22T08:41:29.885010+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:29.885010+0000","last_undegraded":"2023-12-22T08:41:29.885010+0000","last_fullsized":"2023-12-22T08:41:29.885010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:17.007353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801677+0000","last_change":"2023-12-22T08:41:27.121596+0000","last_active":"2023-12-22T08:41:28.801677+0000","last_peered":"2023-12-22T08:41:28.801677+0000","last_clean":"2023-12-22T08:41:28.801677+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:28.801677+0000","last_undegraded":"2023-12-22T08:41:28.801677+0000","last_fullsized":"2023-12-22T08:41:28.801677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112784+0000","last_change":"2023-12-22T08:41:26.748558+0000","last_active":"2023-12-22T08:41:28.112784+0000","last_peered":"2023-12-22T08:41:28.112784+0000","last_clean":"2023-12-22T08:41:28.112784+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:28.112784+0000","last_undegraded":"2023-12-22T08:41:28.112784+0000","last_fullsized":"2023-12-22T08:41:28.112784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801927+0000","last_change":"2023-12-22T08:41:27.124314+0000","last_active":"2023-12-22T08:41:28.801927+0000","last_peered":"2023-12-22T08:41:28.801927+0000","last_clean":"2023-12-22T08:41:28.801927+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:28.801927+0000","last_undegraded":"2023-12-22T08:41:28.801927+0000","last_fullsized":"2023-12-22T08:41:28.801927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:18.009221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801668+0000","last_change":"2023-12-22T08:41:26.740301+0000","last_active":"2023-12-22T08:41:28.801668+0000","last_peered":"2023-12-22T08:41:28.801668+0000","last_clean":"2023-12-22T08:41:28.801668+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:28.801668+0000","last_undegraded":"2023-12-22T08:41:28.801668+0000","last_fullsized":"2023-12-22T08:41:28.801668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801647+0000","last_change":"2023-12-22T08:41:27.121048+0000","last_active":"2023-12-22T08:41:28.801647+0000","last_peered":"2023-12-22T08:41:28.801647+0000","last_clean":"2023-12-22T08:41:28.801647+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:28.801647+0000","last_undegraded":"2023-12-22T08:41:28.801647+0000","last_fullsized":"2023-12-22T08:41:28.801647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112660+0000","last_change":"2023-12-22T08:41:26.747176+0000","last_active":"2023-12-22T08:41:28.112660+0000","last_peered":"2023-12-22T08:41:28.112660+0000","last_clean":"2023-12-22T08:41:28.112660+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:28.112660+0000","last_undegraded":"2023-12-22T08:41:28.112660+0000","last_fullsized":"2023-12-22T08:41:28.112660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803023+0000","last_change":"2023-12-22T08:41:27.122915+0000","last_active":"2023-12-22T08:41:28.803023+0000","last_peered":"2023-12-22T08:41:28.803023+0000","last_clean":"2023-12-22T08:41:28.803023+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:41:28.803023+0000","last_undegraded":"2023-12-22T08:41:28.803023+0000","last_fullsized":"2023-12-22T08:41:28.803023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:27.533832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111422+0000","last_change":"2023-12-22T08:41:26.739638+0000","last_active":"2023-12-22T08:41:28.111422+0000","last_peered":"2023-12-22T08:41:28.111422+0000","last_clean":"2023-12-22T08:41:28.111422+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:28.111422+0000","last_undegraded":"2023-12-22T08:41:28.111422+0000","last_fullsized":"2023-12-22T08:41:28.111422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:03.233269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111243+0000","last_change":"2023-12-22T08:41:27.131013+0000","last_active":"2023-12-22T08:41:28.111243+0000","last_peered":"2023-12-22T08:41:28.111243+0000","last_clean":"2023-12-22T08:41:28.111243+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:41:28.111243+0000","last_undegraded":"2023-12-22T08:41:28.111243+0000","last_fullsized":"2023-12-22T08:41:28.111243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803063+0000","last_change":"2023-12-22T08:41:26.745042+0000","last_active":"2023-12-22T08:41:28.803063+0000","last_peered":"2023-12-22T08:41:28.803063+0000","last_clean":"2023-12-22T08:41:28.803063+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:28.803063+0000","last_undegraded":"2023-12-22T08:41:28.803063+0000","last_fullsized":"2023-12-22T08:41:28.803063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807574+0000","last_change":"2023-12-22T08:41:27.128761+0000","last_active":"2023-12-22T08:41:28.807574+0000","last_peered":"2023-12-22T08:41:28.807574+0000","last_clean":"2023-12-22T08:41:28.807574+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:28.807574+0000","last_undegraded":"2023-12-22T08:41:28.807574+0000","last_fullsized":"2023-12-22T08:41:28.807574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801962+0000","last_change":"2023-12-22T08:41:26.742603+0000","last_active":"2023-12-22T08:41:28.801962+0000","last_peered":"2023-12-22T08:41:28.801962+0000","last_clean":"2023-12-22T08:41:28.801962+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:28.801962+0000","last_undegraded":"2023-12-22T08:41:28.801962+0000","last_fullsized":"2023-12-22T08:41:28.801962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.117407+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:41:27.117407+0000","last_peered":"2023-12-22T08:41:27.117407+0000","last_clean":"2023-12-22T08:41:27.117407+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:27.117407+0000","last_undegraded":"2023-12-22T08:41:27.117407+0000","last_fullsized":"2023-12-22T08:41:27.117407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2616,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":136102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":136102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.377},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.31}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.433},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.75800000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:41:39.266 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-22T08:41:39.266 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:39.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.402+0000 7fbb521d9640 1 Processor -- start 2023-12-22T08:41:39.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.402+0000 7fbb521d9640 1 -- start start 2023-12-22T08:41:39.406 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb521d9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb4c06a6d0 0x7fbb4c14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb521d9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb521d9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4c0bb310 con 0x7fbb4c0ba550 2023-12-22T08:41:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb521d9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4c0bf960 con 0x7fbb4c06a6d0 2023-12-22T08:41:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb521d9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c0bb5b0 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb4b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb4c06a6d0 0x7fbb4c14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb4b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb4c06a6d0 0x7fbb4c14acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45846/0 (socket says 172.21.15.31:45846) 2023-12-22T08:41:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb4b7fe640 1 -- 172.21.15.31:0/294993800 learned_addr learned my addr 172.21.15.31:0/294993800 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:39.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb4bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbb4c0ba550 0x7fbb4c14e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33610/0 (socket says 172.21.15.31:33610) 2023-12-22T08:41:39.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb4affd640 1 --2- 172.21.15.31:0/294993800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb4b7fe640 1 -- 172.21.15.31:0/294993800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c14b1f0 msgr2=0x7fbb4c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb4b7fe640 1 --2- 172.21.15.31:0/294993800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.403+0000 7fbb4b7fe640 1 -- 172.21.15.31:0/294993800 >> v1:172.21.15.31:6789/0 conn(0x7fbb4c0ba550 legacy=0x7fbb4c14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.404+0000 7fbb4b7fe640 1 -- 172.21.15.31:0/294993800 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c0c0120 con 0x7fbb4c06a6d0 2023-12-22T08:41:39.408 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.404+0000 7fbb4affd640 1 --2- 172.21.15.31:0/294993800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:39.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.404+0000 7fbb4b7fe640 1 --2- 172.21.15.31:0/294993800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c06a6d0 0x7fbb4c14acb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009870 tx=0x7fbb3c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b764a9f706154fb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.404+0000 7fbb4a7fc640 1 -- 172.21.15.31:0/294993800 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c030840 con 0x7fbb4c06a6d0 2023-12-22T08:41:39.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.404+0000 7fbb4a7fc640 1 -- 172.21.15.31:0/294993800 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c0309a0 con 0x7fbb4c06a6d0 2023-12-22T08:41:39.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.404+0000 7fbb4a7fc640 1 -- 172.21.15.31:0/294993800 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c030d30 con 0x7fbb4c06a6d0 2023-12-22T08:41:39.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.405+0000 7fbb521d9640 1 -- 172.21.15.31:0/294993800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c06a6d0 msgr2=0x7fbb4c14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.405+0000 7fbb521d9640 1 --2- 172.21.15.31:0/294993800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c06a6d0 0x7fbb4c14acb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009870 tx=0x7fbb3c02b980 comp rx=0 tx=0).stop 2023-12-22T08:41:39.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.405+0000 7fbb521d9640 1 -- 172.21.15.31:0/294993800 shutdown_connections 2023-12-22T08:41:39.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.405+0000 7fbb521d9640 1 --2- 172.21.15.31:0/294993800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.405+0000 7fbb521d9640 1 --2- 172.21.15.31:0/294993800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c06a6d0 0x7fbb4c14acb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.405+0000 7fbb521d9640 1 -- 172.21.15.31:0/294993800 >> 172.21.15.31:0/294993800 conn(0x7fbb4c0c0350 msgr2=0x7fbb4c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.405+0000 7fbb521d9640 1 -- 172.21.15.31:0/294993800 shutdown_connections 2023-12-22T08:41:39.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.405+0000 7fbb521d9640 1 -- 172.21.15.31:0/294993800 wait complete. 2023-12-22T08:41:39.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.406+0000 7fbb521d9640 1 Processor -- start 2023-12-22T08:41:39.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.406+0000 7fbb521d9640 1 -- start start 2023-12-22T08:41:39.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb521d9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb4c06a6d0 0x7fbb4c14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb521d9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c0ba550 0x7fbb4c14d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb521d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb521d9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c14ccd0 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb521d9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c14c270 con 0x7fbb4c06a6d0 2023-12-22T08:41:39.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb521d9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c14e620 con 0x7fbb4c0ba550 2023-12-22T08:41:39.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45852/0 (socket says 172.21.15.31:45852) 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 -- 172.21.15.31:0/604336803 learned_addr learned my addr 172.21.15.31:0/604336803 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4b7fe640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb4c06a6d0 0x7fbb4c14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4affd640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c0ba550 0x7fbb4c14d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 -- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c0ba550 msgr2=0x7fbb4c14d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c0ba550 0x7fbb4c14d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 -- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb4c06a6d0 msgr2=0x7fbb4c14c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb4c06a6d0 0x7fbb4c14c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 -- 172.21.15.31:0/604336803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c0094d0 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4affd640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c0ba550 0x7fbb4c14d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:39.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb4bfff640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b2ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400c7a0 tx=0x7fbb4400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.407+0000 7fbb33fff640 1 -- 172.21.15.31:0/604336803 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400a640 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.408+0000 7fbb33fff640 1 -- 172.21.15.31:0/604336803 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4400a7a0 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.408+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c14e900 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.408+0000 7fbb33fff640 1 -- 172.21.15.31:0/604336803 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400ab10 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.408+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c1df970 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.409+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4c073a40 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.409+0000 7fbb33fff640 1 -- 172.21.15.31:0/604336803 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb4400ac70 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.409+0000 7fbb33fff640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbb3806a460 0x7fbb3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.409+0000 7fbb33fff640 1 -- 172.21.15.31:0/604336803 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb44087fc0 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.410+0000 7fbb4b7fe640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbb3806a460 0x7fbb3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.410+0000 7fbb4b7fe640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbb3806a460 0x7fbb3806c920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c036000 tx=0x7fbb3c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.414+0000 7fbb33fff640 1 -- 172.21.15.31:0/604336803 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbb44053650 con 0x7fbb4c14b1f0 2023-12-22T08:41:39.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.587+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb4c0c1160 con 0x7fbb3806a460 2023-12-22T08:41:39.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.595+0000 7fbb33fff640 1 -- 172.21.15.31:0/604336803 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270735 (secure 0 0 0) 0x7fbb3c030ce0 con 0x7fbb3806a460 2023-12-22T08:41:39.600 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:39.601 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:41:39.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbb3806a460 msgr2=0x7fbb3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbb3806a460 0x7fbb3806c920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c036000 tx=0x7fbb3c008030 comp rx=0 tx=0).stop 2023-12-22T08:41:39.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c14b1f0 msgr2=0x7fbb4c0b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b2ba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400c7a0 tx=0x7fbb4400cc60 comp rx=0 tx=0).stop 2023-12-22T08:41:39.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 shutdown_connections 2023-12-22T08:41:39.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fbb3806a460 0x7fbb3806c920 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb4c14b1f0 0x7fbb4c0b2ba0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbb4c0ba550 0x7fbb4c14d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 --2- 172.21.15.31:0/604336803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb4c06a6d0 0x7fbb4c14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.597+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 >> 172.21.15.31:0/604336803 conn(0x7fbb4c0c0350 msgr2=0x7fbb4c0a1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.598+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 shutdown_connections 2023-12-22T08:41:39.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.598+0000 7fbb521d9640 1 -- 172.21.15.31:0/604336803 wait complete. 2023-12-22T08:41:39.610 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-12-22T08:41:37.796008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592984,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3944,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":4038656,"data_stored":2260064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2616,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002528"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801980+0000","last_change":"2023-12-22T08:41:27.129975+0000","last_active":"2023-12-22T08:41:28.801980+0000","last_peered":"2023-12-22T08:41:28.801980+0000","last_clean":"2023-12-22T08:41:28.801980+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:41:28.801980+0000","last_undegraded":"2023-12-22T08:41:28.801980+0000","last_fullsized":"2023-12-22T08:41:28.801980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:55.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803164+0000","last_change":"2023-12-22T08:41:27.132308+0000","last_active":"2023-12-22T08:41:28.803164+0000","last_peered":"2023-12-22T08:41:28.803164+0000","last_clean":"2023-12-22T08:41:28.803164+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:41:28.803164+0000","last_undegraded":"2023-12-22T08:41:28.803164+0000","last_fullsized":"2023-12-22T08:41:28.803164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111813+0000","last_change":"2023-12-22T08:41:27.117719+0000","last_active":"2023-12-22T08:41:28.111813+0000","last_peered":"2023-12-22T08:41:28.111813+0000","last_clean":"2023-12-22T08:41:28.111813+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:41:28.111813+0000","last_undegraded":"2023-12-22T08:41:28.111813+0000","last_fullsized":"2023-12-22T08:41:28.111813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112687+0000","last_change":"2023-12-22T08:41:27.126330+0000","last_active":"2023-12-22T08:41:28.112687+0000","last_peered":"2023-12-22T08:41:28.112687+0000","last_clean":"2023-12-22T08:41:28.112687+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:41:28.112687+0000","last_undegraded":"2023-12-22T08:41:28.112687+0000","last_fullsized":"2023-12-22T08:41:28.112687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802393+0000","last_change":"2023-12-22T08:41:27.131419+0000","last_active":"2023-12-22T08:41:28.802393+0000","last_peered":"2023-12-22T08:41:28.802393+0000","last_clean":"2023-12-22T08:41:28.802393+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:41:28.802393+0000","last_undegraded":"2023-12-22T08:41:28.802393+0000","last_fullsized":"2023-12-22T08:41:28.802393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.722212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803093+0000","last_change":"2023-12-22T08:41:27.125465+0000","last_active":"2023-12-22T08:41:28.803093+0000","last_peered":"2023-12-22T08:41:28.803093+0000","last_clean":"2023-12-22T08:41:28.803093+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:41:28.803093+0000","last_undegraded":"2023-12-22T08:41:28.803093+0000","last_fullsized":"2023-12-22T08:41:28.803093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807522+0000","last_change":"2023-12-22T08:41:27.127918+0000","last_active":"2023-12-22T08:41:28.807522+0000","last_peered":"2023-12-22T08:41:28.807522+0000","last_clean":"2023-12-22T08:41:28.807522+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:41:28.807522+0000","last_undegraded":"2023-12-22T08:41:28.807522+0000","last_fullsized":"2023-12-22T08:41:28.807522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807397+0000","last_change":"2023-12-22T08:41:27.128397+0000","last_active":"2023-12-22T08:41:28.807397+0000","last_peered":"2023-12-22T08:41:28.807397+0000","last_clean":"2023-12-22T08:41:28.807397+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:41:28.807397+0000","last_undegraded":"2023-12-22T08:41:28.807397+0000","last_fullsized":"2023-12-22T08:41:28.807397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111299+0000","last_change":"2023-12-22T08:41:27.115975+0000","last_active":"2023-12-22T08:41:28.111299+0000","last_peered":"2023-12-22T08:41:28.111299+0000","last_clean":"2023-12-22T08:41:28.111299+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:41:28.111299+0000","last_undegraded":"2023-12-22T08:41:28.111299+0000","last_fullsized":"2023-12-22T08:41:28.111299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112929+0000","last_change":"2023-12-22T08:41:27.133760+0000","last_active":"2023-12-22T08:41:28.112929+0000","last_peered":"2023-12-22T08:41:28.112929+0000","last_clean":"2023-12-22T08:41:28.112929+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:41:28.112929+0000","last_undegraded":"2023-12-22T08:41:28.112929+0000","last_fullsized":"2023-12-22T08:41:28.112929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807594+0000","last_change":"2023-12-22T08:41:27.121357+0000","last_active":"2023-12-22T08:41:28.807594+0000","last_peered":"2023-12-22T08:41:28.807594+0000","last_clean":"2023-12-22T08:41:28.807594+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:41:28.807594+0000","last_undegraded":"2023-12-22T08:41:28.807594+0000","last_fullsized":"2023-12-22T08:41:28.807594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111645+0000","last_change":"2023-12-22T08:41:27.131986+0000","last_active":"2023-12-22T08:41:28.111645+0000","last_peered":"2023-12-22T08:41:28.111645+0000","last_clean":"2023-12-22T08:41:28.111645+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:41:28.111645+0000","last_undegraded":"2023-12-22T08:41:28.111645+0000","last_fullsized":"2023-12-22T08:41:28.111645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802404+0000","last_change":"2023-12-22T08:41:27.120741+0000","last_active":"2023-12-22T08:41:28.802404+0000","last_peered":"2023-12-22T08:41:28.802404+0000","last_clean":"2023-12-22T08:41:28.802404+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:28.802404+0000","last_undegraded":"2023-12-22T08:41:28.802404+0000","last_fullsized":"2023-12-22T08:41:28.802404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:46.823109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803102+0000","last_change":"2023-12-22T08:41:27.127642+0000","last_active":"2023-12-22T08:41:28.803102+0000","last_peered":"2023-12-22T08:41:28.803102+0000","last_clean":"2023-12-22T08:41:28.803102+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:28.803102+0000","last_undegraded":"2023-12-22T08:41:28.803102+0000","last_fullsized":"2023-12-22T08:41:28.803102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111013+0000","last_change":"2023-12-22T08:41:27.124240+0000","last_active":"2023-12-22T08:41:28.111013+0000","last_peered":"2023-12-22T08:41:28.111013+0000","last_clean":"2023-12-22T08:41:28.111013+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:28.111013+0000","last_undegraded":"2023-12-22T08:41:28.111013+0000","last_fullsized":"2023-12-22T08:41:28.111013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807472+0000","last_change":"2023-12-22T08:41:27.131917+0000","last_active":"2023-12-22T08:41:28.807472+0000","last_peered":"2023-12-22T08:41:28.807472+0000","last_clean":"2023-12-22T08:41:28.807472+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:41:28.807472+0000","last_undegraded":"2023-12-22T08:41:28.807472+0000","last_fullsized":"2023-12-22T08:41:28.807472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807612+0000","last_change":"2023-12-22T08:41:27.126772+0000","last_active":"2023-12-22T08:41:28.807612+0000","last_peered":"2023-12-22T08:41:28.807612+0000","last_clean":"2023-12-22T08:41:28.807612+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:28.807612+0000","last_undegraded":"2023-12-22T08:41:28.807612+0000","last_fullsized":"2023-12-22T08:41:28.807612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803173+0000","last_change":"2023-12-22T08:41:27.132073+0000","last_active":"2023-12-22T08:41:28.803173+0000","last_peered":"2023-12-22T08:41:28.803173+0000","last_clean":"2023-12-22T08:41:28.803173+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:41:28.803173+0000","last_undegraded":"2023-12-22T08:41:28.803173+0000","last_fullsized":"2023-12-22T08:41:28.803173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803140+0000","last_change":"2023-12-22T08:41:27.128462+0000","last_active":"2023-12-22T08:41:28.803140+0000","last_peered":"2023-12-22T08:41:28.803140+0000","last_clean":"2023-12-22T08:41:28.803140+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:41:28.803140+0000","last_undegraded":"2023-12-22T08:41:28.803140+0000","last_fullsized":"2023-12-22T08:41:28.803140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802424+0000","last_change":"2023-12-22T08:41:27.124709+0000","last_active":"2023-12-22T08:41:28.802424+0000","last_peered":"2023-12-22T08:41:28.802424+0000","last_clean":"2023-12-22T08:41:28.802424+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:28.802424+0000","last_undegraded":"2023-12-22T08:41:28.802424+0000","last_fullsized":"2023-12-22T08:41:28.802424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:26.745936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111759+0000","last_change":"2023-12-22T08:41:27.120855+0000","last_active":"2023-12-22T08:41:28.111759+0000","last_peered":"2023-12-22T08:41:28.111759+0000","last_clean":"2023-12-22T08:41:28.111759+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:41:28.111759+0000","last_undegraded":"2023-12-22T08:41:28.111759+0000","last_fullsized":"2023-12-22T08:41:28.111759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:04.575089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111532+0000","last_change":"2023-12-22T08:41:27.129305+0000","last_active":"2023-12-22T08:41:28.111532+0000","last_peered":"2023-12-22T08:41:28.111532+0000","last_clean":"2023-12-22T08:41:28.111532+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:41:28.111532+0000","last_undegraded":"2023-12-22T08:41:28.111532+0000","last_fullsized":"2023-12-22T08:41:28.111532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801633+0000","last_change":"2023-12-22T08:41:27.123800+0000","last_active":"2023-12-22T08:41:28.801633+0000","last_peered":"2023-12-22T08:41:28.801633+0000","last_clean":"2023-12-22T08:41:28.801633+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:28.801633+0000","last_undegraded":"2023-12-22T08:41:28.801633+0000","last_fullsized":"2023-12-22T08:41:28.801633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110929+0000","last_change":"2023-12-22T08:41:27.114600+0000","last_active":"2023-12-22T08:41:28.110929+0000","last_peered":"2023-12-22T08:41:28.110929+0000","last_clean":"2023-12-22T08:41:28.110929+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:41:28.110929+0000","last_undegraded":"2023-12-22T08:41:28.110929+0000","last_fullsized":"2023-12-22T08:41:28.110929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113130+0000","last_change":"2023-12-22T08:41:27.121608+0000","last_active":"2023-12-22T08:41:28.113130+0000","last_peered":"2023-12-22T08:41:28.113130+0000","last_clean":"2023-12-22T08:41:28.113130+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:41:28.113130+0000","last_undegraded":"2023-12-22T08:41:28.113130+0000","last_fullsized":"2023-12-22T08:41:28.113130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803181+0000","last_change":"2023-12-22T08:41:27.131698+0000","last_active":"2023-12-22T08:41:28.803181+0000","last_peered":"2023-12-22T08:41:28.803181+0000","last_clean":"2023-12-22T08:41:28.803181+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:41:28.803181+0000","last_undegraded":"2023-12-22T08:41:28.803181+0000","last_fullsized":"2023-12-22T08:41:28.803181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113081+0000","last_change":"2023-12-22T08:41:27.121328+0000","last_active":"2023-12-22T08:41:28.113081+0000","last_peered":"2023-12-22T08:41:28.113081+0000","last_clean":"2023-12-22T08:41:28.113081+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:41:28.113081+0000","last_undegraded":"2023-12-22T08:41:28.113081+0000","last_fullsized":"2023-12-22T08:41:28.113081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111750+0000","last_change":"2023-12-22T08:41:27.117153+0000","last_active":"2023-12-22T08:41:28.111750+0000","last_peered":"2023-12-22T08:41:28.111750+0000","last_clean":"2023-12-22T08:41:28.111750+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:28.111750+0000","last_undegraded":"2023-12-22T08:41:28.111750+0000","last_fullsized":"2023-12-22T08:41:28.111750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111857+0000","last_change":"2023-12-22T08:41:27.128755+0000","last_active":"2023-12-22T08:41:28.111857+0000","last_peered":"2023-12-22T08:41:28.111857+0000","last_clean":"2023-12-22T08:41:28.111857+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:41:28.111857+0000","last_undegraded":"2023-12-22T08:41:28.111857+0000","last_fullsized":"2023-12-22T08:41:28.111857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807539+0000","last_change":"2023-12-22T08:41:27.126203+0000","last_active":"2023-12-22T08:41:28.807539+0000","last_peered":"2023-12-22T08:41:28.807539+0000","last_clean":"2023-12-22T08:41:28.807539+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:41:28.807539+0000","last_undegraded":"2023-12-22T08:41:28.807539+0000","last_fullsized":"2023-12-22T08:41:28.807539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801882+0000","last_change":"2023-12-22T08:41:27.127519+0000","last_active":"2023-12-22T08:41:28.801882+0000","last_peered":"2023-12-22T08:41:28.801882+0000","last_clean":"2023-12-22T08:41:28.801882+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:41:28.801882+0000","last_undegraded":"2023-12-22T08:41:28.801882+0000","last_fullsized":"2023-12-22T08:41:28.801882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:50.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807417+0000","last_change":"2023-12-22T08:41:27.122823+0000","last_active":"2023-12-22T08:41:28.807417+0000","last_peered":"2023-12-22T08:41:28.807417+0000","last_clean":"2023-12-22T08:41:28.807417+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:41:28.807417+0000","last_undegraded":"2023-12-22T08:41:28.807417+0000","last_fullsized":"2023-12-22T08:41:28.807417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801686+0000","last_change":"2023-12-22T08:41:27.121742+0000","last_active":"2023-12-22T08:41:28.801686+0000","last_peered":"2023-12-22T08:41:28.801686+0000","last_clean":"2023-12-22T08:41:28.801686+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:28.801686+0000","last_undegraded":"2023-12-22T08:41:28.801686+0000","last_fullsized":"2023-12-22T08:41:28.801686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802016+0000","last_change":"2023-12-22T08:41:26.742786+0000","last_active":"2023-12-22T08:41:28.802016+0000","last_peered":"2023-12-22T08:41:28.802016+0000","last_clean":"2023-12-22T08:41:28.802016+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:28.802016+0000","last_undegraded":"2023-12-22T08:41:28.802016+0000","last_fullsized":"2023-12-22T08:41:28.802016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801996+0000","last_change":"2023-12-22T08:41:27.130511+0000","last_active":"2023-12-22T08:41:28.801996+0000","last_peered":"2023-12-22T08:41:28.801996+0000","last_clean":"2023-12-22T08:41:28.801996+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:41:28.801996+0000","last_undegraded":"2023-12-22T08:41:28.801996+0000","last_fullsized":"2023-12-22T08:41:28.801996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:18.765379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801698+0000","last_change":"2023-12-22T08:41:26.743569+0000","last_active":"2023-12-22T08:41:28.801698+0000","last_peered":"2023-12-22T08:41:28.801698+0000","last_clean":"2023-12-22T08:41:28.801698+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:28.801698+0000","last_undegraded":"2023-12-22T08:41:28.801698+0000","last_fullsized":"2023-12-22T08:41:28.801698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111545+0000","last_change":"2023-12-22T08:41:27.128744+0000","last_active":"2023-12-22T08:41:28.111545+0000","last_peered":"2023-12-22T08:41:28.111545+0000","last_clean":"2023-12-22T08:41:28.111545+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:41:28.111545+0000","last_undegraded":"2023-12-22T08:41:28.111545+0000","last_fullsized":"2023-12-22T08:41:28.111545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803153+0000","last_change":"2023-12-22T08:41:26.747403+0000","last_active":"2023-12-22T08:41:28.803153+0000","last_peered":"2023-12-22T08:41:28.803153+0000","last_clean":"2023-12-22T08:41:28.803153+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:28.803153+0000","last_undegraded":"2023-12-22T08:41:28.803153+0000","last_fullsized":"2023-12-22T08:41:28.803153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:17.763510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113171+0000","last_change":"2023-12-22T08:41:27.121058+0000","last_active":"2023-12-22T08:41:28.113171+0000","last_peered":"2023-12-22T08:41:28.113171+0000","last_clean":"2023-12-22T08:41:28.113171+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:41:28.113171+0000","last_undegraded":"2023-12-22T08:41:28.113171+0000","last_fullsized":"2023-12-22T08:41:28.113171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802433+0000","last_change":"2023-12-22T08:41:26.747241+0000","last_active":"2023-12-22T08:41:28.802433+0000","last_peered":"2023-12-22T08:41:28.802433+0000","last_clean":"2023-12-22T08:41:28.802433+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:28.802433+0000","last_undegraded":"2023-12-22T08:41:28.802433+0000","last_fullsized":"2023-12-22T08:41:28.802433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:52.257765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807557+0000","last_change":"2023-12-22T08:41:27.123533+0000","last_active":"2023-12-22T08:41:28.807557+0000","last_peered":"2023-12-22T08:41:28.807557+0000","last_clean":"2023-12-22T08:41:28.807557+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:41:28.807557+0000","last_undegraded":"2023-12-22T08:41:28.807557+0000","last_fullsized":"2023-12-22T08:41:28.807557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111846+0000","last_change":"2023-12-22T08:41:26.750084+0000","last_active":"2023-12-22T08:41:28.111846+0000","last_peered":"2023-12-22T08:41:28.111846+0000","last_clean":"2023-12-22T08:41:28.111846+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:41:28.111846+0000","last_undegraded":"2023-12-22T08:41:28.111846+0000","last_fullsized":"2023-12-22T08:41:28.111846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111151+0000","last_change":"2023-12-22T08:41:27.125421+0000","last_active":"2023-12-22T08:41:28.111151+0000","last_peered":"2023-12-22T08:41:28.111151+0000","last_clean":"2023-12-22T08:41:28.111151+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:41:28.111151+0000","last_undegraded":"2023-12-22T08:41:28.111151+0000","last_fullsized":"2023-12-22T08:41:28.111151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:39.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111620+0000","last_change":"2023-12-22T08:41:26.743416+0000","last_active":"2023-12-22T08:41:28.111620+0000","last_peered":"2023-12-22T08:41:28.111620+0000","last_clean":"2023-12-22T08:41:28.111620+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:41:28.111620+0000","last_undegraded":"2023-12-22T08:41:28.111620+0000","last_fullsized":"2023-12-22T08:41:28.111620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:42.994044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111016+0000","last_change":"2023-12-22T08:41:27.123904+0000","last_active":"2023-12-22T08:41:28.111016+0000","last_peered":"2023-12-22T08:41:28.111016+0000","last_clean":"2023-12-22T08:41:28.111016+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:41:28.111016+0000","last_undegraded":"2023-12-22T08:41:28.111016+0000","last_fullsized":"2023-12-22T08:41:28.111016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803073+0000","last_change":"2023-12-22T08:41:26.745648+0000","last_active":"2023-12-22T08:41:28.803073+0000","last_peered":"2023-12-22T08:41:28.803073+0000","last_clean":"2023-12-22T08:41:28.803073+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:41:28.803073+0000","last_undegraded":"2023-12-22T08:41:28.803073+0000","last_fullsized":"2023-12-22T08:41:28.803073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112566+0000","last_change":"2023-12-22T08:41:27.126166+0000","last_active":"2023-12-22T08:41:28.112566+0000","last_peered":"2023-12-22T08:41:28.112566+0000","last_clean":"2023-12-22T08:41:28.112566+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:28.112566+0000","last_undegraded":"2023-12-22T08:41:28.112566+0000","last_fullsized":"2023-12-22T08:41:28.112566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111017+0000","last_change":"2023-12-22T08:41:26.739716+0000","last_active":"2023-12-22T08:41:28.111017+0000","last_peered":"2023-12-22T08:41:28.111017+0000","last_clean":"2023-12-22T08:41:28.111017+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:28.111017+0000","last_undegraded":"2023-12-22T08:41:28.111017+0000","last_fullsized":"2023-12-22T08:41:28.111017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:25.744068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111505+0000","last_change":"2023-12-22T08:41:27.133504+0000","last_active":"2023-12-22T08:41:28.111505+0000","last_peered":"2023-12-22T08:41:28.111505+0000","last_clean":"2023-12-22T08:41:28.111505+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:41:28.111505+0000","last_undegraded":"2023-12-22T08:41:28.111505+0000","last_fullsized":"2023-12-22T08:41:28.111505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803207+0000","last_change":"2023-12-22T08:41:26.743175+0000","last_active":"2023-12-22T08:41:28.803207+0000","last_peered":"2023-12-22T08:41:28.803207+0000","last_clean":"2023-12-22T08:41:28.803207+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:28.803207+0000","last_undegraded":"2023-12-22T08:41:28.803207+0000","last_fullsized":"2023-12-22T08:41:28.803207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:03.573220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803190+0000","last_change":"2023-12-22T08:41:27.129547+0000","last_active":"2023-12-22T08:41:28.803190+0000","last_peered":"2023-12-22T08:41:28.803190+0000","last_clean":"2023-12-22T08:41:28.803190+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:41:28.803190+0000","last_undegraded":"2023-12-22T08:41:28.803190+0000","last_fullsized":"2023-12-22T08:41:28.803190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801721+0000","last_change":"2023-12-22T08:41:26.743757+0000","last_active":"2023-12-22T08:41:28.801721+0000","last_peered":"2023-12-22T08:41:28.801721+0000","last_clean":"2023-12-22T08:41:28.801721+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:28.801721+0000","last_undegraded":"2023-12-22T08:41:28.801721+0000","last_fullsized":"2023-12-22T08:41:28.801721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803120+0000","last_change":"2023-12-22T08:41:27.131773+0000","last_active":"2023-12-22T08:41:28.803120+0000","last_peered":"2023-12-22T08:41:28.803120+0000","last_clean":"2023-12-22T08:41:28.803120+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:41:28.803120+0000","last_undegraded":"2023-12-22T08:41:28.803120+0000","last_fullsized":"2023-12-22T08:41:28.803120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111905+0000","last_change":"2023-12-22T08:41:26.745597+0000","last_active":"2023-12-22T08:41:28.111905+0000","last_peered":"2023-12-22T08:41:28.111905+0000","last_clean":"2023-12-22T08:41:28.111905+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:28.111905+0000","last_undegraded":"2023-12-22T08:41:28.111905+0000","last_fullsized":"2023-12-22T08:41:28.111905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111718+0000","last_change":"2023-12-22T08:41:27.118227+0000","last_active":"2023-12-22T08:41:28.111718+0000","last_peered":"2023-12-22T08:41:28.111718+0000","last_clean":"2023-12-22T08:41:28.111718+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:41:28.111718+0000","last_undegraded":"2023-12-22T08:41:28.111718+0000","last_fullsized":"2023-12-22T08:41:28.111718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'7","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880717+0000","last_change":"2023-12-22T08:41:26.748072+0000","last_active":"2023-12-22T08:41:28.880717+0000","last_peered":"2023-12-22T08:41:28.880717+0000","last_clean":"2023-12-22T08:41:28.880717+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:28.880717+0000","last_undegraded":"2023-12-22T08:41:28.880717+0000","last_fullsized":"2023-12-22T08:41:28.880717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:05.371284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1818,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112579+0000","last_change":"2023-12-22T08:41:27.120378+0000","last_active":"2023-12-22T08:41:28.112579+0000","last_peered":"2023-12-22T08:41:28.112579+0000","last_clean":"2023-12-22T08:41:28.112579+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:28.112579+0000","last_undegraded":"2023-12-22T08:41:28.112579+0000","last_fullsized":"2023-12-22T08:41:28.112579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111924+0000","last_change":"2023-12-22T08:41:26.740501+0000","last_active":"2023-12-22T08:41:28.111924+0000","last_peered":"2023-12-22T08:41:28.111924+0000","last_clean":"2023-12-22T08:41:28.111924+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:28.111924+0000","last_undegraded":"2023-12-22T08:41:28.111924+0000","last_fullsized":"2023-12-22T08:41:28.111924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803112+0000","last_change":"2023-12-22T08:41:27.127482+0000","last_active":"2023-12-22T08:41:28.803112+0000","last_peered":"2023-12-22T08:41:28.803112+0000","last_clean":"2023-12-22T08:41:28.803112+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:41:28.803112+0000","last_undegraded":"2023-12-22T08:41:28.803112+0000","last_fullsized":"2023-12-22T08:41:28.803112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112604+0000","last_change":"2023-12-22T08:41:26.746743+0000","last_active":"2023-12-22T08:41:28.112604+0000","last_peered":"2023-12-22T08:41:28.112604+0000","last_clean":"2023-12-22T08:41:28.112604+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:28.112604+0000","last_undegraded":"2023-12-22T08:41:28.112604+0000","last_fullsized":"2023-12-22T08:41:28.112604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807455+0000","last_change":"2023-12-22T08:41:27.123864+0000","last_active":"2023-12-22T08:41:28.807455+0000","last_peered":"2023-12-22T08:41:28.807455+0000","last_clean":"2023-12-22T08:41:28.807455+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:41:28.807455+0000","last_undegraded":"2023-12-22T08:41:28.807455+0000","last_fullsized":"2023-12-22T08:41:28.807455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803082+0000","last_change":"2023-12-22T08:41:26.742515+0000","last_active":"2023-12-22T08:41:28.803082+0000","last_peered":"2023-12-22T08:41:28.803082+0000","last_clean":"2023-12-22T08:41:28.803082+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:28.803082+0000","last_undegraded":"2023-12-22T08:41:28.803082+0000","last_fullsized":"2023-12-22T08:41:28.803082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:32.527496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801907+0000","last_change":"2023-12-22T08:41:27.122673+0000","last_active":"2023-12-22T08:41:28.801907+0000","last_peered":"2023-12-22T08:41:28.801907+0000","last_clean":"2023-12-22T08:41:28.801907+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:41:28.801907+0000","last_undegraded":"2023-12-22T08:41:28.801907+0000","last_fullsized":"2023-12-22T08:41:28.801907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:06.373152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803052+0000","last_change":"2023-12-22T08:41:26.748785+0000","last_active":"2023-12-22T08:41:28.803052+0000","last_peered":"2023-12-22T08:41:28.803052+0000","last_clean":"2023-12-22T08:41:28.803052+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:41:28.803052+0000","last_undegraded":"2023-12-22T08:41:28.803052+0000","last_fullsized":"2023-12-22T08:41:28.803052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111273+0000","last_change":"2023-12-22T08:41:27.118299+0000","last_active":"2023-12-22T08:41:28.111273+0000","last_peered":"2023-12-22T08:41:28.111273+0000","last_clean":"2023-12-22T08:41:28.111273+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:41:28.111273+0000","last_undegraded":"2023-12-22T08:41:28.111273+0000","last_fullsized":"2023-12-22T08:41:28.111273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113208+0000","last_change":"2023-12-22T08:41:26.751813+0000","last_active":"2023-12-22T08:41:28.113208+0000","last_peered":"2023-12-22T08:41:28.113208+0000","last_clean":"2023-12-22T08:41:28.113208+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:28.113208+0000","last_undegraded":"2023-12-22T08:41:28.113208+0000","last_fullsized":"2023-12-22T08:41:28.113208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111455+0000","last_change":"2023-12-22T08:41:27.122998+0000","last_active":"2023-12-22T08:41:28.111455+0000","last_peered":"2023-12-22T08:41:28.111455+0000","last_clean":"2023-12-22T08:41:28.111455+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:41:28.111455+0000","last_undegraded":"2023-12-22T08:41:28.111455+0000","last_fullsized":"2023-12-22T08:41:28.111455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111193+0000","last_change":"2023-12-22T08:41:26.740945+0000","last_active":"2023-12-22T08:41:28.111193+0000","last_peered":"2023-12-22T08:41:28.111193+0000","last_clean":"2023-12-22T08:41:28.111193+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:41:28.111193+0000","last_undegraded":"2023-12-22T08:41:28.111193+0000","last_fullsized":"2023-12-22T08:41:28.111193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112745+0000","last_change":"2023-12-22T08:41:27.125917+0000","last_active":"2023-12-22T08:41:28.112745+0000","last_peered":"2023-12-22T08:41:28.112745+0000","last_clean":"2023-12-22T08:41:28.112745+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:41:28.112745+0000","last_undegraded":"2023-12-22T08:41:28.112745+0000","last_fullsized":"2023-12-22T08:41:28.112745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111940+0000","last_change":"2023-12-22T08:41:26.743117+0000","last_active":"2023-12-22T08:41:28.111940+0000","last_peered":"2023-12-22T08:41:28.111940+0000","last_clean":"2023-12-22T08:41:28.111940+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:41:28.111940+0000","last_undegraded":"2023-12-22T08:41:28.111940+0000","last_fullsized":"2023-12-22T08:41:28.111940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802452+0000","last_change":"2023-12-22T08:41:27.125969+0000","last_active":"2023-12-22T08:41:28.802452+0000","last_peered":"2023-12-22T08:41:28.802452+0000","last_clean":"2023-12-22T08:41:28.802452+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:28.802452+0000","last_undegraded":"2023-12-22T08:41:28.802452+0000","last_fullsized":"2023-12-22T08:41:28.802452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:34.167113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111633+0000","last_change":"2023-12-22T08:41:26.744095+0000","last_active":"2023-12-22T08:41:28.111633+0000","last_peered":"2023-12-22T08:41:28.111633+0000","last_clean":"2023-12-22T08:41:28.111633+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:41:28.111633+0000","last_undegraded":"2023-12-22T08:41:28.111633+0000","last_fullsized":"2023-12-22T08:41:28.111633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:11.707505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802382+0000","last_change":"2023-12-22T08:41:27.125387+0000","last_active":"2023-12-22T08:41:28.802382+0000","last_peered":"2023-12-22T08:41:28.802382+0000","last_clean":"2023-12-22T08:41:28.802382+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:28.802382+0000","last_undegraded":"2023-12-22T08:41:28.802382+0000","last_fullsized":"2023-12-22T08:41:28.802382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:31.788205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801658+0000","last_change":"2023-12-22T08:41:26.747215+0000","last_active":"2023-12-22T08:41:28.801658+0000","last_peered":"2023-12-22T08:41:28.801658+0000","last_clean":"2023-12-22T08:41:28.801658+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:28.801658+0000","last_undegraded":"2023-12-22T08:41:28.801658+0000","last_fullsized":"2023-12-22T08:41:28.801658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802415+0000","last_change":"2023-12-22T08:41:27.122152+0000","last_active":"2023-12-22T08:41:28.802415+0000","last_peered":"2023-12-22T08:41:28.802415+0000","last_clean":"2023-12-22T08:41:28.802415+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:28.802415+0000","last_undegraded":"2023-12-22T08:41:28.802415+0000","last_fullsized":"2023-12-22T08:41:28.802415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.709373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801943+0000","last_change":"2023-12-22T08:41:26.746895+0000","last_active":"2023-12-22T08:41:28.801943+0000","last_peered":"2023-12-22T08:41:28.801943+0000","last_clean":"2023-12-22T08:41:28.801943+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:28.801943+0000","last_undegraded":"2023-12-22T08:41:28.801943+0000","last_fullsized":"2023-12-22T08:41:28.801943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802368+0000","last_change":"2023-12-22T08:41:27.121179+0000","last_active":"2023-12-22T08:41:28.802368+0000","last_peered":"2023-12-22T08:41:28.802368+0000","last_clean":"2023-12-22T08:41:28.802368+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:28.802368+0000","last_undegraded":"2023-12-22T08:41:28.802368+0000","last_fullsized":"2023-12-22T08:41:28.802368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:53.573498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111334+0000","last_change":"2023-12-22T08:41:26.744242+0000","last_active":"2023-12-22T08:41:28.111334+0000","last_peered":"2023-12-22T08:41:28.111334+0000","last_clean":"2023-12-22T08:41:28.111334+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:28.111334+0000","last_undegraded":"2023-12-22T08:41:28.111334+0000","last_fullsized":"2023-12-22T08:41:28.111334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807504+0000","last_change":"2023-12-22T08:41:27.125910+0000","last_active":"2023-12-22T08:41:28.807504+0000","last_peered":"2023-12-22T08:41:28.807504+0000","last_clean":"2023-12-22T08:41:28.807504+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:41:28.807504+0000","last_undegraded":"2023-12-22T08:41:28.807504+0000","last_fullsized":"2023-12-22T08:41:28.807504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110836+0000","last_change":"2023-12-22T08:41:26.747152+0000","last_active":"2023-12-22T08:41:28.110836+0000","last_peered":"2023-12-22T08:41:28.110836+0000","last_clean":"2023-12-22T08:41:28.110836+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:28.110836+0000","last_undegraded":"2023-12-22T08:41:28.110836+0000","last_fullsized":"2023-12-22T08:41:28.110836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802474+0000","last_change":"2023-12-22T08:41:27.122069+0000","last_active":"2023-12-22T08:41:28.802474+0000","last_peered":"2023-12-22T08:41:28.802474+0000","last_clean":"2023-12-22T08:41:28.802474+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:28.802474+0000","last_undegraded":"2023-12-22T08:41:28.802474+0000","last_fullsized":"2023-12-22T08:41:28.802474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:04.235137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113220+0000","last_change":"2023-12-22T08:41:26.748464+0000","last_active":"2023-12-22T08:41:28.113220+0000","last_peered":"2023-12-22T08:41:28.113220+0000","last_clean":"2023-12-22T08:41:28.113220+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:28.113220+0000","last_undegraded":"2023-12-22T08:41:28.113220+0000","last_fullsized":"2023-12-22T08:41:28.113220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111578+0000","last_change":"2023-12-22T08:41:27.117970+0000","last_active":"2023-12-22T08:41:28.111578+0000","last_peered":"2023-12-22T08:41:28.111578+0000","last_clean":"2023-12-22T08:41:28.111578+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:41:28.111578+0000","last_undegraded":"2023-12-22T08:41:28.111578+0000","last_fullsized":"2023-12-22T08:41:28.111578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.885010+0000","last_change":"2023-12-22T08:41:26.744425+0000","last_active":"2023-12-22T08:41:29.885010+0000","last_peered":"2023-12-22T08:41:29.885010+0000","last_clean":"2023-12-22T08:41:29.885010+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:29.885010+0000","last_undegraded":"2023-12-22T08:41:29.885010+0000","last_fullsized":"2023-12-22T08:41:29.885010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:17.007353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801677+0000","last_change":"2023-12-22T08:41:27.121596+0000","last_active":"2023-12-22T08:41:28.801677+0000","last_peered":"2023-12-22T08:41:28.801677+0000","last_clean":"2023-12-22T08:41:28.801677+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:28.801677+0000","last_undegraded":"2023-12-22T08:41:28.801677+0000","last_fullsized":"2023-12-22T08:41:28.801677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112784+0000","last_change":"2023-12-22T08:41:26.748558+0000","last_active":"2023-12-22T08:41:28.112784+0000","last_peered":"2023-12-22T08:41:28.112784+0000","last_clean":"2023-12-22T08:41:28.112784+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:28.112784+0000","last_undegraded":"2023-12-22T08:41:28.112784+0000","last_fullsized":"2023-12-22T08:41:28.112784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801927+0000","last_change":"2023-12-22T08:41:27.124314+0000","last_active":"2023-12-22T08:41:28.801927+0000","last_peered":"2023-12-22T08:41:28.801927+0000","last_clean":"2023-12-22T08:41:28.801927+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:28.801927+0000","last_undegraded":"2023-12-22T08:41:28.801927+0000","last_fullsized":"2023-12-22T08:41:28.801927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:18.009221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801668+0000","last_change":"2023-12-22T08:41:26.740301+0000","last_active":"2023-12-22T08:41:28.801668+0000","last_peered":"2023-12-22T08:41:28.801668+0000","last_clean":"2023-12-22T08:41:28.801668+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:28.801668+0000","last_undegraded":"2023-12-22T08:41:28.801668+0000","last_fullsized":"2023-12-22T08:41:28.801668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801647+0000","last_change":"2023-12-22T08:41:27.121048+0000","last_active":"2023-12-22T08:41:28.801647+0000","last_peered":"2023-12-22T08:41:28.801647+0000","last_clean":"2023-12-22T08:41:28.801647+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:28.801647+0000","last_undegraded":"2023-12-22T08:41:28.801647+0000","last_fullsized":"2023-12-22T08:41:28.801647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112660+0000","last_change":"2023-12-22T08:41:26.747176+0000","last_active":"2023-12-22T08:41:28.112660+0000","last_peered":"2023-12-22T08:41:28.112660+0000","last_clean":"2023-12-22T08:41:28.112660+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:28.112660+0000","last_undegraded":"2023-12-22T08:41:28.112660+0000","last_fullsized":"2023-12-22T08:41:28.112660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803023+0000","last_change":"2023-12-22T08:41:27.122915+0000","last_active":"2023-12-22T08:41:28.803023+0000","last_peered":"2023-12-22T08:41:28.803023+0000","last_clean":"2023-12-22T08:41:28.803023+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:41:28.803023+0000","last_undegraded":"2023-12-22T08:41:28.803023+0000","last_fullsized":"2023-12-22T08:41:28.803023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:27.533832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111422+0000","last_change":"2023-12-22T08:41:26.739638+0000","last_active":"2023-12-22T08:41:28.111422+0000","last_peered":"2023-12-22T08:41:28.111422+0000","last_clean":"2023-12-22T08:41:28.111422+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:28.111422+0000","last_undegraded":"2023-12-22T08:41:28.111422+0000","last_fullsized":"2023-12-22T08:41:28.111422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:03.233269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111243+0000","last_change":"2023-12-22T08:41:27.131013+0000","last_active":"2023-12-22T08:41:28.111243+0000","last_peered":"2023-12-22T08:41:28.111243+0000","last_clean":"2023-12-22T08:41:28.111243+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:41:28.111243+0000","last_undegraded":"2023-12-22T08:41:28.111243+0000","last_fullsized":"2023-12-22T08:41:28.111243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803063+0000","last_change":"2023-12-22T08:41:26.745042+0000","last_active":"2023-12-22T08:41:28.803063+0000","last_peered":"2023-12-22T08:41:28.803063+0000","last_clean":"2023-12-22T08:41:28.803063+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:28.803063+0000","last_undegraded":"2023-12-22T08:41:28.803063+0000","last_fullsized":"2023-12-22T08:41:28.803063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807574+0000","last_change":"2023-12-22T08:41:27.128761+0000","last_active":"2023-12-22T08:41:28.807574+0000","last_peered":"2023-12-22T08:41:28.807574+0000","last_clean":"2023-12-22T08:41:28.807574+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:28.807574+0000","last_undegraded":"2023-12-22T08:41:28.807574+0000","last_fullsized":"2023-12-22T08:41:28.807574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801962+0000","last_change":"2023-12-22T08:41:26.742603+0000","last_active":"2023-12-22T08:41:28.801962+0000","last_peered":"2023-12-22T08:41:28.801962+0000","last_clean":"2023-12-22T08:41:28.801962+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:28.801962+0000","last_undegraded":"2023-12-22T08:41:28.801962+0000","last_fullsized":"2023-12-22T08:41:28.801962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.117407+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:41:27.117407+0000","last_peered":"2023-12-22T08:41:27.117407+0000","last_clean":"2023-12-22T08:41:27.117407+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:27.117407+0000","last_undegraded":"2023-12-22T08:41:27.117407+0000","last_fullsized":"2023-12-22T08:41:27.117407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2616,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":136102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":136102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.377},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.31}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.433},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.75800000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:41:39.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T08:41:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.754+0000 7fef024db640 1 Processor -- start 2023-12-22T08:41:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.754+0000 7fef024db640 1 -- start start 2023-12-22T08:41:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7fef024db640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feefc06a6d0 0x7feefc14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7fef024db640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7feefc0ba550 0x7feefc1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7fef024db640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc0bb310 con 0x7feefc14b1f0 2023-12-22T08:41:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7fef024db640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0bf960 con 0x7feefc06a6d0 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7fef024db640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0bb5b0 con 0x7feefc0ba550 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7feefbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feefc06a6d0 0x7feefc14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7feefbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feefc06a6d0 0x7feefc14acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45862/0 (socket says 172.21.15.31:45862) 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7feefbfff640 1 -- 172.21.15.31:0/1603762615 learned_addr learned my addr 172.21.15.31:0/1603762615 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7fef00a78640 1 --2- 172.21.15.31:0/1603762615 >> v2:172.21.15.69:3300/0 conn(0x7feefc0ba550 0x7feefc1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7feefbfff640 1 -- 172.21.15.31:0/1603762615 >> v2:172.21.15.69:3300/0 conn(0x7feefc0ba550 msgr2=0x7feefc1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7feefbfff640 1 --2- 172.21.15.31:0/1603762615 >> v2:172.21.15.69:3300/0 conn(0x7feefc0ba550 0x7feefc1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7feefbfff640 1 -- 172.21.15.31:0/1603762615 >> v1:172.21.15.69:6789/0 conn(0x7feefc14b1f0 legacy=0x7feefc0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7feefbfff640 1 -- 172.21.15.31:0/1603762615 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0c0120 con 0x7feefc06a6d0 2023-12-22T08:41:39.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.755+0000 7fef00a78640 1 --2- 172.21.15.31:0/1603762615 >> v2:172.21.15.69:3300/0 conn(0x7feefc0ba550 0x7feefc1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.756+0000 7feefbfff640 1 --2- 172.21.15.31:0/1603762615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc06a6d0 0x7feefc14acb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feefc09fcb0 tx=0x7feef002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf08e7d96772df4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.756+0000 7feefaffd640 1 -- 172.21.15.31:0/1603762615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0031870 con 0x7feefc06a6d0 2023-12-22T08:41:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.756+0000 7feefaffd640 1 -- 172.21.15.31:0/1603762615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef00319d0 con 0x7feefc06a6d0 2023-12-22T08:41:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.756+0000 7feefaffd640 1 -- 172.21.15.31:0/1603762615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0031d60 con 0x7feefc06a6d0 2023-12-22T08:41:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.757+0000 7fef024db640 1 -- 172.21.15.31:0/1603762615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc06a6d0 msgr2=0x7feefc14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.757+0000 7fef024db640 1 --2- 172.21.15.31:0/1603762615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc06a6d0 0x7feefc14acb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7feefc09fcb0 tx=0x7feef002b910 comp rx=0 tx=0).stop 2023-12-22T08:41:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.757+0000 7fef024db640 1 -- 172.21.15.31:0/1603762615 shutdown_connections 2023-12-22T08:41:39.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.757+0000 7fef024db640 1 --2- 172.21.15.31:0/1603762615 >> v2:172.21.15.69:3300/0 conn(0x7feefc0ba550 0x7feefc1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.757+0000 7fef024db640 1 --2- 172.21.15.31:0/1603762615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc06a6d0 0x7feefc14acb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.757+0000 7fef024db640 1 -- 172.21.15.31:0/1603762615 >> 172.21.15.31:0/1603762615 conn(0x7feefc0c0350 msgr2=0x7feefc0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.757+0000 7fef024db640 1 -- 172.21.15.31:0/1603762615 shutdown_connections 2023-12-22T08:41:39.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.757+0000 7fef024db640 1 -- 172.21.15.31:0/1603762615 wait complete. 2023-12-22T08:41:39.764 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.758+0000 7fef024db640 1 Processor -- start 2023-12-22T08:41:39.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.758+0000 7fef024db640 1 -- start start 2023-12-22T08:41:39.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.758+0000 7fef024db640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feefc06a6d0 0x7feefc1e0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.758+0000 7fef024db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc0ba550 0x7feefc14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.758+0000 7fef024db640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feefc14b1f0 0x7feefc14c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.758+0000 7fef024db640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc14c900 con 0x7feefc0ba550 2023-12-22T08:41:39.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.758+0000 7fef024db640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc1e06a0 con 0x7feefc14b1f0 2023-12-22T08:41:39.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.758+0000 7fef024db640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc1e0960 con 0x7feefc06a6d0 2023-12-22T08:41:39.765 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc0ba550 0x7feefc14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc0ba550 0x7feefc14be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45870/0 (socket says 172.21.15.31:45870) 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 -- 172.21.15.31:0/1451309631 learned_addr learned my addr 172.21.15.31:0/1451309631 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7fef00a78640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feefc14b1f0 0x7feefc14c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefbfff640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feefc06a6d0 0x7feefc1e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 -- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feefc06a6d0 msgr2=0x7feefc1e0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feefc06a6d0 0x7feefc1e0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 -- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feefc14b1f0 msgr2=0x7feefc14c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feefc14b1f0 0x7feefc14c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.766 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 -- 172.21.15.31:0/1451309631 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00094d0 con 0x7feefc0ba550 2023-12-22T08:41:39.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefbfff640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feefc06a6d0 0x7feefc1e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:39.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feefb7fe640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc0ba550 0x7feefc14be80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feeec00b3c0 tx=0x7feeec00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feef8ff9640 1 -- 172.21.15.31:0/1451309631 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec011830 con 0x7feefc0ba550 2023-12-22T08:41:39.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feef8ff9640 1 -- 172.21.15.31:0/1451309631 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec011990 con 0x7feefc0ba550 2023-12-22T08:41:39.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc1e0df0 con 0x7feefc0ba550 2023-12-22T08:41:39.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7feef8ff9640 1 -- 172.21.15.31:0/1451309631 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec011d40 con 0x7feefc0ba550 2023-12-22T08:41:39.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.759+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc14ef90 con 0x7feefc0ba550 2023-12-22T08:41:39.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.760+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc0bacf0 con 0x7feefc0ba550 2023-12-22T08:41:39.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.761+0000 7feef8ff9640 1 -- 172.21.15.31:0/1451309631 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feeec01b460 con 0x7feefc0ba550 2023-12-22T08:41:39.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.761+0000 7feef8ff9640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feee806a460 0x7feee806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:39.768 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.761+0000 7feef8ff9640 1 -- 172.21.15.31:0/1451309631 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeec088570 con 0x7feefc0ba550 2023-12-22T08:41:39.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.761+0000 7feefbfff640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feee806a460 0x7feee806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:39.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.762+0000 7feefbfff640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feee806a460 0x7feee806c920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feef0036000 tx=0x7feef003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:39.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.765+0000 7feef8ff9640 1 -- 172.21.15.31:0/1451309631 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7feeec053b60 con 0x7feefc0ba550 2023-12-22T08:41:39.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.945+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feefc073a40 con 0x7feefc0ba550 2023-12-22T08:41:39.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.946+0000 7feef8ff9640 1 -- 172.21.15.31:0/1451309631 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7feeec057180 con 0x7feefc0ba550 2023-12-22T08:41:39.948 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:39.948 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"fsid":"e4a54bac-4042-4984-af5f-75635705de5c","created":"2023-12-22T08:40:21.725042+0000","modified":"2023-12-22T08:41:28.105217+0000","last_up_change":"2023-12-22T08:40:32.852742+0000","last_in_change":"2023-12-22T08:40:23.986727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-22T08:40:33.839141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-22T08:41:24.856244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-22T08:41:26.086679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73bbab90-3a3c-4844-81e9-e85e6938f760","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":120299},{"type":"v1","addr":"172.21.15.31:6801","nonce":120299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":120299},{"type":"v1","addr":"172.21.15.31:6803","nonce":120299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":120299},{"type":"v1","addr":"172.21.15.31:6807","nonce":120299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":120299},{"type":"v1","addr":"172.21.15.31:6805","nonce":120299}]},"public_addr":"172.21.15.31:6801/120299","cluster_addr":"172.21.15.31:6803/120299","heartbeat_back_addr":"172.21.15.31:6807/120299","heartbeat_front_addr":"172.21.15.31:6805/120299","state":["exists","up"]},{"osd":1,"uuid":"1f73a722-71ce-4761-be63-24052f045111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":120301},{"type":"v1","addr":"172.21.15.31:6815","nonce":120301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":120301},{"type":"v1","addr":"172.21.15.31:6818","nonce":120301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":120301},{"type":"v1","addr":"172.21.15.31:6823","nonce":120301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":120301},{"type":"v1","addr":"172.21.15.31:6821","nonce":120301}]},"public_addr":"172.21.15.31:6815/120301","cluster_addr":"172.21.15.31:6818/120301","heartbeat_back_addr":"172.21.15.31:6823/120301","heartbeat_front_addr":"172.21.15.31:6821/120301","state":["exists","up"]},{"osd":2,"uuid":"8489b4d7-5dfc-4d5d-9b44-008d0a30caeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":120310},{"type":"v1","addr":"172.21.15.31:6825","nonce":120310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":120310},{"type":"v1","addr":"172.21.15.31:6827","nonce":120310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":120310},{"type":"v1","addr":"172.21.15.31:6831","nonce":120310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":120310},{"type":"v1","addr":"172.21.15.31:6829","nonce":120310}]},"public_addr":"172.21.15.31:6825/120310","cluster_addr":"172.21.15.31:6827/120310","heartbeat_back_addr":"172.21.15.31:6831/120310","heartbeat_front_addr":"172.21.15.31:6829/120310","state":["exists","up"]},{"osd":3,"uuid":"08a73907-f641-4405-8fd1-91dc2cd5c200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":120300},{"type":"v1","addr":"172.21.15.31:6809","nonce":120300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":120300},{"type":"v1","addr":"172.21.15.31:6811","nonce":120300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":120300},{"type":"v1","addr":"172.21.15.31:6819","nonce":120300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":120300},{"type":"v1","addr":"172.21.15.31:6814","nonce":120300}]},"public_addr":"172.21.15.31:6809/120300","cluster_addr":"172.21.15.31:6811/120300","heartbeat_back_addr":"172.21.15.31:6819/120300","heartbeat_front_addr":"172.21.15.31:6814/120300","state":["exists","up"]},{"osd":4,"uuid":"627c34fc-9601-4362-a7b9-419ab1465a19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":120280},{"type":"v1","addr":"172.21.15.69:6801","nonce":120280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":120280},{"type":"v1","addr":"172.21.15.69:6803","nonce":120280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":120280},{"type":"v1","addr":"172.21.15.69:6807","nonce":120280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":120280},{"type":"v1","addr":"172.21.15.69:6805","nonce":120280}]},"public_addr":"172.21.15.69:6801/120280","cluster_addr":"172.21.15.69:6803/120280","heartbeat_back_addr":"172.21.15.69:6807/120280","heartbeat_front_addr":"172.21.15.69:6805/120280","state":["exists","up"]},{"osd":5,"uuid":"e071a2d4-d0bf-401c-8cd1-73106bd306e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":120281},{"type":"v1","addr":"172.21.15.69:6809","nonce":120281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":120281},{"type":"v1","addr":"172.21.15.69:6811","nonce":120281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":120281},{"type":"v1","addr":"172.21.15.69:6815","nonce":120281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":120281},{"type":"v1","addr":"172.21.15.69:6813","nonce":120281}]},"public_addr":"172.21.15.69:6809/120281","cluster_addr":"172.21.15.69:6811/120281","heartbeat_back_addr":"172.21.15.69:6815/120281","heartbeat_front_addr":"172.21.15.69:6813/120281","state":["exists","up"]},{"osd":6,"uuid":"c48886a0-c0ab-459e-9bcb-0eafc32700d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":120298},{"type":"v1","addr":"172.21.15.69:6817","nonce":120298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":120298},{"type":"v1","addr":"172.21.15.69:6819","nonce":120298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":120298},{"type":"v1","addr":"172.21.15.69:6823","nonce":120298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":120298},{"type":"v1","addr":"172.21.15.69:6821","nonce":120298}]},"public_addr":"172.21.15.69:6817/120298","cluster_addr":"172.21.15.69:6819/120298","heartbeat_back_addr":"172.21.15.69:6823/120298","heartbeat_front_addr":"172.21.15.69:6821/120298","state":["exists","up"]},{"osd":7,"uuid":"c33fbb46-4bcb-4d82-92b5-46d94c9e2bcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":120311},{"type":"v1","addr":"172.21.15.69:6825","nonce":120311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":120311},{"type":"v1","addr":"172.21.15.69:6827","nonce":120311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":120311},{"type":"v1","addr":"172.21.15.69:6831","nonce":120311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":120311},{"type":"v1","addr":"172.21.15.69:6829","nonce":120311}]},"public_addr":"172.21.15.69:6825/120311","cluster_addr":"172.21.15.69:6827/120311","heartbeat_back_addr":"172.21.15.69:6831/120311","heartbeat_front_addr":"172.21.15.69:6829/120311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.097686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.107555+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.218495+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.208397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.079298+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.155293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.186577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T08:40:29.188569+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T08:41:39.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feee806a460 msgr2=0x7feee806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feee806a460 0x7feee806c920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feef0036000 tx=0x7feef003c040 comp rx=0 tx=0).stop 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc0ba550 msgr2=0x7feefc14be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc0ba550 0x7feefc14be80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7feeec00b3c0 tx=0x7feeec00b880 comp rx=0 tx=0).stop 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 shutdown_connections 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7feee806a460 0x7feee806c920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feefc14b1f0 0x7feefc14c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feefc0ba550 0x7feefc14be80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 --2- 172.21.15.31:0/1451309631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feefc06a6d0 0x7feefc1e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 >> 172.21.15.31:0/1451309631 conn(0x7feefc0c0350 msgr2=0x7feefc09fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:39.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 shutdown_connections 2023-12-22T08:41:39.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:39.948+0000 7fef024db640 1 -- 172.21.15.31:0/1451309631 wait complete. 2023-12-22T08:41:40.962 INFO:tasks.ceph:Scrubbing osd.0 2023-12-22T08:41:40.962 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:41:41.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.082+0000 7f6304563640 1 Processor -- start 2023-12-22T08:41:41.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.082+0000 7f6304563640 1 -- start start 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f6304563640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc14aa00 0x7f62fc0bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f6304563640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62fc0bacc0 con 0x7f62fc0b79f0 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f6304563640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62fc0bbe60 con 0x7f62fc140ef0 2023-12-22T08:41:41.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f6304563640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0bbca0 con 0x7f62fc14aa00 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63022ff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f62fc0b79f0 0x7f62fc0b83a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33612/0 (socket says 172.21.15.31:33612) 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63022ff640 1 -- 172.21.15.31:0/4231054310 learned_addr learned my addr 172.21.15.31:0/4231054310 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f6301afe640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc14aa00 0x7f62fc0bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713479135 0 0) 0x7f62fc0bacc0 con 0x7f62fc0b79f0 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e8003520 con 0x7f62fc0b79f0 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3947609958 0 0) 0x7f62e8003520 con 0x7f62fc0b79f0 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc14aa00 msgr2=0x7f62fc0bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63012fd640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc14aa00 0x7f62fc0bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 >> v1:172.21.15.69:6789/0 conn(0x7f62fc140ef0 legacy=0x7f62fc141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.083+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0b8bc0 con 0x7f62fc0b79f0 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f62f8001670 con 0x7f62fc0b79f0 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 >> v1:172.21.15.31:6789/0 conn(0x7f62fc0b79f0 legacy=0x7f62fc0b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63012fd640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc14aa00 0x7f62e80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63012fd640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8003f20 0x7f62e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63012fd640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e8004d00 0x7f62e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e800bac0 con 0x7f62e8004d00 2023-12-22T08:41:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e800bc30 con 0x7f62e8003f20 2023-12-22T08:41:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e800bdf0 con 0x7f62fc14aa00 2023-12-22T08:41:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f6302b00640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e8004d00 0x7f62e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f63022ff640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc14aa00 0x7f62e80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f6301afe640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8003f20 0x7f62e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f6302b00640 1 -- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc14aa00 msgr2=0x7f62e80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f6302b00640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc14aa00 0x7f62e80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f6302b00640 1 -- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8003f20 msgr2=0x7f62e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f6302b00640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8003f20 0x7f62e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.084+0000 7f6302b00640 1 -- 172.21.15.31:0/4231054310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8003520 con 0x7f62e8004d00 2023-12-22T08:41:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.085+0000 7f6302b00640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e8004d00 0x7f62e8005180 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62f4001e50 tx=0x7f62e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6516648dadef2956 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.085+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4003b70 con 0x7f62e8004d00 2023-12-22T08:41:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.085+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f4003cd0 con 0x7f62e8004d00 2023-12-22T08:41:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.085+0000 7f63012fd640 1 -- 172.21.15.31:0/4231054310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4005310 con 0x7f62e8004d00 2023-12-22T08:41:41.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.086+0000 7f6304563640 1 -- 172.21.15.31:0/4231054310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e8004d00 msgr2=0x7f62e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.086+0000 7f6304563640 1 --2- 172.21.15.31:0/4231054310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e8004d00 0x7f62e8005180 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f62f4001e50 tx=0x7f62e80057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.086+0000 7f6302b00640 1 -- 172.21.15.31:0/4231054310 reap_dead start 2023-12-22T08:41:41.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.086+0000 7f6304563640 1 -- 172.21.15.31:0/4231054310 shutdown_connections 2023-12-22T08:41:41.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.086+0000 7f6304563640 1 -- 172.21.15.31:0/4231054310 >> 172.21.15.31:0/4231054310 conn(0x7f62fc0c0340 msgr2=0x7f62fc0c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.086+0000 7f6304563640 1 -- 172.21.15.31:0/4231054310 shutdown_connections 2023-12-22T08:41:41.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.086+0000 7f6304563640 1 -- 172.21.15.31:0/4231054310 wait complete. 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.087+0000 7f6304563640 1 Processor -- start 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.087+0000 7f6304563640 1 -- start start 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.087+0000 7f6304563640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8004d00 0x7f62fc13baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6304563640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc142d40 0x7f62fc1436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6304563640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc143bf0 0x7f62fc139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6304563640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc13c030 con 0x7f62fc142d40 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6304563640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc144600 con 0x7f62e8004d00 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6304563640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc141e00 con 0x7f62fc143bf0 2023-12-22T08:41:41.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc142d40 0x7f62fc1436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc142d40 0x7f62fc1436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45878/0 (socket says 172.21.15.31:45878) 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 -- 172.21.15.31:0/2383304652 learned_addr learned my addr 172.21.15.31:0/2383304652 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f63022ff640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8004d00 0x7f62fc13baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6302b00640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc143bf0 0x7f62fc139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 -- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc143bf0 msgr2=0x7f62fc139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62fc143bf0 0x7f62fc139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 -- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8004d00 msgr2=0x7f62fc13baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8004d00 0x7f62fc13baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 -- 172.21.15.31:0/2383304652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc144870 con 0x7f62fc142d40 2023-12-22T08:41:41.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f63022ff640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e8004d00 0x7f62fc13baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:41.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6301afe640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc142d40 0x7f62fc1436b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62ec011940 tx=0x7f62ec011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004240 con 0x7f62fc142d40 2023-12-22T08:41:41.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec0043c0 con 0x7f62fc142d40 2023-12-22T08:41:41.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc143290 con 0x7f62fc142d40 2023-12-22T08:41:41.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00fb20 con 0x7f62fc142d40 2023-12-22T08:41:41.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.088+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc141ab0 con 0x7f62fc142d40 2023-12-22T08:41:41.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.089+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62fc0bb240 con 0x7f62fc142d40 2023-12-22T08:41:41.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.090+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62ec00fc80 con 0x7f62fc142d40 2023-12-22T08:41:41.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.090+0000 7f62f2ffd640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f62e006a430 0x7f62e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.090+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62ec088fb0 con 0x7f62fc142d40 2023-12-22T08:41:41.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.090+0000 7f63022ff640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f62e006a430 0x7f62e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.090+0000 7f62f2ffd640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f62e00725d0 0x7f62e00749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.090+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 --> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62e00750a0 con 0x7f62e00725d0 2023-12-22T08:41:41.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.090+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62ec08b610 con 0x7f62fc142d40 2023-12-22T08:41:41.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.090+0000 7f6302b00640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f62e00725d0 0x7f62e00749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.091+0000 7f63022ff640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f62e006a430 0x7f62e006c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f62f8007d80 tx=0x7f62f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.091+0000 7f6302b00640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f62e00725d0 0x7f62e00749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.091+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 <== osd.0 v2:172.21.15.31:6800/120299 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f62e00750a0 con 0x7f62e00725d0 2023-12-22T08:41:41.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.104+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 --> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62fc0baf60 con 0x7f62e00725d0 2023-12-22T08:41:41.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.104+0000 7f62f2ffd640 1 -- 172.21.15.31:0/2383304652 <== osd.0 v2:172.21.15.31:6800/120299 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f62f403f040 con 0x7f62e00725d0 2023-12-22T08:41:41.107 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:41.107 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T08:41:41.107 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:41.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f62e00725d0 msgr2=0x7f62e00749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.31:6800/120299,v1:172.21.15.31:6801/120299] conn(0x7f62e00725d0 0x7f62e00749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f62e006a430 msgr2=0x7f62e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f62e006a430 0x7f62e006c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f62f8007d80 tx=0x7f62f8009040 comp rx=0 tx=0).stop 2023-12-22T08:41:41.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc142d40 msgr2=0x7f62fc1436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 --2- 172.21.15.31:0/2383304652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc142d40 0x7f62fc1436b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62ec011940 tx=0x7f62ec011e00 comp rx=0 tx=0).stop 2023-12-22T08:41:41.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6302b00640 1 -- 172.21.15.31:0/2383304652 reap_dead start 2023-12-22T08:41:41.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 shutdown_connections 2023-12-22T08:41:41.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 >> 172.21.15.31:0/2383304652 conn(0x7f62fc0c0340 msgr2=0x7f62fc13f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 shutdown_connections 2023-12-22T08:41:41.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.105+0000 7f6304563640 1 -- 172.21.15.31:0/2383304652 wait complete. 2023-12-22T08:41:41.117 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-22T08:41:41.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.222+0000 7f3a79963640 1 Processor -- start 2023-12-22T08:41:41.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.222+0000 7f3a79963640 1 -- start start 2023-12-22T08:41:41.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a79963640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a7414d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a79963640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a7414dd00 0x7f3a74155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a79963640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a740b6d90 con 0x7f3a7406bc30 2023-12-22T08:41:41.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a79963640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7414e170 con 0x7f3a7414dd00 2023-12-22T08:41:41.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a79963640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7409ce40 con 0x7f3a7409eca0 2023-12-22T08:41:41.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a737fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a7414dd00 0x7f3a74155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a737fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a7414dd00 0x7f3a74155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45880/0 (socket says 172.21.15.31:45880) 2023-12-22T08:41:41.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a737fe640 1 -- 172.21.15.31:0/3854695313 learned_addr learned my addr 172.21.15.31:0/3854695313 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:41.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a737fe640 1 -- 172.21.15.31:0/3854695313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 msgr2=0x7f3a7414d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a727fc640 1 --2- 172.21.15.31:0/3854695313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a7414d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a737fe640 1 --2- 172.21.15.31:0/3854695313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a7414d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a737fe640 1 -- 172.21.15.31:0/3854695313 >> v1:172.21.15.69:6789/0 conn(0x7f3a7406bc30 legacy=0x7f3a740b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a737fe640 1 -- 172.21.15.31:0/3854695313 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7409d090 con 0x7f3a7414dd00 2023-12-22T08:41:41.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.223+0000 7f3a727fc640 1 --2- 172.21.15.31:0/3854695313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a7414d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:41.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.224+0000 7f3a737fe640 1 --2- 172.21.15.31:0/3854695313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7414dd00 0x7f3a74155690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009870 tx=0x7f3a6c02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e6256983ae8562 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.224+0000 7f3a71ffb640 1 -- 172.21.15.31:0/3854695313 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c02f830 con 0x7f3a7414dd00 2023-12-22T08:41:41.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.224+0000 7f3a71ffb640 1 -- 172.21.15.31:0/3854695313 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c02f990 con 0x7f3a7414dd00 2023-12-22T08:41:41.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.224+0000 7f3a71ffb640 1 -- 172.21.15.31:0/3854695313 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c02fd20 con 0x7f3a7414dd00 2023-12-22T08:41:41.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.225+0000 7f3a79963640 1 -- 172.21.15.31:0/3854695313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7414dd00 msgr2=0x7f3a74155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.225+0000 7f3a79963640 1 --2- 172.21.15.31:0/3854695313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7414dd00 0x7f3a74155690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009870 tx=0x7f3a6c02ba10 comp rx=0 tx=0).stop 2023-12-22T08:41:41.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.225+0000 7f3a79963640 1 -- 172.21.15.31:0/3854695313 shutdown_connections 2023-12-22T08:41:41.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.225+0000 7f3a79963640 1 --2- 172.21.15.31:0/3854695313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7414dd00 0x7f3a74155690 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.225+0000 7f3a79963640 1 --2- 172.21.15.31:0/3854695313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a7414d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.225+0000 7f3a79963640 1 -- 172.21.15.31:0/3854695313 >> 172.21.15.31:0/3854695313 conn(0x7f3a7406a580 msgr2=0x7f3a740bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.225+0000 7f3a79963640 1 -- 172.21.15.31:0/3854695313 shutdown_connections 2023-12-22T08:41:41.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.225+0000 7f3a79963640 1 -- 172.21.15.31:0/3854695313 wait complete. 2023-12-22T08:41:41.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.226+0000 7f3a79963640 1 Processor -- start 2023-12-22T08:41:41.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.226+0000 7f3a79963640 1 -- start start 2023-12-22T08:41:41.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.226+0000 7f3a79963640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7406bc30 0x7f3a740a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.226+0000 7f3a79963640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a740bb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.226+0000 7f3a79963640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7414dd00 0x7f3a74146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.226+0000 7f3a79963640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74070b20 con 0x7f3a7406bc30 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.226+0000 7f3a79963640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7409fe20 con 0x7f3a7414dd00 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.226+0000 7f3a79963640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74070d60 con 0x7f3a7409eca0 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7406bc30 0x7f3a740a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7406bc30 0x7f3a740a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45894/0 (socket says 172.21.15.31:45894) 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 -- 172.21.15.31:0/4124517589 learned_addr learned my addr 172.21.15.31:0/4124517589 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a727fc640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a740bb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a737fe640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7414dd00 0x7f3a74146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 -- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 msgr2=0x7f3a740bb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a740bb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 -- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7414dd00 msgr2=0x7f3a74146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7414dd00 0x7f3a74146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 -- 172.21.15.31:0/4124517589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c0094d0 con 0x7f3a7406bc30 2023-12-22T08:41:41.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a737fe640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7414dd00 0x7f3a74146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:41.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a72ffd640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7406bc30 0x7f3a740a02b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400c870 tx=0x7f3a6400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a5bfff640 1 -- 172.21.15.31:0/4124517589 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64003b70 con 0x7f3a7406bc30 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a5bfff640 1 -- 172.21.15.31:0/4124517589 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64003cf0 con 0x7f3a7406bc30 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a74071040 con 0x7f3a7406bc30 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a5bfff640 1 -- 172.21.15.31:0/4124517589 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400aa90 con 0x7f3a7406bc30 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.227+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a740a13d0 con 0x7f3a7406bc30 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.228+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7409ffb0 con 0x7f3a7406bc30 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.229+0000 7f3a5bfff640 1 -- 172.21.15.31:0/4124517589 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3a6400abf0 con 0x7f3a7406bc30 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.229+0000 7f3a5bfff640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3a6006a430 0x7f3a6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.229+0000 7f3a5bfff640 1 -- 172.21.15.31:0/4124517589 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a64088760 con 0x7f3a7406bc30 2023-12-22T08:41:41.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.229+0000 7f3a727fc640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3a6006a430 0x7f3a6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.230+0000 7f3a727fc640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3a6006a430 0x7f3a6006c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a74071f10 tx=0x7f3a68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.233+0000 7f3a5bfff640 1 -- 172.21.15.31:0/4124517589 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3a64053de0 con 0x7f3a7406bc30 2023-12-22T08:41:41.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.407+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a7409d650 con 0x7f3a6006a430 2023-12-22T08:41:41.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.408+0000 7f3a5bfff640 1 -- 172.21.15.31:0/4124517589 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3a6800c040 con 0x7f3a6006a430 2023-12-22T08:41:41.410 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2023-12-22T08:41:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3a6006a430 msgr2=0x7f3a6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3a6006a430 0x7f3a6006c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3a74071f10 tx=0x7f3a68008040 comp rx=0 tx=0).stop 2023-12-22T08:41:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7406bc30 msgr2=0x7f3a740a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7406bc30 0x7f3a740a02b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400c870 tx=0x7f3a6400cd30 comp rx=0 tx=0).stop 2023-12-22T08:41:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 shutdown_connections 2023-12-22T08:41:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3a6006a430 0x7f3a6006c8f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a7414dd00 0x7f3a74146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a7409eca0 0x7f3a740bb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 --2- 172.21.15.31:0/4124517589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a7406bc30 0x7f3a740a02b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 >> 172.21.15.31:0/4124517589 conn(0x7f3a7406a580 msgr2=0x7f3a740b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 shutdown_connections 2023-12-22T08:41:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.410+0000 7f3a79963640 1 -- 172.21.15.31:0/4124517589 wait complete. 2023-12-22T08:41:41.423 INFO:tasks.ceph:Scrubbing osd.1 2023-12-22T08:41:41.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:41:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe990823640 1 Processor -- start 2023-12-22T08:41:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe990823640 1 -- start start 2023-12-22T08:41:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe990823640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe98c14aa00 0x7fe98c0bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe990823640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe98c140ef0 0x7fe98c141380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe990823640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c1418c0 con 0x7fe98c0b79f0 2023-12-22T08:41:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe990823640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0bbca0 con 0x7fe98c140ef0 2023-12-22T08:41:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe990823640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0bacc0 con 0x7fe98c14aa00 2023-12-22T08:41:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe98ad9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe98c140ef0 0x7fe98c141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe98a59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe98c0b79f0 0x7fe98c0b83a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33618/0 (socket says 172.21.15.31:33618) 2023-12-22T08:41:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe98a59c640 1 -- 172.21.15.31:0/2284928068 learned_addr learned my addr 172.21.15.31:0/2284928068 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.531+0000 7fe98ad9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe98c140ef0 0x7fe98c141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45898/0 (socket says 172.21.15.31:45898) 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.532+0000 7fe983fff640 1 --2- 172.21.15.31:0/2284928068 >> v2:172.21.15.69:3300/0 conn(0x7fe98c14aa00 0x7fe98c0bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.532+0000 7fe98ad9d640 1 -- 172.21.15.31:0/2284928068 >> v2:172.21.15.69:3300/0 conn(0x7fe98c14aa00 msgr2=0x7fe98c0bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.532+0000 7fe98ad9d640 1 --2- 172.21.15.31:0/2284928068 >> v2:172.21.15.69:3300/0 conn(0x7fe98c14aa00 0x7fe98c0bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.532+0000 7fe98ad9d640 1 -- 172.21.15.31:0/2284928068 >> v1:172.21.15.31:6789/0 conn(0x7fe98c0b79f0 legacy=0x7fe98c0b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.532+0000 7fe989d9b640 1 -- 172.21.15.31:0/2284928068 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489600092 0 0) 0x7fe98c1418c0 con 0x7fe98c0b79f0 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.532+0000 7fe98ad9d640 1 -- 172.21.15.31:0/2284928068 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c0bbe60 con 0x7fe98c140ef0 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.532+0000 7fe983fff640 1 --2- 172.21.15.31:0/2284928068 >> v2:172.21.15.69:3300/0 conn(0x7fe98c14aa00 0x7fe98c0bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe98ad9d640 1 --2- 172.21.15.31:0/2284928068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c140ef0 0x7fe98c141380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0b80b0 tx=0x7fe98402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd983740f261474 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe989d9b640 1 -- 172.21.15.31:0/2284928068 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98402cd00 con 0x7fe98c140ef0 2023-12-22T08:41:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe989d9b640 1 -- 172.21.15.31:0/2284928068 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98402ce60 con 0x7fe98c140ef0 2023-12-22T08:41:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe989d9b640 1 -- 172.21.15.31:0/2284928068 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984034660 con 0x7fe98c140ef0 2023-12-22T08:41:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe990823640 1 -- 172.21.15.31:0/2284928068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c140ef0 msgr2=0x7fe98c141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe990823640 1 --2- 172.21.15.31:0/2284928068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c140ef0 0x7fe98c141380 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0b80b0 tx=0x7fe98402bf50 comp rx=0 tx=0).stop 2023-12-22T08:41:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe990823640 1 -- 172.21.15.31:0/2284928068 shutdown_connections 2023-12-22T08:41:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe990823640 1 --2- 172.21.15.31:0/2284928068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c140ef0 0x7fe98c141380 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe990823640 1 --2- 172.21.15.31:0/2284928068 >> v2:172.21.15.69:3300/0 conn(0x7fe98c14aa00 0x7fe98c0bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe990823640 1 -- 172.21.15.31:0/2284928068 >> 172.21.15.31:0/2284928068 conn(0x7fe98c0c0340 msgr2=0x7fe98c0c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe990823640 1 -- 172.21.15.31:0/2284928068 shutdown_connections 2023-12-22T08:41:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.533+0000 7fe990823640 1 -- 172.21.15.31:0/2284928068 wait complete. 2023-12-22T08:41:41.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.534+0000 7fe990823640 1 Processor -- start 2023-12-22T08:41:41.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe990823640 1 -- start start 2023-12-22T08:41:41.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe990823640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c0b79f0 0x7fe98c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe990823640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe98c140ef0 0x7fe98c1e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe990823640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c14aa00 0x7fe98c139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe990823640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c14a5a0 con 0x7fe98c0b79f0 2023-12-22T08:41:41.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe990823640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c14bfe0 con 0x7fe98c14aa00 2023-12-22T08:41:41.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe990823640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c14c2c0 con 0x7fe98c140ef0 2023-12-22T08:41:41.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe98a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c0b79f0 0x7fe98c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe98a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c0b79f0 0x7fe98c14a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45912/0 (socket says 172.21.15.31:45912) 2023-12-22T08:41:41.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.535+0000 7fe98a59c640 1 -- 172.21.15.31:0/934456645 learned_addr learned my addr 172.21.15.31:0/934456645 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:41.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe98ad9d640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c14aa00 0x7fe98c139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe98a59c640 1 -- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe98c140ef0 msgr2=0x7fe98c1e3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe983fff640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe98c140ef0 0x7fe98c1e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe98a59c640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe98c140ef0 0x7fe98c1e3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe98a59c640 1 -- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c14aa00 msgr2=0x7fe98c139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe98a59c640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c14aa00 0x7fe98c139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe98a59c640 1 -- 172.21.15.31:0/934456645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984009a70 con 0x7fe98c0b79f0 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe98ad9d640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c14aa00 0x7fe98c139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe983fff640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe98c140ef0 0x7fe98c1e3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe98a59c640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c0b79f0 0x7fe98c14a060 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c4d0 tx=0x7fe97c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0074e0 con 0x7fe98c0b79f0 2023-12-22T08:41:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c007660 con 0x7fe98c0b79f0 2023-12-22T08:41:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c1e2b30 con 0x7fe98c0b79f0 2023-12-22T08:41:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c004a20 con 0x7fe98c0b79f0 2023-12-22T08:41:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.536+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c141ab0 con 0x7fe98c0b79f0 2023-12-22T08:41:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.537+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe98c0baf60 con 0x7fe98c0b79f0 2023-12-22T08:41:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.537+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe97c004b80 con 0x7fe98c0b79f0 2023-12-22T08:41:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.538+0000 7fe982ffd640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.538+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe97c087ac0 con 0x7fe98c0b79f0 2023-12-22T08:41:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.538+0000 7fe983fff640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.538+0000 7fe982ffd640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7fe96c0725d0 0x7fe96c0749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.538+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 --> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe96c0750a0 con 0x7fe96c0725d0 2023-12-22T08:41:41.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.538+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe97c08c2c0 con 0x7fe98c0b79f0 2023-12-22T08:41:41.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.538+0000 7fe98ad9d640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7fe96c0725d0 0x7fe96c0749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.539+0000 7fe98ad9d640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7fe96c0725d0 0x7fe96c0749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.539+0000 7fe983fff640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe974006fd0 tx=0x7fe974008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.539+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 <== osd.1 v2:172.21.15.31:6813/120301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe96c0750a0 con 0x7fe96c0725d0 2023-12-22T08:41:41.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 --> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe98c0b8bc0 con 0x7fe96c0725d0 2023-12-22T08:41:41.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe982ffd640 1 -- 172.21.15.31:0/934456645 <== osd.1 v2:172.21.15.31:6813/120301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe9840344c0 con 0x7fe96c0725d0 2023-12-22T08:41:41.554 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T08:41:41.555 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:41.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7fe96c0725d0 msgr2=0x7fe96c0749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.31:6813/120301,v1:172.21.15.31:6815/120301] conn(0x7fe96c0725d0 0x7fe96c0749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 msgr2=0x7fe96c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe96c06a430 0x7fe96c06c8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe974006fd0 tx=0x7fe974008040 comp rx=0 tx=0).stop 2023-12-22T08:41:41.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c0b79f0 msgr2=0x7fe98c14a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 --2- 172.21.15.31:0/934456645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe98c0b79f0 0x7fe98c14a060 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00c4d0 tx=0x7fe97c00c990 comp rx=0 tx=0).stop 2023-12-22T08:41:41.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe98ad9d640 1 -- 172.21.15.31:0/934456645 reap_dead start 2023-12-22T08:41:41.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 shutdown_connections 2023-12-22T08:41:41.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 >> 172.21.15.31:0/934456645 conn(0x7fe98c0c0340 msgr2=0x7fe98c0bcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 shutdown_connections 2023-12-22T08:41:41.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.552+0000 7fe990823640 1 -- 172.21.15.31:0/934456645 wait complete. 2023-12-22T08:41:41.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-22T08:41:41.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.668+0000 7fa554195640 1 Processor -- start 2023-12-22T08:41:41.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.668+0000 7fa554195640 1 -- start start 2023-12-22T08:41:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa554195640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa54c06a500 0x7fa54c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa554195640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c071640 con 0x7fa54c06a120 2023-12-22T08:41:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa554195640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c0b3ba0 con 0x7fa54c149140 2023-12-22T08:41:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa554195640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c0b3e80 con 0x7fa54c06a500 2023-12-22T08:41:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa551730640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa54c06a500 0x7fa54c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa551730640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa54c06a500 0x7fa54c0b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45926/0 (socket says 172.21.15.31:45926) 2023-12-22T08:41:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa551730640 1 -- 172.21.15.31:0/117772479 learned_addr learned my addr 172.21.15.31:0/117772479 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa551f31640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa54c06a120 0x7fa54c0b33c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33632/0 (socket says 172.21.15.31:33632) 2023-12-22T08:41:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa551730640 1 -- 172.21.15.31:0/117772479 >> v1:172.21.15.69:6789/0 conn(0x7fa54c149140 legacy=0x7fa54c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa551730640 1 -- 172.21.15.31:0/117772479 >> v1:172.21.15.31:6789/0 conn(0x7fa54c06a120 legacy=0x7fa54c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa551730640 1 -- 172.21.15.31:0/117772479 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0b5890 con 0x7fa54c06a500 2023-12-22T08:41:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.669+0000 7fa550f2f640 1 -- 172.21.15.31:0/117772479 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929793892 0 0) 0x7fa54c071640 con 0x7fa54c06a120 2023-12-22T08:41:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.670+0000 7fa551730640 1 --2- 172.21.15.31:0/117772479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a500 0x7fa54c0b5db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa540009870 tx=0x7fa54002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4538504a535e60fd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.670+0000 7fa550f2f640 1 -- 172.21.15.31:0/117772479 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54002f840 con 0x7fa54c06a500 2023-12-22T08:41:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.670+0000 7fa550f2f640 1 -- 172.21.15.31:0/117772479 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54002f9a0 con 0x7fa54c06a500 2023-12-22T08:41:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.670+0000 7fa550f2f640 1 -- 172.21.15.31:0/117772479 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54002fd30 con 0x7fa54c06a500 2023-12-22T08:41:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.671+0000 7fa554195640 1 -- 172.21.15.31:0/117772479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a500 msgr2=0x7fa54c0b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.671+0000 7fa554195640 1 --2- 172.21.15.31:0/117772479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a500 0x7fa54c0b5db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa540009870 tx=0x7fa54002ba20 comp rx=0 tx=0).stop 2023-12-22T08:41:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.671+0000 7fa554195640 1 -- 172.21.15.31:0/117772479 shutdown_connections 2023-12-22T08:41:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.671+0000 7fa554195640 1 --2- 172.21.15.31:0/117772479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a500 0x7fa54c0b5db0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.671+0000 7fa554195640 1 -- 172.21.15.31:0/117772479 >> 172.21.15.31:0/117772479 conn(0x7fa54c0bc330 msgr2=0x7fa54c0bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.671+0000 7fa554195640 1 -- 172.21.15.31:0/117772479 shutdown_connections 2023-12-22T08:41:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.671+0000 7fa554195640 1 -- 172.21.15.31:0/117772479 wait complete. 2023-12-22T08:41:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.672+0000 7fa554195640 1 Processor -- start 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.672+0000 7fa554195640 1 -- start start 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa554195640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a120 0x7fa54c147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa554195640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa54c06a500 0x7fa54c140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa554195640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa54c149140 0x7fa54c140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa554195640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c147590 con 0x7fa54c06a120 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa554195640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c143810 con 0x7fa54c06a500 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa554195640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c1d0900 con 0x7fa54c149140 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a120 0x7fa54c147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a120 0x7fa54c147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45928/0 (socket says 172.21.15.31:45928) 2023-12-22T08:41:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 -- 172.21.15.31:0/2924933456 learned_addr learned my addr 172.21.15.31:0/2924933456 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551730640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa54c06a500 0x7fa54c140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa552732640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa54c149140 0x7fa54c140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 -- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa54c149140 msgr2=0x7fa54c140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa54c149140 0x7fa54c140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 -- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa54c06a500 msgr2=0x7fa54c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa54c06a500 0x7fa54c140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 -- 172.21.15.31:0/2924933456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400094d0 con 0x7fa54c06a120 2023-12-22T08:41:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa551f31640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a120 0x7fa54c147050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa54400c7c0 tx=0x7fa54400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa54a7fc640 1 -- 172.21.15.31:0/2924933456 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400a640 con 0x7fa54c06a120 2023-12-22T08:41:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa54a7fc640 1 -- 172.21.15.31:0/2924933456 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400a7c0 con 0x7fa54c06a120 2023-12-22T08:41:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c1d0620 con 0x7fa54c06a120 2023-12-22T08:41:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa54a7fc640 1 -- 172.21.15.31:0/2924933456 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400ab70 con 0x7fa54c06a120 2023-12-22T08:41:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.673+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c143ce0 con 0x7fa54c06a120 2023-12-22T08:41:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.674+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c143ed0 con 0x7fa54c06a120 2023-12-22T08:41:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.675+0000 7fa54a7fc640 1 -- 172.21.15.31:0/2924933456 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa54400acd0 con 0x7fa54c06a120 2023-12-22T08:41:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.675+0000 7fa54a7fc640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa53806a430 0x7fa53806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.676+0000 7fa54a7fc640 1 -- 172.21.15.31:0/2924933456 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa544088060 con 0x7fa54c06a120 2023-12-22T08:41:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.676+0000 7fa551730640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa53806a430 0x7fa53806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.676+0000 7fa551730640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa53806a430 0x7fa53806c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa540036000 tx=0x7fa540008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.680+0000 7fa54a7fc640 1 -- 172.21.15.31:0/2924933456 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa544053700 con 0x7fa54c06a120 2023-12-22T08:41:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.854+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa54c0b62f0 con 0x7fa53806a430 2023-12-22T08:41:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.855+0000 7fa54a7fc640 1 -- 172.21.15.31:0/2924933456 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa54002fc10 con 0x7fa53806a430 2023-12-22T08:41:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2023-12-22T08:41:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa53806a430 msgr2=0x7fa53806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa53806a430 0x7fa53806c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa540036000 tx=0x7fa540008030 comp rx=0 tx=0).stop 2023-12-22T08:41:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a120 msgr2=0x7fa54c147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a120 0x7fa54c147050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa54400c7c0 tx=0x7fa54400cc80 comp rx=0 tx=0).stop 2023-12-22T08:41:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 shutdown_connections 2023-12-22T08:41:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fa53806a430 0x7fa53806c8f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa54c149140 0x7fa54c140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa54c06a500 0x7fa54c140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 --2- 172.21.15.31:0/2924933456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa54c06a120 0x7fa54c147050 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 >> 172.21.15.31:0/2924933456 conn(0x7fa54c0bc330 msgr2=0x7fa54c0bc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 shutdown_connections 2023-12-22T08:41:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.857+0000 7fa554195640 1 -- 172.21.15.31:0/2924933456 wait complete. 2023-12-22T08:41:41.870 INFO:tasks.ceph:Scrubbing osd.2 2023-12-22T08:41:41.870 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:41:41.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.977+0000 7f57c1b6e640 1 Processor -- start 2023-12-22T08:41:41.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.977+0000 7f57c1b6e640 1 -- start start 2023-12-22T08:41:41.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57c1b6e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57bc0b4b50 0x7f57bc1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57c1b6e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc0b8790 con 0x7f57bc0bafc0 2023-12-22T08:41:41.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57c1b6e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc14e130 con 0x7f57bc0b5250 2023-12-22T08:41:41.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57c1b6e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc06b600 con 0x7f57bc0b4b50 2023-12-22T08:41:41.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57bb7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f57bc0bafc0 0x7f57bc14e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33638/0 (socket says 172.21.15.31:33638) 2023-12-22T08:41:41.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57bb7fe640 1 -- 172.21.15.31:0/560187400 learned_addr learned my addr 172.21.15.31:0/560187400 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:41.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57bbfff640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57bc0b4b50 0x7f57bc1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346275817 0 0) 0x7f57bc0b8790 con 0x7f57bc0bafc0 2023-12-22T08:41:41.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a4003520 con 0x7f57bc0bafc0 2023-12-22T08:41:41.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224820825 0 0) 0x7f57a4003520 con 0x7f57bc0bafc0 2023-12-22T08:41:41.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57bc0b4b50 msgr2=0x7f57bc1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57bc0b4b50 0x7f57bc1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 >> v1:172.21.15.69:6789/0 conn(0x7f57bc0b5250 legacy=0x7f57bc14b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc06b8e0 con 0x7f57bc0bafc0 2023-12-22T08:41:41.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f57ac001670 con 0x7f57bc0bafc0 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 >> v1:172.21.15.31:6789/0 conn(0x7f57bc0bafc0 legacy=0x7f57bc14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a40039a0 0x7f57a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a40047c0 0x7f57a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57bc0b4b50 0x7f57a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc06b600 con 0x7f57a40047c0 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.978+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a400ba30 con 0x7f57a40039a0 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a400bbf0 con 0x7f57bc0b4b50 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57baffd640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a40047c0 0x7f57a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57bb7fe640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a40039a0 0x7f57a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57bbfff640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57bc0b4b50 0x7f57a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57baffd640 1 -- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57bc0b4b50 msgr2=0x7f57a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57baffd640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57bc0b4b50 0x7f57a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57baffd640 1 -- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a40039a0 msgr2=0x7f57a4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:41.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57baffd640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a40039a0 0x7f57a4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.979+0000 7f57baffd640 1 -- 172.21.15.31:0/560187400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4003520 con 0x7f57a40047c0 2023-12-22T08:41:41.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57baffd640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a40047c0 0x7f57a4004c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0b84e0 tx=0x7f57a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc9039984f34715 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00052d0 con 0x7f57a40047c0 2023-12-22T08:41:41.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b002e050 con 0x7f57a40047c0 2023-12-22T08:41:41.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57ba7fc640 1 -- 172.21.15.31:0/560187400 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00035f0 con 0x7f57a40047c0 2023-12-22T08:41:41.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57c1b6e640 1 -- 172.21.15.31:0/560187400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a40047c0 msgr2=0x7f57a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57c1b6e640 1 --2- 172.21.15.31:0/560187400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57a40047c0 0x7f57a4004c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0b84e0 tx=0x7f57a40057f0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57bbfff640 1 -- 172.21.15.31:0/560187400 reap_dead start 2023-12-22T08:41:41.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57c1b6e640 1 -- 172.21.15.31:0/560187400 shutdown_connections 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57c1b6e640 1 -- 172.21.15.31:0/560187400 >> 172.21.15.31:0/560187400 conn(0x7f57bc069d00 msgr2=0x7f57bc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57c1b6e640 1 -- 172.21.15.31:0/560187400 shutdown_connections 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.980+0000 7f57c1b6e640 1 -- 172.21.15.31:0/560187400 wait complete. 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.981+0000 7f57c1b6e640 1 Processor -- start 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57c1b6e640 1 -- start start 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57c1b6e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57a40047c0 0x7f57bc0bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57c1b6e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b5640 0x7f57bc1e0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57c1b6e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57bc147680 0x7f57bc147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57c1b6e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0bdd30 con 0x7f57bc0b5640 2023-12-22T08:41:41.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57c1b6e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0b5db0 con 0x7f57bc147680 2023-12-22T08:41:41.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57c1b6e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0b6fc0 con 0x7f57a40047c0 2023-12-22T08:41:41.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57baffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b5640 0x7f57bc1e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57baffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b5640 0x7f57bc1e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45944/0 (socket says 172.21.15.31:45944) 2023-12-22T08:41:41.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57baffd640 1 -- 172.21.15.31:0/190205526 learned_addr learned my addr 172.21.15.31:0/190205526 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:41.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57bb7fe640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57a40047c0 0x7f57bc0bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.982+0000 7f57bbfff640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57bc147680 0x7f57bc147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57baffd640 1 -- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57a40047c0 msgr2=0x7f57bc0bd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57baffd640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f57a40047c0 0x7f57bc0bd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57baffd640 1 -- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57bc147680 msgr2=0x7f57bc147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:41.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57baffd640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57bc147680 0x7f57bc147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:41.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57baffd640 1 -- 172.21.15.31:0/190205526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc148330 con 0x7f57bc0b5640 2023-12-22T08:41:41.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57baffd640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b5640 0x7f57bc1e0000 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f57b002bba0 tx=0x7f57b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0007a30 con 0x7f57bc0b5640 2023-12-22T08:41:41.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b0007640 con 0x7f57bc0b5640 2023-12-22T08:41:41.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57bc0b5ad0 con 0x7f57bc0b5640 2023-12-22T08:41:41.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0006be0 con 0x7f57bc0b5640 2023-12-22T08:41:41.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.983+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc148070 con 0x7f57bc0b5640 2023-12-22T08:41:41.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.984+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57bc14f020 con 0x7f57bc0b5640 2023-12-22T08:41:41.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.984+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f57b0006d40 con 0x7f57bc0b5640 2023-12-22T08:41:41.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.985+0000 7f57a3fff640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f57a806a430 0x7f57a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.985+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57b00aa510 con 0x7f57bc0b5640 2023-12-22T08:41:41.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.985+0000 7f57a3fff640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f57a80725d0 0x7f57a80749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:41.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.985+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 --> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57a80750a0 con 0x7f57a80725d0 2023-12-22T08:41:41.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.985+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57b00acaf0 con 0x7f57bc0b5640 2023-12-22T08:41:41.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.985+0000 7f57bb7fe640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f57a806a430 0x7f57a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.985+0000 7f57bbfff640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f57a80725d0 0x7f57a80749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:41.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.985+0000 7f57bbfff640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f57a80725d0 0x7f57a80749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.986+0000 7f57bb7fe640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f57a806a430 0x7f57a806c8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0017a0 tx=0x7f57ac0015b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:41.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.986+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 <== osd.2 v2:172.21.15.31:6824/120310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f57a80750a0 con 0x7f57a80725d0 2023-12-22T08:41:42.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.998+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 --> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57bc14e3f0 con 0x7f57a80725d0 2023-12-22T08:41:42.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57a3fff640 1 -- 172.21.15.31:0/190205526 <== osd.2 v2:172.21.15.31:6824/120310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f57b400f040 con 0x7f57a80725d0 2023-12-22T08:41:42.001 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T08:41:42.002 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:42.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f57a80725d0 msgr2=0x7f57a80749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.31:6824/120310,v1:172.21.15.31:6825/120310] conn(0x7f57a80725d0 0x7f57a80749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f57a806a430 msgr2=0x7f57a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f57a806a430 0x7f57a806c8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0017a0 tx=0x7f57ac0015b0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b5640 msgr2=0x7f57bc1e0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 --2- 172.21.15.31:0/190205526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57bc0b5640 0x7f57bc1e0000 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f57b002bba0 tx=0x7f57b0001120 comp rx=0 tx=0).stop 2023-12-22T08:41:42.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57bbfff640 1 -- 172.21.15.31:0/190205526 reap_dead start 2023-12-22T08:41:42.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 shutdown_connections 2023-12-22T08:41:42.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 >> 172.21.15.31:0/190205526 conn(0x7f57bc069d00 msgr2=0x7f57bc0b9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 shutdown_connections 2023-12-22T08:41:42.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:41.999+0000 7f57c1b6e640 1 -- 172.21.15.31:0/190205526 wait complete. 2023-12-22T08:41:42.012 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-22T08:41:42.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.116+0000 7f3f07607640 1 Processor -- start 2023-12-22T08:41:42.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.116+0000 7f3f07607640 1 -- start start 2023-12-22T08:41:42.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.116+0000 7f3f07607640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f000b7fb0 0x7f3f000b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.116+0000 7f3f07607640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f000b8cf0 0x7f3f001554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.116+0000 7f3f07607640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0014ef70 con 0x7f3f00144dd0 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.116+0000 7f3f07607640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f000b9a20 con 0x7f3f000b8cf0 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.116+0000 7f3f07607640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000b9180 con 0x7f3f000b7fb0 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.117+0000 7f3f05ba4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f000b8cf0 0x7f3f001554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.117+0000 7f3f05ba4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f000b8cf0 0x7f3f001554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45950/0 (socket says 172.21.15.31:45950) 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.117+0000 7f3f05ba4640 1 -- 172.21.15.31:0/3196923912 learned_addr learned my addr 172.21.15.31:0/3196923912 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:42.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.117+0000 7f3f04ba2640 1 --2- 172.21.15.31:0/3196923912 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f000b7fb0 0x7f3f000b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.117+0000 7f3f05ba4640 1 -- 172.21.15.31:0/3196923912 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f000b7fb0 msgr2=0x7f3f000b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.117+0000 7f3f05ba4640 1 --2- 172.21.15.31:0/3196923912 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f000b7fb0 0x7f3f000b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.117+0000 7f3f05ba4640 1 -- 172.21.15.31:0/3196923912 >> v1:172.21.15.69:6789/0 conn(0x7f3f00144dd0 legacy=0x7f3f0014e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.117+0000 7f3f05ba4640 1 -- 172.21.15.31:0/3196923912 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f000b6d30 con 0x7f3f000b8cf0 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f05ba4640 1 --2- 172.21.15.31:0/3196923912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001554c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009e50 tx=0x7f3ef802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da63b3f626067fc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3ef7fff640 1 -- 172.21.15.31:0/3196923912 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef802cb90 con 0x7f3f000b8cf0 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3ef7fff640 1 -- 172.21.15.31:0/3196923912 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef802ccf0 con 0x7f3f000b8cf0 2023-12-22T08:41:42.122 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3ef7fff640 1 -- 172.21.15.31:0/3196923912 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8034610 con 0x7f3f000b8cf0 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f07607640 1 -- 172.21.15.31:0/3196923912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 msgr2=0x7f3f001554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f07607640 1 --2- 172.21.15.31:0/3196923912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001554c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009e50 tx=0x7f3ef802bff0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f07607640 1 -- 172.21.15.31:0/3196923912 shutdown_connections 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f07607640 1 --2- 172.21.15.31:0/3196923912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001554c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f07607640 1 --2- 172.21.15.31:0/3196923912 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f000b7fb0 0x7f3f000b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f07607640 1 -- 172.21.15.31:0/3196923912 >> 172.21.15.31:0/3196923912 conn(0x7f3f000c03d0 msgr2=0x7f3f000c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f07607640 1 -- 172.21.15.31:0/3196923912 shutdown_connections 2023-12-22T08:41:42.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.118+0000 7f3f07607640 1 -- 172.21.15.31:0/3196923912 wait complete. 2023-12-22T08:41:42.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.119+0000 7f3f07607640 1 Processor -- start 2023-12-22T08:41:42.126 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.119+0000 7f3f07607640 1 -- start start 2023-12-22T08:41:42.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f07607640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f000b7fb0 0x7f3f0014b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f07607640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001df970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f07607640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f00144dd0 0x7f3f001d5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f07607640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0014b7e0 con 0x7f3f000b8cf0 2023-12-22T08:41:42.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f07607640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f001d64a0 con 0x7f3f000b7fb0 2023-12-22T08:41:42.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f07607640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f001dfeb0 con 0x7f3f00144dd0 2023-12-22T08:41:42.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f04ba2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f04ba2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001df970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45956/0 (socket says 172.21.15.31:45956) 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f04ba2640 1 -- 172.21.15.31:0/2045918779 learned_addr learned my addr 172.21.15.31:0/2045918779 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f053a3640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f000b7fb0 0x7f3f0014b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f04ba2640 1 -- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f00144dd0 msgr2=0x7f3f001d5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f05ba4640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f00144dd0 0x7f3f001d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f04ba2640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f00144dd0 0x7f3f001d5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f04ba2640 1 -- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f000b7fb0 msgr2=0x7f3f0014b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f04ba2640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f000b7fb0 0x7f3f0014b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f04ba2640 1 -- 172.21.15.31:0/2045918779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8009b30 con 0x7f3f000b8cf0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.120+0000 7f3f053a3640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f000b7fb0 0x7f3f0014b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.121+0000 7f3f04ba2640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001df970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000d5f0 tx=0x7f3ef000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.121+0000 7f3ef5ffb640 1 -- 172.21.15.31:0/2045918779 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00125f0 con 0x7f3f000b8cf0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.121+0000 7f3ef5ffb640 1 -- 172.21.15.31:0/2045918779 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef0012750 con 0x7f3f000b8cf0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.121+0000 7f3ef5ffb640 1 -- 172.21.15.31:0/2045918779 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0012b00 con 0x7f3f000b8cf0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.121+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f00146d30 con 0x7f3f000b8cf0 2023-12-22T08:41:42.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.121+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f001d66f0 con 0x7f3f000b8cf0 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.122+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f00145d20 con 0x7f3f000b8cf0 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.122+0000 7f3ef5ffb640 1 -- 172.21.15.31:0/2045918779 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ef0012c60 con 0x7f3f000b8cf0 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.123+0000 7f3ef5ffb640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ee406a430 0x7f3ee406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.123+0000 7f3ef5ffb640 1 -- 172.21.15.31:0/2045918779 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ef0088d50 con 0x7f3f000b8cf0 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.123+0000 7f3f053a3640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ee406a430 0x7f3ee406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.124+0000 7f3f053a3640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ee406a430 0x7f3ee406c8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3efc001680 tx=0x7f3efc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.127+0000 7f3ef5ffb640 1 -- 172.21.15.31:0/2045918779 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ef008c030 con 0x7f3f000b8cf0 2023-12-22T08:41:42.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.303+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f0014ec00 con 0x7f3ee406a430 2023-12-22T08:41:42.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.304+0000 7f3ef5ffb640 1 -- 172.21.15.31:0/2045918779 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3efc001c60 con 0x7f3ee406a430 2023-12-22T08:41:42.306 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2023-12-22T08:41:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ee406a430 msgr2=0x7f3ee406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ee406a430 0x7f3ee406c8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3efc001680 tx=0x7f3efc009040 comp rx=0 tx=0).stop 2023-12-22T08:41:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 msgr2=0x7f3f001df970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001df970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000d5f0 tx=0x7f3ef000dab0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 shutdown_connections 2023-12-22T08:41:42.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f3ee406a430 0x7f3ee406c8f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f00144dd0 0x7f3f001d5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f000b8cf0 0x7f3f001df970 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 --2- 172.21.15.31:0/2045918779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f000b7fb0 0x7f3f0014b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 >> 172.21.15.31:0/2045918779 conn(0x7f3f000c03d0 msgr2=0x7f3f000b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 shutdown_connections 2023-12-22T08:41:42.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.306+0000 7f3f07607640 1 -- 172.21.15.31:0/2045918779 wait complete. 2023-12-22T08:41:42.319 INFO:tasks.ceph:Scrubbing osd.3 2023-12-22T08:41:42.319 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:41:42.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.426+0000 7fc6efd1b640 1 Processor -- start 2023-12-22T08:41:42.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.426+0000 7fc6efd1b640 1 -- start start 2023-12-22T08:41:42.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6efd1b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc6e80b79f0 0x7fc6e80bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6efd1b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6e814aa00 0x7fc6e80b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6efd1b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80bacc0 con 0x7fc6e8140ef0 2023-12-22T08:41:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6efd1b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e80bbca0 con 0x7fc6e814aa00 2023-12-22T08:41:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6efd1b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e80bbe60 con 0x7fc6e80b79f0 2023-12-22T08:41:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6ed2b6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6e814aa00 0x7fc6e80b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6ed2b6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc6e814aa00 0x7fc6e80b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45972/0 (socket says 172.21.15.31:45972) 2023-12-22T08:41:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6ed2b6640 1 -- 172.21.15.31:0/2031516031 learned_addr learned my addr 172.21.15.31:0/2031516031 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6edab7640 1 --2- 172.21.15.31:0/2031516031 >> v2:172.21.15.69:3300/0 conn(0x7fc6e80b79f0 0x7fc6e80bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6ed2b6640 1 -- 172.21.15.31:0/2031516031 >> v2:172.21.15.69:3300/0 conn(0x7fc6e80b79f0 msgr2=0x7fc6e80bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:42.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6ed2b6640 1 --2- 172.21.15.31:0/2031516031 >> v2:172.21.15.69:3300/0 conn(0x7fc6e80b79f0 0x7fc6e80bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6ed2b6640 1 -- 172.21.15.31:0/2031516031 >> v1:172.21.15.69:6789/0 conn(0x7fc6e8140ef0 legacy=0x7fc6e8141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.427+0000 7fc6ed2b6640 1 -- 172.21.15.31:0/2031516031 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80b8bc0 con 0x7fc6e814aa00 2023-12-22T08:41:42.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.428+0000 7fc6ed2b6640 1 --2- 172.21.15.31:0/2031516031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 0x7fc6e80b83a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80bbdf0 tx=0x7fc6dc02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8e2d85a26630af server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.428+0000 7fc6ecab5640 1 -- 172.21.15.31:0/2031516031 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc02f850 con 0x7fc6e814aa00 2023-12-22T08:41:42.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.428+0000 7fc6ecab5640 1 -- 172.21.15.31:0/2031516031 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc02f9b0 con 0x7fc6e814aa00 2023-12-22T08:41:42.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.428+0000 7fc6ecab5640 1 -- 172.21.15.31:0/2031516031 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc02fd40 con 0x7fc6e814aa00 2023-12-22T08:41:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.429+0000 7fc6efd1b640 1 -- 172.21.15.31:0/2031516031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 msgr2=0x7fc6e80b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.429+0000 7fc6efd1b640 1 --2- 172.21.15.31:0/2031516031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 0x7fc6e80b83a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80bbdf0 tx=0x7fc6dc02ba30 comp rx=0 tx=0).stop 2023-12-22T08:41:42.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.429+0000 7fc6efd1b640 1 -- 172.21.15.31:0/2031516031 shutdown_connections 2023-12-22T08:41:42.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.429+0000 7fc6efd1b640 1 --2- 172.21.15.31:0/2031516031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 0x7fc6e80b83a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.429+0000 7fc6efd1b640 1 --2- 172.21.15.31:0/2031516031 >> v2:172.21.15.69:3300/0 conn(0x7fc6e80b79f0 0x7fc6e80bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.429+0000 7fc6efd1b640 1 -- 172.21.15.31:0/2031516031 >> 172.21.15.31:0/2031516031 conn(0x7fc6e80c0340 msgr2=0x7fc6e80c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.429+0000 7fc6efd1b640 1 -- 172.21.15.31:0/2031516031 shutdown_connections 2023-12-22T08:41:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.429+0000 7fc6efd1b640 1 -- 172.21.15.31:0/2031516031 wait complete. 2023-12-22T08:41:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.430+0000 7fc6efd1b640 1 Processor -- start 2023-12-22T08:41:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.430+0000 7fc6efd1b640 1 -- start start 2023-12-22T08:41:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6efd1b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e80b79f0 0x7fc6e80bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6efd1b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e8140ef0 0x7fc6e814e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6efd1b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 0x7fc6e81423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6efd1b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80bfa50 con 0x7fc6e814aa00 2023-12-22T08:41:42.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6efd1b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e814ea50 con 0x7fc6e80b79f0 2023-12-22T08:41:42.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6efd1b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e814dc40 con 0x7fc6e8140ef0 2023-12-22T08:41:42.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 0x7fc6e81423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 0x7fc6e81423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45976/0 (socket says 172.21.15.31:45976) 2023-12-22T08:41:42.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 -- 172.21.15.31:0/1748159664 learned_addr learned my addr 172.21.15.31:0/1748159664 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:42.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6edab7640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e80b79f0 0x7fc6e80bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ed2b6640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e8140ef0 0x7fc6e814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 -- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e8140ef0 msgr2=0x7fc6e814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e8140ef0 0x7fc6e814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 -- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e80b79f0 msgr2=0x7fc6e80bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e80b79f0 0x7fc6e80bf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 -- 172.21.15.31:0/1748159664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc0094d0 con 0x7fc6e814aa00 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6ee2b8640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 0x7fc6e81423b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c7a0 tx=0x7fc6d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8003b70 con 0x7fc6e814aa00 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8003cf0 con 0x7fc6e814aa00 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8003ea0 con 0x7fc6e814aa00 2023-12-22T08:41:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e8143560 con 0x7fc6e814aa00 2023-12-22T08:41:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.431+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e814bcd0 con 0x7fc6e814aa00 2023-12-22T08:41:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.432+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6e80bb240 con 0x7fc6e814aa00 2023-12-22T08:41:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.433+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6d800aa90 con 0x7fc6e814aa00 2023-12-22T08:41:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.433+0000 7fc6e67fc640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6d406a430 0x7fc6d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.433+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6d80886d0 con 0x7fc6e814aa00 2023-12-22T08:41:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.433+0000 7fc6edab7640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6d406a430 0x7fc6d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.433+0000 7fc6e67fc640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7fc6d40725d0 0x7fc6d40749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.433+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 --> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6d40750a0 con 0x7fc6d40725d0 2023-12-22T08:41:42.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.433+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6d808ad90 con 0x7fc6e814aa00 2023-12-22T08:41:42.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.433+0000 7fc6ed2b6640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7fc6d40725d0 0x7fc6d40749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.434+0000 7fc6ed2b6640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7fc6d40725d0 0x7fc6d40749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.434+0000 7fc6edab7640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6d406a430 0x7fc6d406c8f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0006fd0 tx=0x7fc6e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.434+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 <== osd.3 v2:172.21.15.31:6808/120300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc6d40750a0 con 0x7fc6d40725d0 2023-12-22T08:41:42.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 --> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6e80baf60 con 0x7fc6d40725d0 2023-12-22T08:41:42.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6e67fc640 1 -- 172.21.15.31:0/1748159664 <== osd.3 v2:172.21.15.31:6808/120300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc6dc02fb20 con 0x7fc6d40725d0 2023-12-22T08:41:42.449 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T08:41:42.450 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7fc6d40725d0 msgr2=0x7fc6d40749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.31:6808/120300,v1:172.21.15.31:6809/120300] conn(0x7fc6d40725d0 0x7fc6d40749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6d406a430 msgr2=0x7fc6d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fc6d406a430 0x7fc6d406c8f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0006fd0 tx=0x7fc6e0008040 comp rx=0 tx=0).stop 2023-12-22T08:41:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 msgr2=0x7fc6e81423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 --2- 172.21.15.31:0/1748159664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6e814aa00 0x7fc6e81423b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c7a0 tx=0x7fc6d800cc60 comp rx=0 tx=0).stop 2023-12-22T08:41:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6ee2b8640 1 -- 172.21.15.31:0/1748159664 reap_dead start 2023-12-22T08:41:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 shutdown_connections 2023-12-22T08:41:42.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 >> 172.21.15.31:0/1748159664 conn(0x7fc6e80c0340 msgr2=0x7fc6e80bc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 shutdown_connections 2023-12-22T08:41:42.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.447+0000 7fc6efd1b640 1 -- 172.21.15.31:0/1748159664 wait complete. 2023-12-22T08:41:42.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-22T08:41:42.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.564+0000 7faf1b08f640 1 Processor -- start 2023-12-22T08:41:42.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.564+0000 7faf1b08f640 1 -- start start 2023-12-22T08:41:42.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1b08f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf140b9220 0x7faf1414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1b08f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf1414afe0 0x7faf14155330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1b08f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf14070570 con 0x7faf14069f70 2023-12-22T08:41:42.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1b08f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1414b470 con 0x7faf1414afe0 2023-12-22T08:41:42.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1b08f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf140719e0 con 0x7faf140b9220 2023-12-22T08:41:42.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1962c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf1414afe0 0x7faf14155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1962c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf1414afe0 0x7faf14155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45990/0 (socket says 172.21.15.31:45990) 2023-12-22T08:41:42.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1962c640 1 -- 172.21.15.31:0/2396842760 learned_addr learned my addr 172.21.15.31:0/2396842760 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf13fff640 1 --2- 172.21.15.31:0/2396842760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf140b9220 0x7faf1414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1962c640 1 -- 172.21.15.31:0/2396842760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf140b9220 msgr2=0x7faf1414aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1962c640 1 --2- 172.21.15.31:0/2396842760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf140b9220 0x7faf1414aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1962c640 1 -- 172.21.15.31:0/2396842760 >> v1:172.21.15.69:6789/0 conn(0x7faf14069f70 legacy=0x7faf14144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf1962c640 1 -- 172.21.15.31:0/2396842760 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1406ff60 con 0x7faf1414afe0 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.565+0000 7faf13fff640 1 --2- 172.21.15.31:0/2396842760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf140b9220 0x7faf1414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.566+0000 7faf1962c640 1 --2- 172.21.15.31:0/2396842760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf1414afe0 0x7faf14155330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf04009870 tx=0x7faf0402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7682bff1aa0613c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.566+0000 7faf137fe640 1 -- 172.21.15.31:0/2396842760 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04030840 con 0x7faf1414afe0 2023-12-22T08:41:42.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.566+0000 7faf137fe640 1 -- 172.21.15.31:0/2396842760 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf040309a0 con 0x7faf1414afe0 2023-12-22T08:41:42.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.566+0000 7faf137fe640 1 -- 172.21.15.31:0/2396842760 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04030d30 con 0x7faf1414afe0 2023-12-22T08:41:42.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.567+0000 7faf1b08f640 1 -- 172.21.15.31:0/2396842760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf1414afe0 msgr2=0x7faf14155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.567+0000 7faf1b08f640 1 --2- 172.21.15.31:0/2396842760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf1414afe0 0x7faf14155330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf04009870 tx=0x7faf0402b980 comp rx=0 tx=0).stop 2023-12-22T08:41:42.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.567+0000 7faf1b08f640 1 -- 172.21.15.31:0/2396842760 shutdown_connections 2023-12-22T08:41:42.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.567+0000 7faf1b08f640 1 --2- 172.21.15.31:0/2396842760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf1414afe0 0x7faf14155330 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.567+0000 7faf1b08f640 1 --2- 172.21.15.31:0/2396842760 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf140b9220 0x7faf1414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.567+0000 7faf1b08f640 1 -- 172.21.15.31:0/2396842760 >> 172.21.15.31:0/2396842760 conn(0x7faf1406ae10 msgr2=0x7faf1406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.567+0000 7faf1b08f640 1 -- 172.21.15.31:0/2396842760 shutdown_connections 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.567+0000 7faf1b08f640 1 -- 172.21.15.31:0/2396842760 wait complete. 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.568+0000 7faf1b08f640 1 Processor -- start 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.568+0000 7faf1b08f640 1 -- start start 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf1b08f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf14069f70 0x7faf14147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf1b08f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf140b9220 0x7faf14145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf1b08f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf1414afe0 0x7faf141e3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf1b08f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf141e34e0 con 0x7faf140b9220 2023-12-22T08:41:42.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf1b08f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1409ef40 con 0x7faf1414afe0 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf1b08f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf141460f0 con 0x7faf14069f70 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf13fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf140b9220 0x7faf14145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf13fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf140b9220 0x7faf14145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45994/0 (socket says 172.21.15.31:45994) 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf13fff640 1 -- 172.21.15.31:0/3551544402 learned_addr learned my addr 172.21.15.31:0/3551544402 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf18e2b640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf14069f70 0x7faf14147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf1962c640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf1414afe0 0x7faf141e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf13fff640 1 -- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf14069f70 msgr2=0x7faf14147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf13fff640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf14069f70 0x7faf14147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf13fff640 1 -- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf1414afe0 msgr2=0x7faf141e3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf13fff640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf1414afe0 0x7faf141e3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.569+0000 7faf13fff640 1 -- 172.21.15.31:0/3551544402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040094d0 con 0x7faf140b9220 2023-12-22T08:41:42.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.570+0000 7faf13fff640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf140b9220 0x7faf14145610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c7f0 tx=0x7faf0800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.570+0000 7faf117fa640 1 -- 172.21.15.31:0/3551544402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08007a30 con 0x7faf140b9220 2023-12-22T08:41:42.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.570+0000 7faf117fa640 1 -- 172.21.15.31:0/3551544402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf08007b90 con 0x7faf140b9220 2023-12-22T08:41:42.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.570+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf14148250 con 0x7faf140b9220 2023-12-22T08:41:42.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.570+0000 7faf117fa640 1 -- 172.21.15.31:0/3551544402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800ce40 con 0x7faf140b9220 2023-12-22T08:41:42.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.570+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf14145e10 con 0x7faf140b9220 2023-12-22T08:41:42.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.571+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf14066e10 con 0x7faf140b9220 2023-12-22T08:41:42.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.571+0000 7faf117fa640 1 -- 172.21.15.31:0/3551544402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faf080113f0 con 0x7faf140b9220 2023-12-22T08:41:42.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.572+0000 7faf117fa640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7faf0006a430 0x7faf0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.572+0000 7faf117fa640 1 -- 172.21.15.31:0/3551544402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf080889a0 con 0x7faf140b9220 2023-12-22T08:41:42.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.572+0000 7faf18e2b640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7faf0006a430 0x7faf0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.572+0000 7faf18e2b640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7faf0006a430 0x7faf0006c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005660 tx=0x7faf0c003d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.576+0000 7faf117fa640 1 -- 172.21.15.31:0/3551544402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faf080540d0 con 0x7faf140b9220 2023-12-22T08:41:42.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.753+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7faf1406bda0 con 0x7faf0006a430 2023-12-22T08:41:42.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.754+0000 7faf117fa640 1 -- 172.21.15.31:0/3551544402 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faf0c00fe00 con 0x7faf0006a430 2023-12-22T08:41:42.756 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2023-12-22T08:41:42.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7faf0006a430 msgr2=0x7faf0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7faf0006a430 0x7faf0006c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005660 tx=0x7faf0c003d90 comp rx=0 tx=0).stop 2023-12-22T08:41:42.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf140b9220 msgr2=0x7faf14145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf140b9220 0x7faf14145610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c7f0 tx=0x7faf0800cbf0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 shutdown_connections 2023-12-22T08:41:42.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7faf0006a430 0x7faf0006c8f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf1414afe0 0x7faf141e3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf140b9220 0x7faf14145610 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 --2- 172.21.15.31:0/3551544402 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faf14069f70 0x7faf14147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 >> 172.21.15.31:0/3551544402 conn(0x7faf1406ae10 msgr2=0x7faf141422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 shutdown_connections 2023-12-22T08:41:42.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.756+0000 7faf1b08f640 1 -- 172.21.15.31:0/3551544402 wait complete. 2023-12-22T08:41:42.768 INFO:tasks.ceph:Scrubbing osd.4 2023-12-22T08:41:42.769 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:41:42.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.875+0000 7f9be9ffd640 1 Processor -- start 2023-12-22T08:41:42.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.875+0000 7f9be9ffd640 1 -- start start 2023-12-22T08:41:42.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be9ffd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9be40b8340 0x7f9be414b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be9ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be40bacf0 0x7f9be40ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be9ffd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be414af40 con 0x7f9be4140f40 2023-12-22T08:41:42.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be9ffd640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be40b7ee0 con 0x7f9be40b8340 2023-12-22T08:41:42.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be9ffd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be41450a0 con 0x7f9be40bacf0 2023-12-22T08:41:42.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be3fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9be4140f40 0x7f9be414dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33644/0 (socket says 172.21.15.31:33644) 2023-12-22T08:41:42.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be3fff640 1 -- 172.21.15.31:0/1882219027 learned_addr learned my addr 172.21.15.31:0/1882219027 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be37fe640 1 --2- 172.21.15.31:0/1882219027 >> v2:172.21.15.69:3300/0 conn(0x7f9be40b8340 0x7f9be414b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be2ffd640 1 --2- 172.21.15.31:0/1882219027 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be40bacf0 0x7f9be40ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be27fc640 1 -- 172.21.15.31:0/1882219027 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989050832 0 0) 0x7f9be414af40 con 0x7f9be4140f40 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.876+0000 7f9be27fc640 1 -- 172.21.15.31:0/1882219027 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bcc003520 con 0x7f9be4140f40 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.877+0000 7f9be27fc640 1 -- 172.21.15.31:0/1882219027 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2276345288 0 0) 0x7f9bcc003520 con 0x7f9be4140f40 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.877+0000 7f9be2ffd640 1 -- 172.21.15.31:0/1882219027 >> v2:172.21.15.69:3300/0 conn(0x7f9be40b8340 msgr2=0x7f9be414b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.877+0000 7f9be2ffd640 1 --2- 172.21.15.31:0/1882219027 >> v2:172.21.15.69:3300/0 conn(0x7f9be40b8340 0x7f9be414b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.877+0000 7f9be2ffd640 1 -- 172.21.15.31:0/1882219027 >> v1:172.21.15.31:6789/0 conn(0x7f9be4140f40 legacy=0x7f9be414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.877+0000 7f9be2ffd640 1 -- 172.21.15.31:0/1882219027 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be414ac10 con 0x7f9be40bacf0 2023-12-22T08:41:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be2ffd640 1 --2- 172.21.15.31:0/1882219027 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be40bacf0 0x7f9be40ba230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80097a0 tx=0x7f9bd802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af98847e4de5c960 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be27fc640 1 -- 172.21.15.31:0/1882219027 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd802f050 con 0x7f9be40bacf0 2023-12-22T08:41:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be27fc640 1 -- 172.21.15.31:0/1882219027 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd8031500 con 0x7f9be40bacf0 2023-12-22T08:41:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be27fc640 1 -- 172.21.15.31:0/1882219027 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0019f0 con 0x7f9be40bacf0 2023-12-22T08:41:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be9ffd640 1 -- 172.21.15.31:0/1882219027 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be40bacf0 msgr2=0x7f9be40ba230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be9ffd640 1 --2- 172.21.15.31:0/1882219027 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be40bacf0 0x7f9be40ba230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80097a0 tx=0x7f9bd802b820 comp rx=0 tx=0).stop 2023-12-22T08:41:42.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be9ffd640 1 -- 172.21.15.31:0/1882219027 shutdown_connections 2023-12-22T08:41:42.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be9ffd640 1 --2- 172.21.15.31:0/1882219027 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be40bacf0 0x7f9be40ba230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be9ffd640 1 --2- 172.21.15.31:0/1882219027 >> v2:172.21.15.69:3300/0 conn(0x7f9be40b8340 0x7f9be414b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be9ffd640 1 -- 172.21.15.31:0/1882219027 >> 172.21.15.31:0/1882219027 conn(0x7f9be40c0370 msgr2=0x7f9be40c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be9ffd640 1 -- 172.21.15.31:0/1882219027 shutdown_connections 2023-12-22T08:41:42.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.878+0000 7f9be9ffd640 1 -- 172.21.15.31:0/1882219027 wait complete. 2023-12-22T08:41:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.879+0000 7f9be9ffd640 1 Processor -- start 2023-12-22T08:41:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be9ffd640 1 -- start start 2023-12-22T08:41:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be9ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be40b8340 0x7f9be414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be9ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be40bacf0 0x7f9be413f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be9ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be4140f40 0x7f9be41e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be9ffd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be413fbb0 con 0x7f9be40bacf0 2023-12-22T08:41:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be9ffd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be414dde0 con 0x7f9be40b8340 2023-12-22T08:41:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be9ffd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be414e0c0 con 0x7f9be4140f40 2023-12-22T08:41:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be40bacf0 0x7f9be413f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be40bacf0 0x7f9be413f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46002/0 (socket says 172.21.15.31:46002) 2023-12-22T08:41:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be2ffd640 1 -- 172.21.15.31:0/2155809685 learned_addr learned my addr 172.21.15.31:0/2155809685 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be3fff640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be4140f40 0x7f9be41e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.880+0000 7f9be37fe640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be40b8340 0x7f9be414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9be2ffd640 1 -- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be4140f40 msgr2=0x7f9be41e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9be2ffd640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9be4140f40 0x7f9be41e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9be2ffd640 1 -- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be40b8340 msgr2=0x7f9be414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9be2ffd640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be40b8340 0x7f9be414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9be2ffd640 1 -- 172.21.15.31:0/2155809685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd8009400 con 0x7f9be40bacf0 2023-12-22T08:41:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9be2ffd640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be40bacf0 0x7f9be413f670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8000c00 tx=0x7f9bd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd803c8d0 con 0x7f9be40bacf0 2023-12-22T08:41:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd803ca30 con 0x7f9be40bacf0 2023-12-22T08:41:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be414e3a0 con 0x7f9be40bacf0 2023-12-22T08:41:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd803cde0 con 0x7f9be40bacf0 2023-12-22T08:41:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.881+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be4140260 con 0x7f9be40bacf0 2023-12-22T08:41:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.882+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9be414dc70 con 0x7f9be40bacf0 2023-12-22T08:41:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.882+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9bd803a040 con 0x7f9be40bacf0 2023-12-22T08:41:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.883+0000 7f9bcbfff640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9bd006a430 0x7f9bd006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.883+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bd80a9f30 con 0x7f9be40bacf0 2023-12-22T08:41:42.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.883+0000 7f9be37fe640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9bd006a430 0x7f9bd006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.883+0000 7f9bcbfff640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f9bd00725d0 0x7f9bd00749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.883+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 --> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bd00750a0 con 0x7f9bd00725d0 2023-12-22T08:41:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.883+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bd802f020 con 0x7f9be40bacf0 2023-12-22T08:41:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.883+0000 7f9be3fff640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f9bd00725d0 0x7f9bd00749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.883+0000 7f9be37fe640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9bd006a430 0x7f9bd006c8f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009aa0 tx=0x7f9bd4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.884+0000 7f9be3fff640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f9bd00725d0 0x7f9bd00749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.884+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 <== osd.4 v2:172.21.15.69:6800/120280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9bd00750a0 con 0x7f9bd00725d0 2023-12-22T08:41:42.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.897+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 --> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9be40ba770 con 0x7f9bd00725d0 2023-12-22T08:41:42.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.897+0000 7f9bcbfff640 1 -- 172.21.15.31:0/2155809685 <== osd.4 v2:172.21.15.69:6800/120280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9bdc0019b0 con 0x7f9bd00725d0 2023-12-22T08:41:42.900 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T08:41:42.900 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f9bd00725d0 msgr2=0x7f9bd00749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6800/120280,v1:172.21.15.69:6801/120280] conn(0x7f9bd00725d0 0x7f9bd00749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9bd006a430 msgr2=0x7f9bd006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f9bd006a430 0x7f9bd006c8f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009aa0 tx=0x7f9bd4009190 comp rx=0 tx=0).stop 2023-12-22T08:41:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be40bacf0 msgr2=0x7f9be413f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 --2- 172.21.15.31:0/2155809685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be40bacf0 0x7f9be413f670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8000c00 tx=0x7f9bd80046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be3fff640 1 -- 172.21.15.31:0/2155809685 reap_dead start 2023-12-22T08:41:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 shutdown_connections 2023-12-22T08:41:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 >> 172.21.15.31:0/2155809685 conn(0x7f9be40c0370 msgr2=0x7f9be40c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 shutdown_connections 2023-12-22T08:41:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:42.898+0000 7f9be9ffd640 1 -- 172.21.15.31:0/2155809685 wait complete. 2023-12-22T08:41:42.910 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-22T08:41:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.014+0000 7fee793b9640 1 Processor -- start 2023-12-22T08:41:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.014+0000 7fee793b9640 1 -- start start 2023-12-22T08:41:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee793b9640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fee7406a390 0x7fee74148260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee793b9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee7406ecb0 0x7fee74070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee793b9640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee741487a0 con 0x7fee740711f0 2023-12-22T08:41:43.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee793b9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee74147e40 con 0x7fee7406ecb0 2023-12-22T08:41:43.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee793b9640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee740b3660 con 0x7fee7406a390 2023-12-22T08:41:43.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee727fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee7406ecb0 0x7fee74070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee727fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fee7406ecb0 0x7fee74070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46014/0 (socket says 172.21.15.31:46014) 2023-12-22T08:41:43.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee727fc640 1 -- 172.21.15.31:0/1280489995 learned_addr learned my addr 172.21.15.31:0/1280489995 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:43.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.015+0000 7fee72ffd640 1 --2- 172.21.15.31:0/1280489995 >> v2:172.21.15.69:3300/0 conn(0x7fee7406a390 0x7fee74148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee727fc640 1 -- 172.21.15.31:0/1280489995 >> v2:172.21.15.69:3300/0 conn(0x7fee7406a390 msgr2=0x7fee74148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee727fc640 1 --2- 172.21.15.31:0/1280489995 >> v2:172.21.15.69:3300/0 conn(0x7fee7406a390 0x7fee74148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee727fc640 1 -- 172.21.15.31:0/1280489995 >> v1:172.21.15.69:6789/0 conn(0x7fee740711f0 legacy=0x7fee74141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee727fc640 1 -- 172.21.15.31:0/1280489995 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740716b0 con 0x7fee7406ecb0 2023-12-22T08:41:43.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee72ffd640 1 --2- 172.21.15.31:0/1280489995 >> v2:172.21.15.69:3300/0 conn(0x7fee7406a390 0x7fee74148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:41:43.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee727fc640 1 --2- 172.21.15.31:0/1280489995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee7406ecb0 0x7fee74070cb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fee7406d0a0 tx=0x7fee5c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33f5e1fbd80a93 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee71ffb640 1 -- 172.21.15.31:0/1280489995 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c030860 con 0x7fee7406ecb0 2023-12-22T08:41:43.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee71ffb640 1 -- 172.21.15.31:0/1280489995 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0309c0 con 0x7fee7406ecb0 2023-12-22T08:41:43.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.016+0000 7fee71ffb640 1 -- 172.21.15.31:0/1280489995 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c030d50 con 0x7fee7406ecb0 2023-12-22T08:41:43.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.017+0000 7fee793b9640 1 -- 172.21.15.31:0/1280489995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee7406ecb0 msgr2=0x7fee74070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.017+0000 7fee793b9640 1 --2- 172.21.15.31:0/1280489995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee7406ecb0 0x7fee74070cb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fee7406d0a0 tx=0x7fee5c02b9a0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.017+0000 7fee793b9640 1 -- 172.21.15.31:0/1280489995 shutdown_connections 2023-12-22T08:41:43.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.017+0000 7fee793b9640 1 --2- 172.21.15.31:0/1280489995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee7406ecb0 0x7fee74070cb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.017+0000 7fee793b9640 1 --2- 172.21.15.31:0/1280489995 >> v2:172.21.15.69:3300/0 conn(0x7fee7406a390 0x7fee74148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.017+0000 7fee793b9640 1 -- 172.21.15.31:0/1280489995 >> 172.21.15.31:0/1280489995 conn(0x7fee740bc330 msgr2=0x7fee740bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.017+0000 7fee793b9640 1 -- 172.21.15.31:0/1280489995 shutdown_connections 2023-12-22T08:41:43.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.017+0000 7fee793b9640 1 -- 172.21.15.31:0/1280489995 wait complete. 2023-12-22T08:41:43.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.018+0000 7fee793b9640 1 Processor -- start 2023-12-22T08:41:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.018+0000 7fee793b9640 1 -- start start 2023-12-22T08:41:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee793b9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee7406a390 0x7fee741489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee793b9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7406ecb0 0x7fee74137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee793b9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee740711f0 0x7fee7414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee793b9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee740b6300 con 0x7fee740711f0 2023-12-22T08:41:43.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee793b9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74148ef0 con 0x7fee7406ecb0 2023-12-22T08:41:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee793b9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee74145a60 con 0x7fee7406a390 2023-12-22T08:41:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee737fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee740711f0 0x7fee7414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee737fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee740711f0 0x7fee7414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46016/0 (socket says 172.21.15.31:46016) 2023-12-22T08:41:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee737fe640 1 -- 172.21.15.31:0/1467672506 learned_addr learned my addr 172.21.15.31:0/1467672506 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee72ffd640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee7406a390 0x7fee741489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee727fc640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7406ecb0 0x7fee74137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee737fe640 1 -- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee7406a390 msgr2=0x7fee741489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee737fe640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee7406a390 0x7fee741489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee737fe640 1 -- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7406ecb0 msgr2=0x7fee74137cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee737fe640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7406ecb0 0x7fee74137cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.019+0000 7fee737fe640 1 -- 172.21.15.31:0/1467672506 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0094d0 con 0x7fee740711f0 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.020+0000 7fee737fe640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee740711f0 0x7fee7414b2e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00c3f0 tx=0x7fee6c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.020+0000 7fee6b7fe640 1 -- 172.21.15.31:0/1467672506 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0052d0 con 0x7fee740711f0 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.020+0000 7fee6b7fe640 1 -- 172.21.15.31:0/1467672506 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c005430 con 0x7fee740711f0 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.020+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee741490f0 con 0x7fee740711f0 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.020+0000 7fee6b7fe640 1 -- 172.21.15.31:0/1467672506 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c003830 con 0x7fee740711f0 2023-12-22T08:41:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.020+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee741496b0 con 0x7fee740711f0 2023-12-22T08:41:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.021+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee74147a40 con 0x7fee740711f0 2023-12-22T08:41:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.021+0000 7fee6b7fe640 1 -- 172.21.15.31:0/1467672506 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee6c003990 con 0x7fee740711f0 2023-12-22T08:41:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.021+0000 7fee6b7fe640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee5406a430 0x7fee5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.022+0000 7fee6b7fe640 1 -- 172.21.15.31:0/1467672506 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee6c087ce0 con 0x7fee740711f0 2023-12-22T08:41:43.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.022+0000 7fee72ffd640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee5406a430 0x7fee5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.022+0000 7fee72ffd640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee5406a430 0x7fee5406c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee64003b80 tx=0x7fee64009890 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.026+0000 7fee6b7fe640 1 -- 172.21.15.31:0/1467672506 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fee74147a40 con 0x7fee740711f0 2023-12-22T08:41:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.205+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fee7406a770 con 0x7fee5406a430 2023-12-22T08:41:43.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.206+0000 7fee6b7fe640 1 -- 172.21.15.31:0/1467672506 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee6400f040 con 0x7fee5406a430 2023-12-22T08:41:43.208 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 4 to deep-scrub 2023-12-22T08:41:43.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee5406a430 msgr2=0x7fee5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee5406a430 0x7fee5406c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee64003b80 tx=0x7fee64009890 comp rx=0 tx=0).stop 2023-12-22T08:41:43.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee740711f0 msgr2=0x7fee7414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee740711f0 0x7fee7414b2e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00c3f0 tx=0x7fee6c00c7f0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 shutdown_connections 2023-12-22T08:41:43.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fee5406a430 0x7fee5406c8f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee740711f0 0x7fee7414b2e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee7406ecb0 0x7fee74137cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 --2- 172.21.15.31:0/1467672506 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fee7406a390 0x7fee741489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 >> 172.21.15.31:0/1467672506 conn(0x7fee740bc330 msgr2=0x7fee740b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 shutdown_connections 2023-12-22T08:41:43.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.208+0000 7fee793b9640 1 -- 172.21.15.31:0/1467672506 wait complete. 2023-12-22T08:41:43.220 INFO:tasks.ceph:Scrubbing osd.5 2023-12-22T08:41:43.221 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:41:43.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.328+0000 7f7535a5f640 1 Processor -- start 2023-12-22T08:41:43.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.328+0000 7f7535a5f640 1 -- start start 2023-12-22T08:41:43.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f7535a5f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300bacf0 0x7f75300ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f7535a5f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7530140f40 0x7f75301413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f7535a5f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753014af40 con 0x7f75300b8340 2023-12-22T08:41:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f7535a5f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7530141910 con 0x7f7530140f40 2023-12-22T08:41:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f7535a5f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75300b7ee0 con 0x7f75300bacf0 2023-12-22T08:41:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7530140f40 0x7f75301413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7530140f40 0x7f75301413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46020/0 (socket says 172.21.15.31:46020) 2023-12-22T08:41:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752f7fe640 1 -- 172.21.15.31:0/3587154620 learned_addr learned my addr 172.21.15.31:0/3587154620 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752effd640 1 --1- 172.21.15.31:0/3587154620 >> v1:172.21.15.31:6789/0 conn(0x7f75300b8340 0x7f753014b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33660/0 (socket says 172.21.15.31:33660) 2023-12-22T08:41:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752e7fc640 1 --2- 172.21.15.31:0/3587154620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300bacf0 0x7f75300ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752f7fe640 1 -- 172.21.15.31:0/3587154620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300bacf0 msgr2=0x7f75300ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752f7fe640 1 --2- 172.21.15.31:0/3587154620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300bacf0 0x7f75300ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752f7fe640 1 -- 172.21.15.31:0/3587154620 >> v1:172.21.15.31:6789/0 conn(0x7f75300b8340 legacy=0x7f753014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752f7fe640 1 -- 172.21.15.31:0/3587154620 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75301450a0 con 0x7f7530140f40 2023-12-22T08:41:43.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.329+0000 7f752dffb640 1 -- 172.21.15.31:0/3587154620 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431448121 0 0) 0x7f753014af40 con 0x7f75300b8340 2023-12-22T08:41:43.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.330+0000 7f752f7fe640 1 --2- 172.21.15.31:0/3587154620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7530140f40 0x7f75301413d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7520009e50 tx=0x7f752002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc4c753c2e4691a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.330+0000 7f752dffb640 1 -- 172.21.15.31:0/3587154620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752002cb90 con 0x7f7530140f40 2023-12-22T08:41:43.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.330+0000 7f752dffb640 1 -- 172.21.15.31:0/3587154620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752002ccf0 con 0x7f7530140f40 2023-12-22T08:41:43.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.330+0000 7f752dffb640 1 -- 172.21.15.31:0/3587154620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520034610 con 0x7f7530140f40 2023-12-22T08:41:43.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.331+0000 7f7535a5f640 1 -- 172.21.15.31:0/3587154620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7530140f40 msgr2=0x7f75301413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.331+0000 7f7535a5f640 1 --2- 172.21.15.31:0/3587154620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7530140f40 0x7f75301413d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7520009e50 tx=0x7f752002bff0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.331+0000 7f7535a5f640 1 -- 172.21.15.31:0/3587154620 shutdown_connections 2023-12-22T08:41:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.331+0000 7f7535a5f640 1 --2- 172.21.15.31:0/3587154620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7530140f40 0x7f75301413d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.331+0000 7f7535a5f640 1 --2- 172.21.15.31:0/3587154620 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300bacf0 0x7f75300ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.331+0000 7f7535a5f640 1 -- 172.21.15.31:0/3587154620 >> 172.21.15.31:0/3587154620 conn(0x7f75300c0370 msgr2=0x7f75300c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.331+0000 7f7535a5f640 1 -- 172.21.15.31:0/3587154620 shutdown_connections 2023-12-22T08:41:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.331+0000 7f7535a5f640 1 -- 172.21.15.31:0/3587154620 wait complete. 2023-12-22T08:41:43.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.332+0000 7f7535a5f640 1 Processor -- start 2023-12-22T08:41:43.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.332+0000 7f7535a5f640 1 -- start start 2023-12-22T08:41:43.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f7535a5f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300b8340 0x7f753014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f7535a5f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300bacf0 0x7f75301440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f7535a5f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7530140f40 0x7f75301e3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f7535a5f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530143ca0 con 0x7f75300bacf0 2023-12-22T08:41:43.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f7535a5f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75301e2bc0 con 0x7f7530140f40 2023-12-22T08:41:43.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f7535a5f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753014d300 con 0x7f75300b8340 2023-12-22T08:41:43.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300bacf0 0x7f75301440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300bacf0 0x7f75301440f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46034/0 (socket says 172.21.15.31:46034) 2023-12-22T08:41:43.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 -- 172.21.15.31:0/2307303998 learned_addr learned my addr 172.21.15.31:0/2307303998 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:43.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752effd640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300b8340 0x7f753014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752f7fe640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7530140f40 0x7f75301e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 -- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300b8340 msgr2=0x7f753014ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f75300b8340 0x7f753014ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 -- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7530140f40 msgr2=0x7f75301e3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7530140f40 0x7f75301e3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 -- 172.21.15.31:0/2307303998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009b30 con 0x7f75300bacf0 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.333+0000 7f752e7fc640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300bacf0 0x7f75301440f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f751800d800 tx=0x7f751800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.334+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800b6c0 con 0x7f75300bacf0 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.334+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751800b820 con 0x7f75300bacf0 2023-12-22T08:41:43.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.334+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753014e740 con 0x7f75300bacf0 2023-12-22T08:41:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.334+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800bbb0 con 0x7f75300bacf0 2023-12-22T08:41:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.334+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753014e320 con 0x7f75300bacf0 2023-12-22T08:41:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.334+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f753014eb60 con 0x7f75300bacf0 2023-12-22T08:41:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.335+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f751800bd10 con 0x7f75300bacf0 2023-12-22T08:41:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.335+0000 7f7527fff640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f751006a460 0x7f751006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.335+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7518088c30 con 0x7f75300bacf0 2023-12-22T08:41:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.336+0000 7f7527fff640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7f7510072600 0x7f7510074a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.336+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 --> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75100750d0 con 0x7f7510072600 2023-12-22T08:41:43.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.336+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f751808b270 con 0x7f75300bacf0 2023-12-22T08:41:43.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.336+0000 7f752effd640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f751006a460 0x7f751006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.336+0000 7f752f7fe640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7f7510072600 0x7f7510074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.336+0000 7f752effd640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f751006a460 0x7f751006c920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7528000f60 tx=0x7f7528007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.336+0000 7f752f7fe640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7f7510072600 0x7f7510074a20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.337+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 <== osd.5 v2:172.21.15.69:6808/120281 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f75100750d0 con 0x7f7510072600 2023-12-22T08:41:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 --> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f75300ba770 con 0x7f7510072600 2023-12-22T08:41:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f7527fff640 1 -- 172.21.15.31:0/2307303998 <== osd.5 v2:172.21.15.69:6808/120281 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f752002cae0 con 0x7f7510072600 2023-12-22T08:41:43.352 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:43.353 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T08:41:43.353 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7f7510072600 msgr2=0x7f7510074a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f7535a5f640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6808/120281,v1:172.21.15.69:6809/120281] conn(0x7f7510072600 0x7f7510074a20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f751006a460 msgr2=0x7f751006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f7535a5f640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f751006a460 0x7f751006c920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7528000f60 tx=0x7f7528007d50 comp rx=0 tx=0).stop 2023-12-22T08:41:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300bacf0 msgr2=0x7f75301440f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f7535a5f640 1 --2- 172.21.15.31:0/2307303998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75300bacf0 0x7f75301440f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f751800d800 tx=0x7f751800dcc0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.350+0000 7f752f7fe640 1 -- 172.21.15.31:0/2307303998 reap_dead start 2023-12-22T08:41:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.351+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 shutdown_connections 2023-12-22T08:41:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.351+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 >> 172.21.15.31:0/2307303998 conn(0x7f75300c0370 msgr2=0x7f753014b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.351+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 shutdown_connections 2023-12-22T08:41:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.351+0000 7f7535a5f640 1 -- 172.21.15.31:0/2307303998 wait complete. 2023-12-22T08:41:43.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-22T08:41:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.468+0000 7ff0f091b640 1 Processor -- start 2023-12-22T08:41:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.468+0000 7ff0f091b640 1 -- start start 2023-12-22T08:41:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0f091b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff0ec144dd0 0x7ff0ec14e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0f091b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec0b7fb0 0x7ff0ec0b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0f091b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec14ef70 con 0x7ff0ec14e670 2023-12-22T08:41:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0f091b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec0b9a20 con 0x7ff0ec144dd0 2023-12-22T08:41:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0f091b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0b6d30 con 0x7ff0ec0b7fb0 2023-12-22T08:41:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0ea59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff0ec144dd0 0x7ff0ec14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0ea59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff0ec144dd0 0x7ff0ec14e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46046/0 (socket says 172.21.15.31:46046) 2023-12-22T08:41:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0ea59c640 1 -- 172.21.15.31:0/516285880 learned_addr learned my addr 172.21.15.31:0/516285880 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0e9d9b640 1 --2- 172.21.15.31:0/516285880 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec0b7fb0 0x7ff0ec0b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0ea59c640 1 -- 172.21.15.31:0/516285880 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec0b7fb0 msgr2=0x7ff0ec0b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0ea59c640 1 --2- 172.21.15.31:0/516285880 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec0b7fb0 0x7ff0ec0b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0ea59c640 1 -- 172.21.15.31:0/516285880 >> v1:172.21.15.69:6789/0 conn(0x7ff0ec14e670 legacy=0x7ff0ec14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.469+0000 7ff0ea59c640 1 -- 172.21.15.31:0/516285880 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0bca70 con 0x7ff0ec144dd0 2023-12-22T08:41:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.470+0000 7ff0ea59c640 1 --2- 172.21.15.31:0/516285880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec14e130 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009870 tx=0x7ff0e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af807abe79f5b7c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.470+0000 7ff0e959a640 1 -- 172.21.15.31:0/516285880 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4030840 con 0x7ff0ec144dd0 2023-12-22T08:41:43.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.470+0000 7ff0e959a640 1 -- 172.21.15.31:0/516285880 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e40309a0 con 0x7ff0ec144dd0 2023-12-22T08:41:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.470+0000 7ff0e959a640 1 -- 172.21.15.31:0/516285880 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4030d30 con 0x7ff0ec144dd0 2023-12-22T08:41:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.471+0000 7ff0f091b640 1 -- 172.21.15.31:0/516285880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 msgr2=0x7ff0ec14e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.471+0000 7ff0f091b640 1 --2- 172.21.15.31:0/516285880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec14e130 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009870 tx=0x7ff0e402b980 comp rx=0 tx=0).stop 2023-12-22T08:41:43.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.471+0000 7ff0f091b640 1 -- 172.21.15.31:0/516285880 shutdown_connections 2023-12-22T08:41:43.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.471+0000 7ff0f091b640 1 --2- 172.21.15.31:0/516285880 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec0b7fb0 0x7ff0ec0b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.471+0000 7ff0f091b640 1 --2- 172.21.15.31:0/516285880 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec14e130 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.471+0000 7ff0f091b640 1 -- 172.21.15.31:0/516285880 >> 172.21.15.31:0/516285880 conn(0x7ff0ec0c03d0 msgr2=0x7ff0ec0c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.471+0000 7ff0f091b640 1 -- 172.21.15.31:0/516285880 shutdown_connections 2023-12-22T08:41:43.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.471+0000 7ff0f091b640 1 -- 172.21.15.31:0/516285880 wait complete. 2023-12-22T08:41:43.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.472+0000 7ff0f091b640 1 Processor -- start 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.472+0000 7ff0f091b640 1 -- start start 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0f091b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0ec0b7fb0 0x7ff0ec0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0f091b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec1d5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0f091b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec14e670 0x7ff0ec1d5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0f091b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1d7970 con 0x7ff0ec144dd0 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0f091b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1d5550 con 0x7ff0ec0b7fb0 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0f091b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1d7e30 con 0x7ff0ec14e670 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec1d5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec1d5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46050/0 (socket says 172.21.15.31:46050) 2023-12-22T08:41:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 -- 172.21.15.31:0/410031130 learned_addr learned my addr 172.21.15.31:0/410031130 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0ea59c640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0ec0b7fb0 0x7ff0ec0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0ead9d640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec14e670 0x7ff0ec1d5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 -- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec14e670 msgr2=0x7ff0ec1d5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec14e670 0x7ff0ec1d5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 -- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0ec0b7fb0 msgr2=0x7ff0ec0aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0ec0b7fb0 0x7ff0ec0aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 -- 172.21.15.31:0/410031130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40094d0 con 0x7ff0ec144dd0 2023-12-22T08:41:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0ead9d640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec14e670 0x7ff0ec1d5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e9d9b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec1d5010 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400c820 tx=0x7ff0d400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.473+0000 7ff0e2ffd640 1 -- 172.21.15.31:0/410031130 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4004220 con 0x7ff0ec144dd0 2023-12-22T08:41:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.474+0000 7ff0e2ffd640 1 -- 172.21.15.31:0/410031130 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d40043a0 con 0x7ff0ec144dd0 2023-12-22T08:41:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.474+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec1d46f0 con 0x7ff0ec144dd0 2023-12-22T08:41:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.474+0000 7ff0e2ffd640 1 -- 172.21.15.31:0/410031130 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4007a70 con 0x7ff0ec144dd0 2023-12-22T08:41:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.474+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec1d4bd0 con 0x7ff0ec144dd0 2023-12-22T08:41:43.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.475+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec1d4880 con 0x7ff0ec144dd0 2023-12-22T08:41:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.475+0000 7ff0e2ffd640 1 -- 172.21.15.31:0/410031130 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff0d4007bd0 con 0x7ff0ec144dd0 2023-12-22T08:41:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.475+0000 7ff0e2ffd640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0cc06a430 0x7ff0cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.476+0000 7ff0e2ffd640 1 -- 172.21.15.31:0/410031130 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0d4088730 con 0x7ff0ec144dd0 2023-12-22T08:41:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.476+0000 7ff0ea59c640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0cc06a430 0x7ff0cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.476+0000 7ff0ea59c640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0cc06a430 0x7ff0cc06c8f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4036000 tx=0x7ff0e4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.480+0000 7ff0e2ffd640 1 -- 172.21.15.31:0/410031130 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff0d4053d10 con 0x7ff0ec144dd0 2023-12-22T08:41:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.657+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0ec0b77d0 con 0x7ff0cc06a430 2023-12-22T08:41:43.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.657+0000 7ff0e2ffd640 1 -- 172.21.15.31:0/410031130 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff0e4044470 con 0x7ff0cc06a430 2023-12-22T08:41:43.660 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 5 to deep-scrub 2023-12-22T08:41:43.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0cc06a430 msgr2=0x7ff0cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0cc06a430 0x7ff0cc06c8f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4036000 tx=0x7ff0e4008030 comp rx=0 tx=0).stop 2023-12-22T08:41:43.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 msgr2=0x7ff0ec1d5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec1d5010 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400c820 tx=0x7ff0d400cce0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 shutdown_connections 2023-12-22T08:41:43.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0cc06a430 0x7ff0cc06c8f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0ec14e670 0x7ff0ec1d5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ec144dd0 0x7ff0ec1d5010 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 --2- 172.21.15.31:0/410031130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0ec0b7fb0 0x7ff0ec0aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 >> 172.21.15.31:0/410031130 conn(0x7ff0ec0c03d0 msgr2=0x7ff0ec0b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 shutdown_connections 2023-12-22T08:41:43.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.659+0000 7ff0f091b640 1 -- 172.21.15.31:0/410031130 wait complete. 2023-12-22T08:41:43.673 INFO:tasks.ceph:Scrubbing osd.6 2023-12-22T08:41:43.673 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:41:43.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.781+0000 7f27bc7dc640 1 Processor -- start 2023-12-22T08:41:43.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.781+0000 7f27bc7dc640 1 -- start start 2023-12-22T08:41:43.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27bc7dc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f27b4141520 0x7f27b40bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27bc7dc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b40b83d0 con 0x7f27b40b8b40 2023-12-22T08:41:43.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27bc7dc640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b40b86b0 con 0x7f27b40b7740 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27bc7dc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b4141900 con 0x7f27b4141520 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27ba578640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f27b4141520 0x7f27b40bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27b9d77640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f27b40b8b40 0x7f27b414a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33664/0 (socket says 172.21.15.31:33664) 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27b9d77640 1 -- 172.21.15.31:0/3909147547 learned_addr learned my addr 172.21.15.31:0/3909147547 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27ba578640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f27b4141520 0x7f27b40bc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46066/0 (socket says 172.21.15.31:46066) 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27ba578640 1 -- 172.21.15.31:0/3909147547 >> v1:172.21.15.69:6789/0 conn(0x7f27b40b7740 legacy=0x7f27b41552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27ba578640 1 -- 172.21.15.31:0/3909147547 >> v1:172.21.15.31:6789/0 conn(0x7f27b40b8b40 legacy=0x7f27b414a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27b9576640 1 -- 172.21.15.31:0/3909147547 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658812654 0 0) 0x7f27b40b83d0 con 0x7f27b40b8b40 2023-12-22T08:41:43.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.782+0000 7f27ba578640 1 -- 172.21.15.31:0/3909147547 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40bc0c0 con 0x7f27b4141520 2023-12-22T08:41:43.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.783+0000 7f27ba578640 1 --2- 172.21.15.31:0/3909147547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b4141520 0x7f27b40bc520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0097a0 tx=0x7f27ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94567c6ba2ad5d46 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.783+0000 7f27b9576640 1 -- 172.21.15.31:0/3909147547 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac031830 con 0x7f27b4141520 2023-12-22T08:41:43.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.783+0000 7f27b9576640 1 -- 172.21.15.31:0/3909147547 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac031990 con 0x7f27b4141520 2023-12-22T08:41:43.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.783+0000 7f27b9576640 1 -- 172.21.15.31:0/3909147547 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac031d20 con 0x7f27b4141520 2023-12-22T08:41:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.784+0000 7f27bc7dc640 1 -- 172.21.15.31:0/3909147547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b4141520 msgr2=0x7f27b40bc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.784+0000 7f27bc7dc640 1 --2- 172.21.15.31:0/3909147547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b4141520 0x7f27b40bc520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0097a0 tx=0x7f27ac02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.784+0000 7f27bc7dc640 1 -- 172.21.15.31:0/3909147547 shutdown_connections 2023-12-22T08:41:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.784+0000 7f27bc7dc640 1 --2- 172.21.15.31:0/3909147547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b4141520 0x7f27b40bc520 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.784+0000 7f27bc7dc640 1 -- 172.21.15.31:0/3909147547 >> 172.21.15.31:0/3909147547 conn(0x7f27b40c0300 msgr2=0x7f27b40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.784+0000 7f27bc7dc640 1 -- 172.21.15.31:0/3909147547 shutdown_connections 2023-12-22T08:41:43.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.784+0000 7f27bc7dc640 1 -- 172.21.15.31:0/3909147547 wait complete. 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27bc7dc640 1 Processor -- start 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27bc7dc640 1 -- start start 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27bc7dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b40b7740 0x7f27b4149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27bc7dc640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27b40b8b40 0x7f27b41dfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27bc7dc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f27b4141520 0x7f27b41dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27bc7dc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4147a90 con 0x7f27b40b7740 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27bc7dc640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4149fb0 con 0x7f27b40b8b40 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27bc7dc640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b41e04e0 con 0x7f27b4141520 2023-12-22T08:41:43.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27ba578640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b40b7740 0x7f27b4149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27ba578640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b40b7740 0x7f27b4149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46074/0 (socket says 172.21.15.31:46074) 2023-12-22T08:41:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.785+0000 7f27ba578640 1 -- 172.21.15.31:0/912205879 learned_addr learned my addr 172.21.15.31:0/912205879 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27ba578640 1 -- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f27b4141520 msgr2=0x7f27b41dffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27ba578640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f27b4141520 0x7f27b41dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27ba578640 1 -- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27b40b8b40 msgr2=0x7f27b41dfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27b9d77640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27b40b8b40 0x7f27b41dfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27ba578640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27b40b8b40 0x7f27b41dfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27ba578640 1 -- 172.21.15.31:0/912205879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac009400 con 0x7f27b40b7740 2023-12-22T08:41:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27b9d77640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f27b40b8b40 0x7f27b41dfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27ba578640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b40b7740 0x7f27b4149a70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f27ac034040 tx=0x7f27ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac03aa60 con 0x7f27b40b7740 2023-12-22T08:41:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac03abe0 con 0x7f27b40b7740 2023-12-22T08:41:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b4146be0 con 0x7f27b40b7740 2023-12-22T08:41:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac044400 con 0x7f27b40b7740 2023-12-22T08:41:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.786+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b41476b0 con 0x7f27b40b7740 2023-12-22T08:41:43.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.787+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27b40bd3d0 con 0x7f27b40b7740 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.787+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27ac04d440 con 0x7f27b40b7740 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.788+0000 7f27b2ffd640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f27a006a430 0x7f27a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.788+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27ac0aaad0 con 0x7f27b40b7740 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.788+0000 7f27b2ffd640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f27a00725d0 0x7f27a00749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.788+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 --> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27a00750a0 con 0x7f27a00725d0 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.788+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27ac0af2c0 con 0x7f27b40b7740 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.788+0000 7f27b9d77640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f27a006a430 0x7f27a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.788+0000 7f27bad79640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f27a00725d0 0x7f27a00749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.789+0000 7f27b9d77640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f27a006a430 0x7f27a006c8f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27b414a180 tx=0x7f27a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.789+0000 7f27bad79640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f27a00725d0 0x7f27a00749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.789+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 <== osd.6 v2:172.21.15.69:6816/120298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f27a00750a0 con 0x7f27a00725d0 2023-12-22T08:41:43.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.802+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 --> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f27b40bd0f0 con 0x7f27a00725d0 2023-12-22T08:41:43.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27b2ffd640 1 -- 172.21.15.31:0/912205879 <== osd.6 v2:172.21.15.69:6816/120298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f27a4001d80 con 0x7f27a00725d0 2023-12-22T08:41:43.805 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:43.805 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T08:41:43.805 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:43.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f27a00725d0 msgr2=0x7f27a00749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6816/120298,v1:172.21.15.69:6817/120298] conn(0x7f27a00725d0 0x7f27a00749f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f27a006a430 msgr2=0x7f27a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f27a006a430 0x7f27a006c8f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27b414a180 tx=0x7f27a8009040 comp rx=0 tx=0).stop 2023-12-22T08:41:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b40b7740 msgr2=0x7f27b4149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 --2- 172.21.15.31:0/912205879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27b40b7740 0x7f27b4149a70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f27ac034040 tx=0x7f27ac0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bad79640 1 -- 172.21.15.31:0/912205879 reap_dead start 2023-12-22T08:41:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 shutdown_connections 2023-12-22T08:41:43.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 >> 172.21.15.31:0/912205879 conn(0x7f27b40c0300 msgr2=0x7f27b40bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 shutdown_connections 2023-12-22T08:41:43.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.803+0000 7f27bc7dc640 1 -- 172.21.15.31:0/912205879 wait complete. 2023-12-22T08:41:43.816 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-22T08:41:43.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.920+0000 7fe203988640 1 Processor -- start 2023-12-22T08:41:43.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.920+0000 7fe203988640 1 -- start start 2023-12-22T08:41:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.920+0000 7fe203988640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc144ea0 0x7fe1fc0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.920+0000 7fe203988640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe1fc071a40 0x7fe1fc070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.920+0000 7fe203988640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc06bb60 con 0x7fe1fc14abc0 2023-12-22T08:41:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.920+0000 7fe203988640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc069d00 con 0x7fe1fc071a40 2023-12-22T08:41:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.920+0000 7fe203988640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc069ee0 con 0x7fe1fc144ea0 2023-12-22T08:41:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe201724640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc144ea0 0x7fe1fc0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe200f23640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe1fc071a40 0x7fe1fc070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe201f25640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe1fc14abc0 0x7fe1fc14e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:39716/0 (socket says 172.21.15.31:39716) 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe201f25640 1 -- 172.21.15.31:0/3399347172 learned_addr learned my addr 172.21.15.31:0/3399347172 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe200f23640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe1fc071a40 0x7fe1fc070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.31:40948/0 (socket says 172.21.15.31:40948) 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe200f23640 1 -- 172.21.15.31:0/3399347172 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc144ea0 msgr2=0x7fe1fc0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe200f23640 1 --2- 172.21.15.31:0/3399347172 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc144ea0 0x7fe1fc0b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe200f23640 1 -- 172.21.15.31:0/3399347172 >> v1:172.21.15.69:6789/0 conn(0x7fe1fc14abc0 legacy=0x7fe1fc14e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe200f23640 1 -- 172.21.15.31:0/3399347172 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc06a1c0 con 0x7fe1fc071a40 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.921+0000 7fe201724640 1 --2- 172.21.15.31:0/3399347172 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc144ea0 0x7fe1fc0b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:41:43.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.922+0000 7fe200f23640 1 --2- 172.21.15.31:0/3399347172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc071a40 0x7fe1fc070aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0097a0 tx=0x7fe1ec02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e1dc8ba92542803 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.922+0000 7fe1f3fff640 1 -- 172.21.15.31:0/3399347172 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec031830 con 0x7fe1fc071a40 2023-12-22T08:41:43.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.922+0000 7fe1f3fff640 1 -- 172.21.15.31:0/3399347172 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec031990 con 0x7fe1fc071a40 2023-12-22T08:41:43.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.922+0000 7fe1f3fff640 1 -- 172.21.15.31:0/3399347172 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec031d20 con 0x7fe1fc071a40 2023-12-22T08:41:43.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.923+0000 7fe203988640 1 -- 172.21.15.31:0/3399347172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc071a40 msgr2=0x7fe1fc070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.923+0000 7fe203988640 1 --2- 172.21.15.31:0/3399347172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc071a40 0x7fe1fc070aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0097a0 tx=0x7fe1ec02b8d0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.923+0000 7fe203988640 1 -- 172.21.15.31:0/3399347172 shutdown_connections 2023-12-22T08:41:43.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.923+0000 7fe203988640 1 --2- 172.21.15.31:0/3399347172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc071a40 0x7fe1fc070aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.923+0000 7fe203988640 1 --2- 172.21.15.31:0/3399347172 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc144ea0 0x7fe1fc0b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.923+0000 7fe203988640 1 -- 172.21.15.31:0/3399347172 >> 172.21.15.31:0/3399347172 conn(0x7fe1fc0bd240 msgr2=0x7fe1fc0bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:43.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.923+0000 7fe203988640 1 -- 172.21.15.31:0/3399347172 shutdown_connections 2023-12-22T08:41:43.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.923+0000 7fe203988640 1 -- 172.21.15.31:0/3399347172 wait complete. 2023-12-22T08:41:43.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.924+0000 7fe203988640 1 Processor -- start 2023-12-22T08:41:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.924+0000 7fe203988640 1 -- start start 2023-12-22T08:41:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.924+0000 7fe203988640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc071a40 0x7fe1fc14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.924+0000 7fe203988640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1fc144ea0 0x7fe1fc146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.924+0000 7fe203988640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc14abc0 0x7fe1fc0b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.924+0000 7fe203988640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0b8090 con 0x7fe1fc144ea0 2023-12-22T08:41:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.924+0000 7fe203988640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc14dd20 con 0x7fe1fc14abc0 2023-12-22T08:41:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.924+0000 7fe203988640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc14bd00 con 0x7fe1fc071a40 2023-12-22T08:41:43.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1fc144ea0 0x7fe1fc146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1fc144ea0 0x7fe1fc146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46082/0 (socket says 172.21.15.31:46082) 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe201724640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc071a40 0x7fe1fc14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 -- 172.21.15.31:0/1900563987 learned_addr learned my addr 172.21.15.31:0/1900563987 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe201f25640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc14abc0 0x7fe1fc0b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 -- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc071a40 msgr2=0x7fe1fc14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc071a40 0x7fe1fc14e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 -- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc14abc0 msgr2=0x7fe1fc0b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc14abc0 0x7fe1fc0b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:43.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 -- 172.21.15.31:0/1900563987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8009400 con 0x7fe1fc144ea0 2023-12-22T08:41:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe200f23640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1fc144ea0 0x7fe1fc146d40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec034040 tx=0x7fe1ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe1f1ffb640 1 -- 172.21.15.31:0/1900563987 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec03a8f0 con 0x7fe1fc144ea0 2023-12-22T08:41:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe1f1ffb640 1 -- 172.21.15.31:0/1900563987 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec03aa70 con 0x7fe1fc144ea0 2023-12-22T08:41:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec009400 con 0x7fe1fc144ea0 2023-12-22T08:41:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe1f1ffb640 1 -- 172.21.15.31:0/1900563987 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec03ae20 con 0x7fe1fc144ea0 2023-12-22T08:41:43.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.925+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc14c2c0 con 0x7fe1fc144ea0 2023-12-22T08:41:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.926+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc14daf0 con 0x7fe1fc144ea0 2023-12-22T08:41:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.927+0000 7fe1f1ffb640 1 -- 172.21.15.31:0/1900563987 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1ec04d440 con 0x7fe1fc144ea0 2023-12-22T08:41:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.927+0000 7fe1f1ffb640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe1e006a430 0x7fe1e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:43.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.928+0000 7fe1f1ffb640 1 -- 172.21.15.31:0/1900563987 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1ec0aa830 con 0x7fe1fc144ea0 2023-12-22T08:41:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.928+0000 7fe201724640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe1e006a430 0x7fe1e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.928+0000 7fe201724640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe1e006a430 0x7fe1e006c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009cd0 tx=0x7fe1f8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:43.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:43.932+0000 7fe1f1ffb640 1 -- 172.21.15.31:0/1900563987 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe1ec075f60 con 0x7fe1fc144ea0 2023-12-22T08:41:44.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.107+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1fc14f040 con 0x7fe1e006a430 2023-12-22T08:41:44.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.108+0000 7fe1f1ffb640 1 -- 172.21.15.31:0/1900563987 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe1fc14f040 con 0x7fe1e006a430 2023-12-22T08:41:44.110 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 6 to deep-scrub 2023-12-22T08:41:44.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.109+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe1e006a430 msgr2=0x7fe1e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.109+0000 7fe203988640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe1e006a430 0x7fe1e006c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009cd0 tx=0x7fe1f8009190 comp rx=0 tx=0).stop 2023-12-22T08:41:44.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.109+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1fc144ea0 msgr2=0x7fe1fc146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.109+0000 7fe203988640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1fc144ea0 0x7fe1fc146d40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec034040 tx=0x7fe1ec0046c0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.110+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 shutdown_connections 2023-12-22T08:41:44.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.110+0000 7fe203988640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7fe1e006a430 0x7fe1e006c8f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.110+0000 7fe203988640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc14abc0 0x7fe1fc0b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.110+0000 7fe203988640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1fc144ea0 0x7fe1fc146d40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.110+0000 7fe203988640 1 --2- 172.21.15.31:0/1900563987 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe1fc071a40 0x7fe1fc14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.110+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 >> 172.21.15.31:0/1900563987 conn(0x7fe1fc0bd240 msgr2=0x7fe1fc1497b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.110+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 shutdown_connections 2023-12-22T08:41:44.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.110+0000 7fe203988640 1 -- 172.21.15.31:0/1900563987 wait complete. 2023-12-22T08:41:44.122 INFO:tasks.ceph:Scrubbing osd.7 2023-12-22T08:41:44.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-22T08:41:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.230+0000 7f05aff6d640 1 Processor -- start 2023-12-22T08:41:44.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.230+0000 7f05aff6d640 1 -- start start 2023-12-22T08:41:44.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05aff6d640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f05a80b9350 0x7f05a81416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05aff6d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05a8148030 0x7f05a8152110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05aff6d640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a80716d0 con 0x7f05a8141c20 2023-12-22T08:41:44.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05aff6d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a8071a20 con 0x7f05a8148030 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05aff6d640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a8070da0 con 0x7f05a80b9350 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05ae50a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05a8148030 0x7f05a8152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05ae50a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05a8148030 0x7f05a8152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46094/0 (socket says 172.21.15.31:46094) 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05ae50a640 1 -- 172.21.15.31:0/258237211 learned_addr learned my addr 172.21.15.31:0/258237211 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05add09640 1 --2- 172.21.15.31:0/258237211 >> v2:172.21.15.69:3300/0 conn(0x7f05a80b9350 0x7f05a81416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05ae50a640 1 -- 172.21.15.31:0/258237211 >> v2:172.21.15.69:3300/0 conn(0x7f05a80b9350 msgr2=0x7f05a81416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05ae50a640 1 --2- 172.21.15.31:0/258237211 >> v2:172.21.15.69:3300/0 conn(0x7f05a80b9350 0x7f05a81416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05ae50a640 1 -- 172.21.15.31:0/258237211 >> v1:172.21.15.69:6789/0 conn(0x7f05a8141c20 legacy=0x7f05a8147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.231+0000 7f05ae50a640 1 -- 172.21.15.31:0/258237211 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a8071080 con 0x7f05a8148030 2023-12-22T08:41:44.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.232+0000 7f05ae50a640 1 --2- 172.21.15.31:0/258237211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8148030 0x7f05a8152110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f05a80b9ab0 tx=0x7f05a002e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453fc121a44345d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.232+0000 7f05acd07640 1 -- 172.21.15.31:0/258237211 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a000b0d0 con 0x7f05a8148030 2023-12-22T08:41:44.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.232+0000 7f05acd07640 1 -- 172.21.15.31:0/258237211 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a000b230 con 0x7f05a8148030 2023-12-22T08:41:44.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.232+0000 7f05acd07640 1 -- 172.21.15.31:0/258237211 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0009600 con 0x7f05a8148030 2023-12-22T08:41:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.232+0000 7f05aff6d640 1 -- 172.21.15.31:0/258237211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8148030 msgr2=0x7f05a8152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.232+0000 7f05aff6d640 1 --2- 172.21.15.31:0/258237211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8148030 0x7f05a8152110 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f05a80b9ab0 tx=0x7f05a002e180 comp rx=0 tx=0).stop 2023-12-22T08:41:44.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.232+0000 7f05aff6d640 1 -- 172.21.15.31:0/258237211 shutdown_connections 2023-12-22T08:41:44.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.233+0000 7f05aff6d640 1 --2- 172.21.15.31:0/258237211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8148030 0x7f05a8152110 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.233+0000 7f05aff6d640 1 --2- 172.21.15.31:0/258237211 >> v2:172.21.15.69:3300/0 conn(0x7f05a80b9350 0x7f05a81416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.233+0000 7f05aff6d640 1 -- 172.21.15.31:0/258237211 >> 172.21.15.31:0/258237211 conn(0x7f05a80bc560 msgr2=0x7f05a80b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.233+0000 7f05aff6d640 1 -- 172.21.15.31:0/258237211 shutdown_connections 2023-12-22T08:41:44.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.233+0000 7f05aff6d640 1 -- 172.21.15.31:0/258237211 wait complete. 2023-12-22T08:41:44.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05aff6d640 1 Processor -- start 2023-12-22T08:41:44.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05aff6d640 1 -- start start 2023-12-22T08:41:44.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05aff6d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f05a80b9350 0x7f05a81e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05aff6d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8141c20 0x7f05a8144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05aff6d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8148030 0x7f05a813b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05aff6d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80b60d0 con 0x7f05a8141c20 2023-12-22T08:41:44.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05aff6d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a8142570 con 0x7f05a8148030 2023-12-22T08:41:44.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05aff6d640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a81e3610 con 0x7f05a80b9350 2023-12-22T08:41:44.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05ad508640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8141c20 0x7f05a8144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05ad508640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8141c20 0x7f05a8144000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46100/0 (socket says 172.21.15.31:46100) 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05ad508640 1 -- 172.21.15.31:0/2520761552 learned_addr learned my addr 172.21.15.31:0/2520761552 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.234+0000 7f05ae50a640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8148030 0x7f05a813b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05add09640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f05a80b9350 0x7f05a81e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05ad508640 1 -- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f05a80b9350 msgr2=0x7f05a81e30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05ad508640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f05a80b9350 0x7f05a81e30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05ad508640 1 -- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8148030 msgr2=0x7f05a813b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05ad508640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8148030 0x7f05a813b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05ad508640 1 -- 172.21.15.31:0/2520761552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a000bd40 con 0x7f05a8141c20 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05ad508640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8141c20 0x7f05a8144000 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f059800c430 tx=0x7f059800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598011790 con 0x7f05a8141c20 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980118f0 con 0x7f05a8141c20 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598011ce0 con 0x7f05a8141c20 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a80b6320 con 0x7f05a8141c20 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.235+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a81e3880 con 0x7f05a8141c20 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.236+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05a80b9730 con 0x7f05a8141c20 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.236+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f059801c460 con 0x7f05a8141c20 2023-12-22T08:41:44.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.237+0000 7f059e7fc640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f058c06a460 0x7f058c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.237+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0598088700 con 0x7f05a8141c20 2023-12-22T08:41:44.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.237+0000 7f059e7fc640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7f058c072600 0x7f058c074a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.237+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 --> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f058c0750d0 con 0x7f058c072600 2023-12-22T08:41:44.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.237+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f059808adc0 con 0x7f05a8141c20 2023-12-22T08:41:44.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.237+0000 7f05add09640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f058c06a460 0x7f058c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.237+0000 7f05ae50a640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7f058c072600 0x7f058c074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.238+0000 7f05add09640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f058c06a460 0x7f058c06c920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006fd0 tx=0x7f05a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.238+0000 7f05ae50a640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7f058c072600 0x7f058c074a20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.238+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 <== osd.7 v2:172.21.15.69:6824/120311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f058c0750d0 con 0x7f058c072600 2023-12-22T08:41:44.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.251+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 --> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f05a8071360 con 0x7f058c072600 2023-12-22T08:41:44.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.251+0000 7f059e7fc640 1 -- 172.21.15.31:0/2520761552 <== osd.7 v2:172.21.15.69:6824/120311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f05a000b4a0 con 0x7f058c072600 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T08:41:44.254 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-12-22T08:41:44.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7f058c072600 msgr2=0x7f058c074a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6824/120311,v1:172.21.15.69:6825/120311] conn(0x7f058c072600 0x7f058c074a20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f058c06a460 msgr2=0x7f058c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f058c06a460 0x7f058c06c920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006fd0 tx=0x7f05a4008040 comp rx=0 tx=0).stop 2023-12-22T08:41:44.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8141c20 msgr2=0x7f05a8144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 --2- 172.21.15.31:0/2520761552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a8141c20 0x7f05a8144000 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f059800c430 tx=0x7f059800c8f0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05ae50a640 1 -- 172.21.15.31:0/2520761552 reap_dead start 2023-12-22T08:41:44.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 shutdown_connections 2023-12-22T08:41:44.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 >> 172.21.15.31:0/2520761552 conn(0x7f05a80bc560 msgr2=0x7f05a8147920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 shutdown_connections 2023-12-22T08:41:44.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.252+0000 7f05aff6d640 1 -- 172.21.15.31:0/2520761552 wait complete. 2023-12-22T08:41:44.264 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-22T08:41:44.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.368+0000 7f592b026640 1 Processor -- start 2023-12-22T08:41:44.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.368+0000 7f592b026640 1 -- start start 2023-12-22T08:41:44.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f592b026640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5924145080 0x7f592406db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f592b026640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f592414b0c0 0x7f592414b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f592b026640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592414ac30 con 0x7f592406fee0 2023-12-22T08:41:44.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f592b026640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59240b99f0 con 0x7f5924145080 2023-12-22T08:41:44.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f592b026640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592414ba90 con 0x7f592414b0c0 2023-12-22T08:41:44.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f5928dc2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5924145080 0x7f592406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f5923fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f592406fee0 0x7f59240b8a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33672/0 (socket says 172.21.15.31:33672) 2023-12-22T08:41:44.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f5928dc2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5924145080 0x7f592406db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46104/0 (socket says 172.21.15.31:46104) 2023-12-22T08:41:44.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f5923fff640 1 -- 172.21.15.31:0/3902024027 learned_addr learned my addr 172.21.15.31:0/3902024027 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:41:44.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.369+0000 7f59295c3640 1 --2- 172.21.15.31:0/3902024027 >> v2:172.21.15.69:3300/0 conn(0x7f592414b0c0 0x7f592414b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.370+0000 7f5928dc2640 1 -- 172.21.15.31:0/3902024027 >> v2:172.21.15.69:3300/0 conn(0x7f592414b0c0 msgr2=0x7f592414b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.370+0000 7f5928dc2640 1 --2- 172.21.15.31:0/3902024027 >> v2:172.21.15.69:3300/0 conn(0x7f592414b0c0 0x7f592414b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.370+0000 7f5928dc2640 1 -- 172.21.15.31:0/3902024027 >> v1:172.21.15.31:6789/0 conn(0x7f592406fee0 legacy=0x7f59240b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.370+0000 7f5928dc2640 1 -- 172.21.15.31:0/3902024027 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59240b9190 con 0x7f5924145080 2023-12-22T08:41:44.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.370+0000 7f5928dc2640 1 --2- 172.21.15.31:0/3902024027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592406db30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f592406c5e0 tx=0x7f591c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f499e5cb76a1c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.370+0000 7f59237fe640 1 -- 172.21.15.31:0/3902024027 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c02cc80 con 0x7f5924145080 2023-12-22T08:41:44.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.370+0000 7f59237fe640 1 -- 172.21.15.31:0/3902024027 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c02cde0 con 0x7f5924145080 2023-12-22T08:41:44.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.370+0000 7f59237fe640 1 -- 172.21.15.31:0/3902024027 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c034660 con 0x7f5924145080 2023-12-22T08:41:44.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.371+0000 7f592b026640 1 -- 172.21.15.31:0/3902024027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 msgr2=0x7f592406db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.371+0000 7f592b026640 1 --2- 172.21.15.31:0/3902024027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592406db30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f592406c5e0 tx=0x7f591c02bed0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.371+0000 7f592b026640 1 -- 172.21.15.31:0/3902024027 shutdown_connections 2023-12-22T08:41:44.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.371+0000 7f592b026640 1 --2- 172.21.15.31:0/3902024027 >> v2:172.21.15.69:3300/0 conn(0x7f592414b0c0 0x7f592414b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.371+0000 7f592b026640 1 --2- 172.21.15.31:0/3902024027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592406db30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.371+0000 7f592b026640 1 -- 172.21.15.31:0/3902024027 >> 172.21.15.31:0/3902024027 conn(0x7f592406ae10 msgr2=0x7f592406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.371+0000 7f592b026640 1 -- 172.21.15.31:0/3902024027 shutdown_connections 2023-12-22T08:41:44.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.371+0000 7f592b026640 1 -- 172.21.15.31:0/3902024027 wait complete. 2023-12-22T08:41:44.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.372+0000 7f592b026640 1 Processor -- start 2023-12-22T08:41:44.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.372+0000 7f592b026640 1 -- start start 2023-12-22T08:41:44.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f592b026640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f592406fee0 0x7f59241409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f592b026640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592414d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f592b026640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f592414b0c0 0x7f592414db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f592b026640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5924140ef0 con 0x7f5924145080 2023-12-22T08:41:44.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f592b026640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59241e42a0 con 0x7f592406fee0 2023-12-22T08:41:44.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f592b026640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59241e3970 con 0x7f592414b0c0 2023-12-22T08:41:44.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592414d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592414d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46106/0 (socket says 172.21.15.31:46106) 2023-12-22T08:41:44.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 -- 172.21.15.31:0/1241337493 learned_addr learned my addr 172.21.15.31:0/1241337493 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:44.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5928dc2640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f592406fee0 0x7f59241409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f59295c3640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f592414b0c0 0x7f592414db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 -- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f592414b0c0 msgr2=0x7f592414db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f592414b0c0 0x7f592414db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 -- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f592406fee0 msgr2=0x7f59241409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f592406fee0 0x7f59241409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 -- 172.21.15.31:0/1241337493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c009a70 con 0x7f5924145080 2023-12-22T08:41:44.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f59295c3640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f592414b0c0 0x7f592414db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:41:44.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.373+0000 7f5923fff640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592414d630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f591800c4a0 tx=0x7f591800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.374+0000 7f59217fa640 1 -- 172.21.15.31:0/1241337493 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918005ce0 con 0x7f5924145080 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.374+0000 7f59217fa640 1 -- 172.21.15.31:0/1241337493 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918005e40 con 0x7f5924145080 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.374+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59241e3c50 con 0x7f5924145080 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.374+0000 7f59217fa640 1 -- 172.21.15.31:0/1241337493 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918007270 con 0x7f5924145080 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.374+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592414bc90 con 0x7f5924145080 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.375+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5924073a40 con 0x7f5924145080 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.375+0000 7f59217fa640 1 -- 172.21.15.31:0/1241337493 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5918007490 con 0x7f5924145080 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.375+0000 7f59217fa640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f591006a430 0x7f591006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.375+0000 7f59217fa640 1 -- 172.21.15.31:0/1241337493 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5918087d20 con 0x7f5924145080 2023-12-22T08:41:44.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.376+0000 7f5928dc2640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f591006a430 0x7f591006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.376+0000 7f5928dc2640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f591006a430 0x7f591006c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f591c036000 tx=0x7f591c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.379+0000 7f59217fa640 1 -- 172.21.15.31:0/1241337493 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5918053450 con 0x7f5924145080 2023-12-22T08:41:44.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.555+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f592406e430 con 0x7f591006a430 2023-12-22T08:41:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.556+0000 7f59217fa640 1 -- 172.21.15.31:0/1241337493 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f591c009450 con 0x7f591006a430 2023-12-22T08:41:44.558 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 7 to deep-scrub 2023-12-22T08:41:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f591006a430 msgr2=0x7f591006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f591006a430 0x7f591006c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f591c036000 tx=0x7f591c030000 comp rx=0 tx=0).stop 2023-12-22T08:41:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 msgr2=0x7f592414d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592414d630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f591800c4a0 tx=0x7f591800c960 comp rx=0 tx=0).stop 2023-12-22T08:41:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 shutdown_connections 2023-12-22T08:41:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f591006a430 0x7f591006c8f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f592414b0c0 0x7f592414db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5924145080 0x7f592414d630 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 --2- 172.21.15.31:0/1241337493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f592406fee0 0x7f59241409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 >> 172.21.15.31:0/1241337493 conn(0x7f592406ae10 msgr2=0x7f5924071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 shutdown_connections 2023-12-22T08:41:44.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.558+0000 7f592b026640 1 -- 172.21.15.31:0/1241337493 wait complete. 2023-12-22T08:41:44.571 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:41:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.674+0000 7f617fbf6640 1 Processor -- start 2023-12-22T08:41:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.674+0000 7f617fbf6640 1 -- start start 2023-12-22T08:41:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617fbf6640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f61780b2e90 0x7f617806f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617fbf6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f617814aa80 0x7f61780701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617fbf6640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61780b5cb0 con 0x7f617814a6a0 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617fbf6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617814af10 con 0x7f617814aa80 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617fbf6640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617806f090 con 0x7f61780b2e90 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617e193640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f617814aa80 0x7f61780701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617e193640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f617814aa80 0x7f61780701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39758/0 (socket says 172.21.15.31:39758) 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617e193640 1 -- 172.21.15.31:0/431725460 learned_addr learned my addr 172.21.15.31:0/431725460 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617d191640 1 --2- 172.21.15.31:0/431725460 >> v2:172.21.15.69:3300/0 conn(0x7f61780b2e90 0x7f617806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617e193640 1 -- 172.21.15.31:0/431725460 >> v2:172.21.15.69:3300/0 conn(0x7f61780b2e90 msgr2=0x7f617806f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617e193640 1 --2- 172.21.15.31:0/431725460 >> v2:172.21.15.69:3300/0 conn(0x7f61780b2e90 0x7f617806f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617e193640 1 -- 172.21.15.31:0/431725460 >> v1:172.21.15.69:6789/0 conn(0x7f617814a6a0 legacy=0x7f61780b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:41:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.675+0000 7f617e193640 1 -- 172.21.15.31:0/431725460 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617814b1e0 con 0x7f617814aa80 2023-12-22T08:41:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.676+0000 7f617e193640 1 --2- 172.21.15.31:0/431725460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814aa80 0x7f61780701b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f617806d210 tx=0x7f617002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260dcdf99064e0f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.676+0000 7f617c990640 1 -- 172.21.15.31:0/431725460 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617002ca80 con 0x7f617814aa80 2023-12-22T08:41:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.676+0000 7f617c990640 1 -- 172.21.15.31:0/431725460 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617002cbe0 con 0x7f617814aa80 2023-12-22T08:41:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.676+0000 7f617c990640 1 -- 172.21.15.31:0/431725460 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700343f0 con 0x7f617814aa80 2023-12-22T08:41:44.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.677+0000 7f617fbf6640 1 -- 172.21.15.31:0/431725460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814aa80 msgr2=0x7f61780701b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.677+0000 7f617fbf6640 1 --2- 172.21.15.31:0/431725460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814aa80 0x7f61780701b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f617806d210 tx=0x7f617002bee0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.677+0000 7f617fbf6640 1 -- 172.21.15.31:0/431725460 shutdown_connections 2023-12-22T08:41:44.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.677+0000 7f617fbf6640 1 --2- 172.21.15.31:0/431725460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814aa80 0x7f61780701b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.677+0000 7f617fbf6640 1 --2- 172.21.15.31:0/431725460 >> v2:172.21.15.69:3300/0 conn(0x7f61780b2e90 0x7f617806f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.677+0000 7f617fbf6640 1 -- 172.21.15.31:0/431725460 >> 172.21.15.31:0/431725460 conn(0x7f61780bc330 msgr2=0x7f61780bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.677+0000 7f617fbf6640 1 -- 172.21.15.31:0/431725460 shutdown_connections 2023-12-22T08:41:44.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.677+0000 7f617fbf6640 1 -- 172.21.15.31:0/431725460 wait complete. 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617fbf6640 1 Processor -- start 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617fbf6640 1 -- start start 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617fbf6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814a6a0 0x7f617813e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617fbf6640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f617814aa80 0x7f617813ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617fbf6640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f617813e980 0x7f6178138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617fbf6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617813e6f0 con 0x7f617814a6a0 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617fbf6640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617813b3b0 con 0x7f617813e980 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617fbf6640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6178149530 con 0x7f617814aa80 2023-12-22T08:41:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617d992640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814a6a0 0x7f617813e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.678+0000 7f617d992640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814a6a0 0x7f617813e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39780/0 (socket says 172.21.15.31:39780) 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617d992640 1 -- 172.21.15.31:0/3703602748 learned_addr learned my addr 172.21.15.31:0/3703602748 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617d992640 1 -- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f617814aa80 msgr2=0x7f617813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617e193640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f617813e980 0x7f6178138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617d992640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f617814aa80 0x7f617813ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617d992640 1 -- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f617813e980 msgr2=0x7f6178138080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617d992640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f617813e980 0x7f6178138080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617d992640 1 -- 172.21.15.31:0/3703602748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009b30 con 0x7f617814a6a0 2023-12-22T08:41:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617d992640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814a6a0 0x7f617813e1b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f617400c430 tx=0x7f617400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f616e7fc640 1 -- 172.21.15.31:0/3703602748 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174011790 con 0x7f617814a6a0 2023-12-22T08:41:44.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f616e7fc640 1 -- 172.21.15.31:0/3703602748 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61740118f0 con 0x7f617814a6a0 2023-12-22T08:41:44.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61781497d0 con 0x7f617814a6a0 2023-12-22T08:41:44.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f616e7fc640 1 -- 172.21.15.31:0/3703602748 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174011ca0 con 0x7f617814a6a0 2023-12-22T08:41:44.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.679+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61780b2760 con 0x7f617814a6a0 2023-12-22T08:41:44.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.680+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6178073a40 con 0x7f617814a6a0 2023-12-22T08:41:44.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.681+0000 7f616e7fc640 1 -- 172.21.15.31:0/3703602748 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f617401c460 con 0x7f617814a6a0 2023-12-22T08:41:44.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.681+0000 7f616e7fc640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f615c06a460 0x7f615c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:41:44.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.681+0000 7f616e7fc640 1 -- 172.21.15.31:0/3703602748 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61740887a0 con 0x7f617814a6a0 2023-12-22T08:41:44.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.682+0000 7f617d191640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f615c06a460 0x7f615c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:41:44.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.682+0000 7f617d191640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f615c06a460 0x7f615c06c920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6178139020 tx=0x7f6168008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:41:44.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.685+0000 7f616e7fc640 1 -- 172.21.15.31:0/3703602748 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6174053e20 con 0x7f617814a6a0 2023-12-22T08:41:44.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.857+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61780b86e0 con 0x7f615c06a460 2023-12-22T08:41:44.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.865+0000 7f616e7fc640 1 -- 172.21.15.31:0/3703602748 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289409 (secure 0 0 0) 0x7f6168009480 con 0x7f615c06a460 2023-12-22T08:41:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:41:44.872 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:41:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f615c06a460 msgr2=0x7f615c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f615c06a460 0x7f615c06c920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6178139020 tx=0x7f6168008040 comp rx=0 tx=0).stop 2023-12-22T08:41:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814a6a0 msgr2=0x7f617813e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:41:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814a6a0 0x7f617813e1b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f617400c430 tx=0x7f617400c8f0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.874 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 shutdown_connections 2023-12-22T08:41:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f615c06a460 0x7f615c06c920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f617813e980 0x7f6178138080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f617814aa80 0x7f617813ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 --2- 172.21.15.31:0/3703602748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617814a6a0 0x7f617813e1b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:41:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.868+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 >> 172.21.15.31:0/3703602748 conn(0x7f61780bc330 msgr2=0x7f61780b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:41:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.869+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 shutdown_connections 2023-12-22T08:41:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:41:44.869+0000 7f617fbf6640 1 -- 172.21.15.31:0/3703602748 wait complete. 2023-12-22T08:41:44.881 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-12-22T08:41:43.797310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598261,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3952,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":4046848,"data_stored":2270618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5531,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002720"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801980+0000","last_change":"2023-12-22T08:41:27.129975+0000","last_active":"2023-12-22T08:41:28.801980+0000","last_peered":"2023-12-22T08:41:28.801980+0000","last_clean":"2023-12-22T08:41:28.801980+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:41:28.801980+0000","last_undegraded":"2023-12-22T08:41:28.801980+0000","last_fullsized":"2023-12-22T08:41:28.801980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:55.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803164+0000","last_change":"2023-12-22T08:41:27.132308+0000","last_active":"2023-12-22T08:41:28.803164+0000","last_peered":"2023-12-22T08:41:28.803164+0000","last_clean":"2023-12-22T08:41:28.803164+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:41:28.803164+0000","last_undegraded":"2023-12-22T08:41:28.803164+0000","last_fullsized":"2023-12-22T08:41:28.803164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111813+0000","last_change":"2023-12-22T08:41:27.117719+0000","last_active":"2023-12-22T08:41:28.111813+0000","last_peered":"2023-12-22T08:41:28.111813+0000","last_clean":"2023-12-22T08:41:28.111813+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:41:28.111813+0000","last_undegraded":"2023-12-22T08:41:28.111813+0000","last_fullsized":"2023-12-22T08:41:28.111813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112687+0000","last_change":"2023-12-22T08:41:27.126330+0000","last_active":"2023-12-22T08:41:28.112687+0000","last_peered":"2023-12-22T08:41:28.112687+0000","last_clean":"2023-12-22T08:41:28.112687+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:41:28.112687+0000","last_undegraded":"2023-12-22T08:41:28.112687+0000","last_fullsized":"2023-12-22T08:41:28.112687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802393+0000","last_change":"2023-12-22T08:41:27.131419+0000","last_active":"2023-12-22T08:41:28.802393+0000","last_peered":"2023-12-22T08:41:28.802393+0000","last_clean":"2023-12-22T08:41:28.802393+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:41:28.802393+0000","last_undegraded":"2023-12-22T08:41:28.802393+0000","last_fullsized":"2023-12-22T08:41:28.802393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:27.722212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803093+0000","last_change":"2023-12-22T08:41:27.125465+0000","last_active":"2023-12-22T08:41:28.803093+0000","last_peered":"2023-12-22T08:41:28.803093+0000","last_clean":"2023-12-22T08:41:28.803093+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:41:28.803093+0000","last_undegraded":"2023-12-22T08:41:28.803093+0000","last_fullsized":"2023-12-22T08:41:28.803093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807522+0000","last_change":"2023-12-22T08:41:27.127918+0000","last_active":"2023-12-22T08:41:28.807522+0000","last_peered":"2023-12-22T08:41:28.807522+0000","last_clean":"2023-12-22T08:41:28.807522+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:41:28.807522+0000","last_undegraded":"2023-12-22T08:41:28.807522+0000","last_fullsized":"2023-12-22T08:41:28.807522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807397+0000","last_change":"2023-12-22T08:41:27.128397+0000","last_active":"2023-12-22T08:41:28.807397+0000","last_peered":"2023-12-22T08:41:28.807397+0000","last_clean":"2023-12-22T08:41:28.807397+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:41:28.807397+0000","last_undegraded":"2023-12-22T08:41:28.807397+0000","last_fullsized":"2023-12-22T08:41:28.807397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111299+0000","last_change":"2023-12-22T08:41:27.115975+0000","last_active":"2023-12-22T08:41:28.111299+0000","last_peered":"2023-12-22T08:41:28.111299+0000","last_clean":"2023-12-22T08:41:28.111299+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:41:28.111299+0000","last_undegraded":"2023-12-22T08:41:28.111299+0000","last_fullsized":"2023-12-22T08:41:28.111299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112929+0000","last_change":"2023-12-22T08:41:27.133760+0000","last_active":"2023-12-22T08:41:28.112929+0000","last_peered":"2023-12-22T08:41:28.112929+0000","last_clean":"2023-12-22T08:41:28.112929+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:41:28.112929+0000","last_undegraded":"2023-12-22T08:41:28.112929+0000","last_fullsized":"2023-12-22T08:41:28.112929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807594+0000","last_change":"2023-12-22T08:41:27.121357+0000","last_active":"2023-12-22T08:41:28.807594+0000","last_peered":"2023-12-22T08:41:28.807594+0000","last_clean":"2023-12-22T08:41:28.807594+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:41:28.807594+0000","last_undegraded":"2023-12-22T08:41:28.807594+0000","last_fullsized":"2023-12-22T08:41:28.807594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111645+0000","last_change":"2023-12-22T08:41:27.131986+0000","last_active":"2023-12-22T08:41:28.111645+0000","last_peered":"2023-12-22T08:41:28.111645+0000","last_clean":"2023-12-22T08:41:28.111645+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:41:28.111645+0000","last_undegraded":"2023-12-22T08:41:28.111645+0000","last_fullsized":"2023-12-22T08:41:28.111645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802404+0000","last_change":"2023-12-22T08:41:27.120741+0000","last_active":"2023-12-22T08:41:28.802404+0000","last_peered":"2023-12-22T08:41:28.802404+0000","last_clean":"2023-12-22T08:41:28.802404+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:28.802404+0000","last_undegraded":"2023-12-22T08:41:28.802404+0000","last_fullsized":"2023-12-22T08:41:28.802404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:46.823109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803102+0000","last_change":"2023-12-22T08:41:27.127642+0000","last_active":"2023-12-22T08:41:28.803102+0000","last_peered":"2023-12-22T08:41:28.803102+0000","last_clean":"2023-12-22T08:41:28.803102+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:28.803102+0000","last_undegraded":"2023-12-22T08:41:28.803102+0000","last_fullsized":"2023-12-22T08:41:28.803102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111013+0000","last_change":"2023-12-22T08:41:27.124240+0000","last_active":"2023-12-22T08:41:28.111013+0000","last_peered":"2023-12-22T08:41:28.111013+0000","last_clean":"2023-12-22T08:41:28.111013+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:28.111013+0000","last_undegraded":"2023-12-22T08:41:28.111013+0000","last_fullsized":"2023-12-22T08:41:28.111013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:21:59.976668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807472+0000","last_change":"2023-12-22T08:41:27.131917+0000","last_active":"2023-12-22T08:41:28.807472+0000","last_peered":"2023-12-22T08:41:28.807472+0000","last_clean":"2023-12-22T08:41:28.807472+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:41:28.807472+0000","last_undegraded":"2023-12-22T08:41:28.807472+0000","last_fullsized":"2023-12-22T08:41:28.807472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807612+0000","last_change":"2023-12-22T08:41:27.126772+0000","last_active":"2023-12-22T08:41:28.807612+0000","last_peered":"2023-12-22T08:41:28.807612+0000","last_clean":"2023-12-22T08:41:28.807612+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:28.807612+0000","last_undegraded":"2023-12-22T08:41:28.807612+0000","last_fullsized":"2023-12-22T08:41:28.807612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803173+0000","last_change":"2023-12-22T08:41:27.132073+0000","last_active":"2023-12-22T08:41:28.803173+0000","last_peered":"2023-12-22T08:41:28.803173+0000","last_clean":"2023-12-22T08:41:28.803173+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:41:28.803173+0000","last_undegraded":"2023-12-22T08:41:28.803173+0000","last_fullsized":"2023-12-22T08:41:28.803173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:12.292631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803140+0000","last_change":"2023-12-22T08:41:27.128462+0000","last_active":"2023-12-22T08:41:28.803140+0000","last_peered":"2023-12-22T08:41:28.803140+0000","last_clean":"2023-12-22T08:41:28.803140+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:41:28.803140+0000","last_undegraded":"2023-12-22T08:41:28.803140+0000","last_fullsized":"2023-12-22T08:41:28.803140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802424+0000","last_change":"2023-12-22T08:41:27.124709+0000","last_active":"2023-12-22T08:41:28.802424+0000","last_peered":"2023-12-22T08:41:28.802424+0000","last_clean":"2023-12-22T08:41:28.802424+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:28.802424+0000","last_undegraded":"2023-12-22T08:41:28.802424+0000","last_fullsized":"2023-12-22T08:41:28.802424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:26.745936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111759+0000","last_change":"2023-12-22T08:41:27.120855+0000","last_active":"2023-12-22T08:41:28.111759+0000","last_peered":"2023-12-22T08:41:28.111759+0000","last_clean":"2023-12-22T08:41:28.111759+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:41:28.111759+0000","last_undegraded":"2023-12-22T08:41:28.111759+0000","last_fullsized":"2023-12-22T08:41:28.111759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:04.575089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111532+0000","last_change":"2023-12-22T08:41:27.129305+0000","last_active":"2023-12-22T08:41:28.111532+0000","last_peered":"2023-12-22T08:41:28.111532+0000","last_clean":"2023-12-22T08:41:28.111532+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:41:28.111532+0000","last_undegraded":"2023-12-22T08:41:28.111532+0000","last_fullsized":"2023-12-22T08:41:28.111532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801633+0000","last_change":"2023-12-22T08:41:27.123800+0000","last_active":"2023-12-22T08:41:28.801633+0000","last_peered":"2023-12-22T08:41:28.801633+0000","last_clean":"2023-12-22T08:41:28.801633+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:28.801633+0000","last_undegraded":"2023-12-22T08:41:28.801633+0000","last_fullsized":"2023-12-22T08:41:28.801633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110929+0000","last_change":"2023-12-22T08:41:27.114600+0000","last_active":"2023-12-22T08:41:28.110929+0000","last_peered":"2023-12-22T08:41:28.110929+0000","last_clean":"2023-12-22T08:41:28.110929+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:41:28.110929+0000","last_undegraded":"2023-12-22T08:41:28.110929+0000","last_fullsized":"2023-12-22T08:41:28.110929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113130+0000","last_change":"2023-12-22T08:41:27.121608+0000","last_active":"2023-12-22T08:41:28.113130+0000","last_peered":"2023-12-22T08:41:28.113130+0000","last_clean":"2023-12-22T08:41:28.113130+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:41:28.113130+0000","last_undegraded":"2023-12-22T08:41:28.113130+0000","last_fullsized":"2023-12-22T08:41:28.113130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:36:42.707082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803181+0000","last_change":"2023-12-22T08:41:27.131698+0000","last_active":"2023-12-22T08:41:28.803181+0000","last_peered":"2023-12-22T08:41:28.803181+0000","last_clean":"2023-12-22T08:41:28.803181+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:41:28.803181+0000","last_undegraded":"2023-12-22T08:41:28.803181+0000","last_fullsized":"2023-12-22T08:41:28.803181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113081+0000","last_change":"2023-12-22T08:41:27.121328+0000","last_active":"2023-12-22T08:41:28.113081+0000","last_peered":"2023-12-22T08:41:28.113081+0000","last_clean":"2023-12-22T08:41:28.113081+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:41:28.113081+0000","last_undegraded":"2023-12-22T08:41:28.113081+0000","last_fullsized":"2023-12-22T08:41:28.113081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:38.611370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111750+0000","last_change":"2023-12-22T08:41:27.117153+0000","last_active":"2023-12-22T08:41:28.111750+0000","last_peered":"2023-12-22T08:41:28.111750+0000","last_clean":"2023-12-22T08:41:28.111750+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:28.111750+0000","last_undegraded":"2023-12-22T08:41:28.111750+0000","last_fullsized":"2023-12-22T08:41:28.111750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111857+0000","last_change":"2023-12-22T08:41:27.128755+0000","last_active":"2023-12-22T08:41:28.111857+0000","last_peered":"2023-12-22T08:41:28.111857+0000","last_clean":"2023-12-22T08:41:28.111857+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:41:28.111857+0000","last_undegraded":"2023-12-22T08:41:28.111857+0000","last_fullsized":"2023-12-22T08:41:28.111857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807539+0000","last_change":"2023-12-22T08:41:27.126203+0000","last_active":"2023-12-22T08:41:28.807539+0000","last_peered":"2023-12-22T08:41:28.807539+0000","last_clean":"2023-12-22T08:41:28.807539+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:41:28.807539+0000","last_undegraded":"2023-12-22T08:41:28.807539+0000","last_fullsized":"2023-12-22T08:41:28.807539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:55:56.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801882+0000","last_change":"2023-12-22T08:41:27.127519+0000","last_active":"2023-12-22T08:41:28.801882+0000","last_peered":"2023-12-22T08:41:28.801882+0000","last_clean":"2023-12-22T08:41:28.801882+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:41:28.801882+0000","last_undegraded":"2023-12-22T08:41:28.801882+0000","last_fullsized":"2023-12-22T08:41:28.801882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:50.379837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807417+0000","last_change":"2023-12-22T08:41:27.122823+0000","last_active":"2023-12-22T08:41:28.807417+0000","last_peered":"2023-12-22T08:41:28.807417+0000","last_clean":"2023-12-22T08:41:28.807417+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:41:28.807417+0000","last_undegraded":"2023-12-22T08:41:28.807417+0000","last_fullsized":"2023-12-22T08:41:28.807417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801686+0000","last_change":"2023-12-22T08:41:27.121742+0000","last_active":"2023-12-22T08:41:28.801686+0000","last_peered":"2023-12-22T08:41:28.801686+0000","last_clean":"2023-12-22T08:41:28.801686+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:28.801686+0000","last_undegraded":"2023-12-22T08:41:28.801686+0000","last_fullsized":"2023-12-22T08:41:28.801686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:39:10.333194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802016+0000","last_change":"2023-12-22T08:41:26.742786+0000","last_active":"2023-12-22T08:41:28.802016+0000","last_peered":"2023-12-22T08:41:28.802016+0000","last_clean":"2023-12-22T08:41:28.802016+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:28.802016+0000","last_undegraded":"2023-12-22T08:41:28.802016+0000","last_fullsized":"2023-12-22T08:41:28.802016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801996+0000","last_change":"2023-12-22T08:41:27.130511+0000","last_active":"2023-12-22T08:41:28.801996+0000","last_peered":"2023-12-22T08:41:28.801996+0000","last_clean":"2023-12-22T08:41:28.801996+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:41:28.801996+0000","last_undegraded":"2023-12-22T08:41:28.801996+0000","last_fullsized":"2023-12-22T08:41:28.801996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:18.765379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801698+0000","last_change":"2023-12-22T08:41:26.743569+0000","last_active":"2023-12-22T08:41:28.801698+0000","last_peered":"2023-12-22T08:41:28.801698+0000","last_clean":"2023-12-22T08:41:28.801698+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:28.801698+0000","last_undegraded":"2023-12-22T08:41:28.801698+0000","last_fullsized":"2023-12-22T08:41:28.801698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111545+0000","last_change":"2023-12-22T08:41:27.128744+0000","last_active":"2023-12-22T08:41:28.111545+0000","last_peered":"2023-12-22T08:41:28.111545+0000","last_clean":"2023-12-22T08:41:28.111545+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:41:28.111545+0000","last_undegraded":"2023-12-22T08:41:28.111545+0000","last_fullsized":"2023-12-22T08:41:28.111545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803153+0000","last_change":"2023-12-22T08:41:26.747403+0000","last_active":"2023-12-22T08:41:28.803153+0000","last_peered":"2023-12-22T08:41:28.803153+0000","last_clean":"2023-12-22T08:41:28.803153+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:28.803153+0000","last_undegraded":"2023-12-22T08:41:28.803153+0000","last_fullsized":"2023-12-22T08:41:28.803153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:37:17.763510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113171+0000","last_change":"2023-12-22T08:41:27.121058+0000","last_active":"2023-12-22T08:41:28.113171+0000","last_peered":"2023-12-22T08:41:28.113171+0000","last_clean":"2023-12-22T08:41:28.113171+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:41:28.113171+0000","last_undegraded":"2023-12-22T08:41:28.113171+0000","last_fullsized":"2023-12-22T08:41:28.113171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:59:36.866502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802433+0000","last_change":"2023-12-22T08:41:26.747241+0000","last_active":"2023-12-22T08:41:28.802433+0000","last_peered":"2023-12-22T08:41:28.802433+0000","last_clean":"2023-12-22T08:41:28.802433+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:28.802433+0000","last_undegraded":"2023-12-22T08:41:28.802433+0000","last_fullsized":"2023-12-22T08:41:28.802433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:01:52.257765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807557+0000","last_change":"2023-12-22T08:41:27.123533+0000","last_active":"2023-12-22T08:41:28.807557+0000","last_peered":"2023-12-22T08:41:28.807557+0000","last_clean":"2023-12-22T08:41:28.807557+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:41:28.807557+0000","last_undegraded":"2023-12-22T08:41:28.807557+0000","last_fullsized":"2023-12-22T08:41:28.807557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111846+0000","last_change":"2023-12-22T08:41:26.750084+0000","last_active":"2023-12-22T08:41:28.111846+0000","last_peered":"2023-12-22T08:41:28.111846+0000","last_clean":"2023-12-22T08:41:28.111846+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:41:28.111846+0000","last_undegraded":"2023-12-22T08:41:28.111846+0000","last_fullsized":"2023-12-22T08:41:28.111846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111151+0000","last_change":"2023-12-22T08:41:27.125421+0000","last_active":"2023-12-22T08:41:28.111151+0000","last_peered":"2023-12-22T08:41:28.111151+0000","last_clean":"2023-12-22T08:41:28.111151+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:41:28.111151+0000","last_undegraded":"2023-12-22T08:41:28.111151+0000","last_fullsized":"2023-12-22T08:41:28.111151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:39:39.521551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111620+0000","last_change":"2023-12-22T08:41:26.743416+0000","last_active":"2023-12-22T08:41:28.111620+0000","last_peered":"2023-12-22T08:41:28.111620+0000","last_clean":"2023-12-22T08:41:28.111620+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:41:28.111620+0000","last_undegraded":"2023-12-22T08:41:28.111620+0000","last_fullsized":"2023-12-22T08:41:28.111620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:26:42.994044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111016+0000","last_change":"2023-12-22T08:41:27.123904+0000","last_active":"2023-12-22T08:41:28.111016+0000","last_peered":"2023-12-22T08:41:28.111016+0000","last_clean":"2023-12-22T08:41:28.111016+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:41:28.111016+0000","last_undegraded":"2023-12-22T08:41:28.111016+0000","last_fullsized":"2023-12-22T08:41:28.111016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803073+0000","last_change":"2023-12-22T08:41:26.745648+0000","last_active":"2023-12-22T08:41:28.803073+0000","last_peered":"2023-12-22T08:41:28.803073+0000","last_clean":"2023-12-22T08:41:28.803073+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:41:28.803073+0000","last_undegraded":"2023-12-22T08:41:28.803073+0000","last_fullsized":"2023-12-22T08:41:28.803073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112566+0000","last_change":"2023-12-22T08:41:27.126166+0000","last_active":"2023-12-22T08:41:28.112566+0000","last_peered":"2023-12-22T08:41:28.112566+0000","last_clean":"2023-12-22T08:41:28.112566+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:28.112566+0000","last_undegraded":"2023-12-22T08:41:28.112566+0000","last_fullsized":"2023-12-22T08:41:28.112566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:50:25.512743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111017+0000","last_change":"2023-12-22T08:41:26.739716+0000","last_active":"2023-12-22T08:41:28.111017+0000","last_peered":"2023-12-22T08:41:28.111017+0000","last_clean":"2023-12-22T08:41:28.111017+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:28.111017+0000","last_undegraded":"2023-12-22T08:41:28.111017+0000","last_fullsized":"2023-12-22T08:41:28.111017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:38:25.744068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111505+0000","last_change":"2023-12-22T08:41:27.133504+0000","last_active":"2023-12-22T08:41:28.111505+0000","last_peered":"2023-12-22T08:41:28.111505+0000","last_clean":"2023-12-22T08:41:28.111505+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:41:28.111505+0000","last_undegraded":"2023-12-22T08:41:28.111505+0000","last_fullsized":"2023-12-22T08:41:28.111505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803207+0000","last_change":"2023-12-22T08:41:26.743175+0000","last_active":"2023-12-22T08:41:28.803207+0000","last_peered":"2023-12-22T08:41:28.803207+0000","last_clean":"2023-12-22T08:41:28.803207+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:28.803207+0000","last_undegraded":"2023-12-22T08:41:28.803207+0000","last_fullsized":"2023-12-22T08:41:28.803207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:26:03.573220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803190+0000","last_change":"2023-12-22T08:41:27.129547+0000","last_active":"2023-12-22T08:41:28.803190+0000","last_peered":"2023-12-22T08:41:28.803190+0000","last_clean":"2023-12-22T08:41:28.803190+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:41:28.803190+0000","last_undegraded":"2023-12-22T08:41:28.803190+0000","last_fullsized":"2023-12-22T08:41:28.803190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801721+0000","last_change":"2023-12-22T08:41:26.743757+0000","last_active":"2023-12-22T08:41:28.801721+0000","last_peered":"2023-12-22T08:41:28.801721+0000","last_clean":"2023-12-22T08:41:28.801721+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:28.801721+0000","last_undegraded":"2023-12-22T08:41:28.801721+0000","last_fullsized":"2023-12-22T08:41:28.801721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803120+0000","last_change":"2023-12-22T08:41:27.131773+0000","last_active":"2023-12-22T08:41:28.803120+0000","last_peered":"2023-12-22T08:41:28.803120+0000","last_clean":"2023-12-22T08:41:28.803120+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:41:28.803120+0000","last_undegraded":"2023-12-22T08:41:28.803120+0000","last_fullsized":"2023-12-22T08:41:28.803120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:35:33.787952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111905+0000","last_change":"2023-12-22T08:41:26.745597+0000","last_active":"2023-12-22T08:41:28.111905+0000","last_peered":"2023-12-22T08:41:28.111905+0000","last_clean":"2023-12-22T08:41:28.111905+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:28.111905+0000","last_undegraded":"2023-12-22T08:41:28.111905+0000","last_fullsized":"2023-12-22T08:41:28.111905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111718+0000","last_change":"2023-12-22T08:41:27.118227+0000","last_active":"2023-12-22T08:41:28.111718+0000","last_peered":"2023-12-22T08:41:28.111718+0000","last_clean":"2023-12-22T08:41:28.111718+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:41:28.111718+0000","last_undegraded":"2023-12-22T08:41:28.111718+0000","last_fullsized":"2023-12-22T08:41:28.111718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:06:14.144522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'11","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:38.244654+0000","last_change":"2023-12-22T08:41:26.748072+0000","last_active":"2023-12-22T08:41:38.244654+0000","last_peered":"2023-12-22T08:41:38.244654+0000","last_clean":"2023-12-22T08:41:38.244654+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:38.244654+0000","last_undegraded":"2023-12-22T08:41:38.244654+0000","last_fullsized":"2023-12-22T08:41:38.244654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:05.371284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7095,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112579+0000","last_change":"2023-12-22T08:41:27.120378+0000","last_active":"2023-12-22T08:41:28.112579+0000","last_peered":"2023-12-22T08:41:28.112579+0000","last_clean":"2023-12-22T08:41:28.112579+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:28.112579+0000","last_undegraded":"2023-12-22T08:41:28.112579+0000","last_fullsized":"2023-12-22T08:41:28.112579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111924+0000","last_change":"2023-12-22T08:41:26.740501+0000","last_active":"2023-12-22T08:41:28.111924+0000","last_peered":"2023-12-22T08:41:28.111924+0000","last_clean":"2023-12-22T08:41:28.111924+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:28.111924+0000","last_undegraded":"2023-12-22T08:41:28.111924+0000","last_fullsized":"2023-12-22T08:41:28.111924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803112+0000","last_change":"2023-12-22T08:41:27.127482+0000","last_active":"2023-12-22T08:41:28.803112+0000","last_peered":"2023-12-22T08:41:28.803112+0000","last_clean":"2023-12-22T08:41:28.803112+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:41:28.803112+0000","last_undegraded":"2023-12-22T08:41:28.803112+0000","last_fullsized":"2023-12-22T08:41:28.803112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:47:07.417457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112604+0000","last_change":"2023-12-22T08:41:26.746743+0000","last_active":"2023-12-22T08:41:28.112604+0000","last_peered":"2023-12-22T08:41:28.112604+0000","last_clean":"2023-12-22T08:41:28.112604+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:28.112604+0000","last_undegraded":"2023-12-22T08:41:28.112604+0000","last_fullsized":"2023-12-22T08:41:28.112604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:52.571630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807455+0000","last_change":"2023-12-22T08:41:27.123864+0000","last_active":"2023-12-22T08:41:28.807455+0000","last_peered":"2023-12-22T08:41:28.807455+0000","last_clean":"2023-12-22T08:41:28.807455+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:41:28.807455+0000","last_undegraded":"2023-12-22T08:41:28.807455+0000","last_fullsized":"2023-12-22T08:41:28.807455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:07.437068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803082+0000","last_change":"2023-12-22T08:41:26.742515+0000","last_active":"2023-12-22T08:41:28.803082+0000","last_peered":"2023-12-22T08:41:28.803082+0000","last_clean":"2023-12-22T08:41:28.803082+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:28.803082+0000","last_undegraded":"2023-12-22T08:41:28.803082+0000","last_fullsized":"2023-12-22T08:41:28.803082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:32.527496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801907+0000","last_change":"2023-12-22T08:41:27.122673+0000","last_active":"2023-12-22T08:41:28.801907+0000","last_peered":"2023-12-22T08:41:28.801907+0000","last_clean":"2023-12-22T08:41:28.801907+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:41:28.801907+0000","last_undegraded":"2023-12-22T08:41:28.801907+0000","last_fullsized":"2023-12-22T08:41:28.801907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:04:06.373152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803052+0000","last_change":"2023-12-22T08:41:26.748785+0000","last_active":"2023-12-22T08:41:28.803052+0000","last_peered":"2023-12-22T08:41:28.803052+0000","last_clean":"2023-12-22T08:41:28.803052+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:41:28.803052+0000","last_undegraded":"2023-12-22T08:41:28.803052+0000","last_fullsized":"2023-12-22T08:41:28.803052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111273+0000","last_change":"2023-12-22T08:41:27.118299+0000","last_active":"2023-12-22T08:41:28.111273+0000","last_peered":"2023-12-22T08:41:28.111273+0000","last_clean":"2023-12-22T08:41:28.111273+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:41:28.111273+0000","last_undegraded":"2023-12-22T08:41:28.111273+0000","last_fullsized":"2023-12-22T08:41:28.111273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:07:29.395502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113208+0000","last_change":"2023-12-22T08:41:26.751813+0000","last_active":"2023-12-22T08:41:28.113208+0000","last_peered":"2023-12-22T08:41:28.113208+0000","last_clean":"2023-12-22T08:41:28.113208+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:28.113208+0000","last_undegraded":"2023-12-22T08:41:28.113208+0000","last_fullsized":"2023-12-22T08:41:28.113208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:00:09.525319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111455+0000","last_change":"2023-12-22T08:41:27.122998+0000","last_active":"2023-12-22T08:41:28.111455+0000","last_peered":"2023-12-22T08:41:28.111455+0000","last_clean":"2023-12-22T08:41:28.111455+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:41:28.111455+0000","last_undegraded":"2023-12-22T08:41:28.111455+0000","last_fullsized":"2023-12-22T08:41:28.111455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:42.235469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111193+0000","last_change":"2023-12-22T08:41:26.740945+0000","last_active":"2023-12-22T08:41:28.111193+0000","last_peered":"2023-12-22T08:41:28.111193+0000","last_clean":"2023-12-22T08:41:28.111193+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:41:28.111193+0000","last_undegraded":"2023-12-22T08:41:28.111193+0000","last_fullsized":"2023-12-22T08:41:28.111193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112745+0000","last_change":"2023-12-22T08:41:27.125917+0000","last_active":"2023-12-22T08:41:28.112745+0000","last_peered":"2023-12-22T08:41:28.112745+0000","last_clean":"2023-12-22T08:41:28.112745+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:41:28.112745+0000","last_undegraded":"2023-12-22T08:41:28.112745+0000","last_fullsized":"2023-12-22T08:41:28.112745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111940+0000","last_change":"2023-12-22T08:41:26.743117+0000","last_active":"2023-12-22T08:41:28.111940+0000","last_peered":"2023-12-22T08:41:28.111940+0000","last_clean":"2023-12-22T08:41:28.111940+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:41:28.111940+0000","last_undegraded":"2023-12-22T08:41:28.111940+0000","last_fullsized":"2023-12-22T08:41:28.111940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802452+0000","last_change":"2023-12-22T08:41:27.125969+0000","last_active":"2023-12-22T08:41:28.802452+0000","last_peered":"2023-12-22T08:41:28.802452+0000","last_clean":"2023-12-22T08:41:28.802452+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:28.802452+0000","last_undegraded":"2023-12-22T08:41:28.802452+0000","last_fullsized":"2023-12-22T08:41:28.802452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:34.167113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111633+0000","last_change":"2023-12-22T08:41:26.744095+0000","last_active":"2023-12-22T08:41:28.111633+0000","last_peered":"2023-12-22T08:41:28.111633+0000","last_clean":"2023-12-22T08:41:28.111633+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:41:28.111633+0000","last_undegraded":"2023-12-22T08:41:28.111633+0000","last_fullsized":"2023-12-22T08:41:28.111633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:11.707505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802382+0000","last_change":"2023-12-22T08:41:27.125387+0000","last_active":"2023-12-22T08:41:28.802382+0000","last_peered":"2023-12-22T08:41:28.802382+0000","last_clean":"2023-12-22T08:41:28.802382+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:28.802382+0000","last_undegraded":"2023-12-22T08:41:28.802382+0000","last_fullsized":"2023-12-22T08:41:28.802382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:31.788205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801658+0000","last_change":"2023-12-22T08:41:26.747215+0000","last_active":"2023-12-22T08:41:28.801658+0000","last_peered":"2023-12-22T08:41:28.801658+0000","last_clean":"2023-12-22T08:41:28.801658+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:28.801658+0000","last_undegraded":"2023-12-22T08:41:28.801658+0000","last_fullsized":"2023-12-22T08:41:28.801658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:40:54.163437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802415+0000","last_change":"2023-12-22T08:41:27.122152+0000","last_active":"2023-12-22T08:41:28.802415+0000","last_peered":"2023-12-22T08:41:28.802415+0000","last_clean":"2023-12-22T08:41:28.802415+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:28.802415+0000","last_undegraded":"2023-12-22T08:41:28.802415+0000","last_fullsized":"2023-12-22T08:41:28.802415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:12:12.709373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801943+0000","last_change":"2023-12-22T08:41:26.746895+0000","last_active":"2023-12-22T08:41:28.801943+0000","last_peered":"2023-12-22T08:41:28.801943+0000","last_clean":"2023-12-22T08:41:28.801943+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:28.801943+0000","last_undegraded":"2023-12-22T08:41:28.801943+0000","last_fullsized":"2023-12-22T08:41:28.801943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:48:30.786337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802368+0000","last_change":"2023-12-22T08:41:27.121179+0000","last_active":"2023-12-22T08:41:28.802368+0000","last_peered":"2023-12-22T08:41:28.802368+0000","last_clean":"2023-12-22T08:41:28.802368+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:28.802368+0000","last_undegraded":"2023-12-22T08:41:28.802368+0000","last_fullsized":"2023-12-22T08:41:28.802368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:13:53.573498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111334+0000","last_change":"2023-12-22T08:41:26.744242+0000","last_active":"2023-12-22T08:41:28.111334+0000","last_peered":"2023-12-22T08:41:28.111334+0000","last_clean":"2023-12-22T08:41:28.111334+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:28.111334+0000","last_undegraded":"2023-12-22T08:41:28.111334+0000","last_fullsized":"2023-12-22T08:41:28.111334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:06:33.165245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807504+0000","last_change":"2023-12-22T08:41:27.125910+0000","last_active":"2023-12-22T08:41:28.807504+0000","last_peered":"2023-12-22T08:41:28.807504+0000","last_clean":"2023-12-22T08:41:28.807504+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:41:28.807504+0000","last_undegraded":"2023-12-22T08:41:28.807504+0000","last_fullsized":"2023-12-22T08:41:28.807504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:48:36.332511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.110836+0000","last_change":"2023-12-22T08:41:26.747152+0000","last_active":"2023-12-22T08:41:28.110836+0000","last_peered":"2023-12-22T08:41:28.110836+0000","last_clean":"2023-12-22T08:41:28.110836+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:28.110836+0000","last_undegraded":"2023-12-22T08:41:28.110836+0000","last_fullsized":"2023-12-22T08:41:28.110836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:53:49.377969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802474+0000","last_change":"2023-12-22T08:41:27.122069+0000","last_active":"2023-12-22T08:41:28.802474+0000","last_peered":"2023-12-22T08:41:28.802474+0000","last_clean":"2023-12-22T08:41:28.802474+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:28.802474+0000","last_undegraded":"2023-12-22T08:41:28.802474+0000","last_fullsized":"2023-12-22T08:41:28.802474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:04.235137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.113220+0000","last_change":"2023-12-22T08:41:26.748464+0000","last_active":"2023-12-22T08:41:28.113220+0000","last_peered":"2023-12-22T08:41:28.113220+0000","last_clean":"2023-12-22T08:41:28.113220+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:28.113220+0000","last_undegraded":"2023-12-22T08:41:28.113220+0000","last_fullsized":"2023-12-22T08:41:28.113220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:25:29.648433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111578+0000","last_change":"2023-12-22T08:41:27.117970+0000","last_active":"2023-12-22T08:41:28.111578+0000","last_peered":"2023-12-22T08:41:28.111578+0000","last_clean":"2023-12-22T08:41:28.111578+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:41:28.111578+0000","last_undegraded":"2023-12-22T08:41:28.111578+0000","last_fullsized":"2023-12-22T08:41:28.111578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:12:11.296744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.885010+0000","last_change":"2023-12-22T08:41:26.744425+0000","last_active":"2023-12-22T08:41:29.885010+0000","last_peered":"2023-12-22T08:41:29.885010+0000","last_clean":"2023-12-22T08:41:29.885010+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:29.885010+0000","last_undegraded":"2023-12-22T08:41:29.885010+0000","last_fullsized":"2023-12-22T08:41:29.885010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:17.007353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801677+0000","last_change":"2023-12-22T08:41:27.121596+0000","last_active":"2023-12-22T08:41:28.801677+0000","last_peered":"2023-12-22T08:41:28.801677+0000","last_clean":"2023-12-22T08:41:28.801677+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:28.801677+0000","last_undegraded":"2023-12-22T08:41:28.801677+0000","last_fullsized":"2023-12-22T08:41:28.801677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:29:18.707869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112784+0000","last_change":"2023-12-22T08:41:26.748558+0000","last_active":"2023-12-22T08:41:28.112784+0000","last_peered":"2023-12-22T08:41:28.112784+0000","last_clean":"2023-12-22T08:41:28.112784+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:28.112784+0000","last_undegraded":"2023-12-22T08:41:28.112784+0000","last_fullsized":"2023-12-22T08:41:28.112784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:42:26.720344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801927+0000","last_change":"2023-12-22T08:41:27.124314+0000","last_active":"2023-12-22T08:41:28.801927+0000","last_peered":"2023-12-22T08:41:28.801927+0000","last_clean":"2023-12-22T08:41:28.801927+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:28.801927+0000","last_undegraded":"2023-12-22T08:41:28.801927+0000","last_fullsized":"2023-12-22T08:41:28.801927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T08:50:18.009221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801668+0000","last_change":"2023-12-22T08:41:26.740301+0000","last_active":"2023-12-22T08:41:28.801668+0000","last_peered":"2023-12-22T08:41:28.801668+0000","last_clean":"2023-12-22T08:41:28.801668+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:28.801668+0000","last_undegraded":"2023-12-22T08:41:28.801668+0000","last_fullsized":"2023-12-22T08:41:28.801668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801647+0000","last_change":"2023-12-22T08:41:27.121048+0000","last_active":"2023-12-22T08:41:28.801647+0000","last_peered":"2023-12-22T08:41:28.801647+0000","last_clean":"2023-12-22T08:41:28.801647+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:28.801647+0000","last_undegraded":"2023-12-22T08:41:28.801647+0000","last_fullsized":"2023-12-22T08:41:28.801647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:57:33.529365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.112660+0000","last_change":"2023-12-22T08:41:26.747176+0000","last_active":"2023-12-22T08:41:28.112660+0000","last_peered":"2023-12-22T08:41:28.112660+0000","last_clean":"2023-12-22T08:41:28.112660+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:28.112660+0000","last_undegraded":"2023-12-22T08:41:28.112660+0000","last_fullsized":"2023-12-22T08:41:28.112660+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:35:45.821241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803023+0000","last_change":"2023-12-22T08:41:27.122915+0000","last_active":"2023-12-22T08:41:28.803023+0000","last_peered":"2023-12-22T08:41:28.803023+0000","last_clean":"2023-12-22T08:41:28.803023+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:41:28.803023+0000","last_undegraded":"2023-12-22T08:41:28.803023+0000","last_fullsized":"2023-12-22T08:41:28.803023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:27.533832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111422+0000","last_change":"2023-12-22T08:41:26.739638+0000","last_active":"2023-12-22T08:41:28.111422+0000","last_peered":"2023-12-22T08:41:28.111422+0000","last_clean":"2023-12-22T08:41:28.111422+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:28.111422+0000","last_undegraded":"2023-12-22T08:41:28.111422+0000","last_fullsized":"2023-12-22T08:41:28.111422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:18:03.233269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.111243+0000","last_change":"2023-12-22T08:41:27.131013+0000","last_active":"2023-12-22T08:41:28.111243+0000","last_peered":"2023-12-22T08:41:28.111243+0000","last_clean":"2023-12-22T08:41:28.111243+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:41:28.111243+0000","last_undegraded":"2023-12-22T08:41:28.111243+0000","last_fullsized":"2023-12-22T08:41:28.111243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:53:29.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.803063+0000","last_change":"2023-12-22T08:41:26.745042+0000","last_active":"2023-12-22T08:41:28.803063+0000","last_peered":"2023-12-22T08:41:28.803063+0000","last_clean":"2023-12-22T08:41:28.803063+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:28.803063+0000","last_undegraded":"2023-12-22T08:41:28.803063+0000","last_fullsized":"2023-12-22T08:41:28.803063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:09:14.878520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.807574+0000","last_change":"2023-12-22T08:41:27.128761+0000","last_active":"2023-12-22T08:41:28.807574+0000","last_peered":"2023-12-22T08:41:28.807574+0000","last_clean":"2023-12-22T08:41:28.807574+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:28.807574+0000","last_undegraded":"2023-12-22T08:41:28.807574+0000","last_fullsized":"2023-12-22T08:41:28.807574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:33:47.297349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801962+0000","last_change":"2023-12-22T08:41:26.742603+0000","last_active":"2023-12-22T08:41:28.801962+0000","last_peered":"2023-12-22T08:41:28.801962+0000","last_clean":"2023-12-22T08:41:28.801962+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:28.801962+0000","last_undegraded":"2023-12-22T08:41:28.801962+0000","last_fullsized":"2023-12-22T08:41:28.801962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:37:19.990879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-22T08:41:27.117407+0000","last_change":"2023-12-22T08:40:34.959893+0000","last_active":"2023-12-22T08:41:27.117407+0000","last_peered":"2023-12-22T08:41:27.117407+0000","last_clean":"2023-12-22T08:41:27.117407+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:27.117407+0000","last_undegraded":"2023-12-22T08:41:27.117407+0000","last_fullsized":"2023-12-22T08:41:27.117407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:40:33.854793+0000","last_clean_scrub_stamp":"2023-12-22T08:40:33.854793+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:58:59.265007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7893,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39100000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.373}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.432}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67800000000000005}]},{"osd":4,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.624},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.497}]},{"osd":1,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39400000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.372}]},{"osd":7,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.379},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.46700000000000003}]},{"osd":5,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.442},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.504}]},{"osd":7,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":368640,"data_stored":141379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.315},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.26200000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.34000000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.55100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.443},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.46300000000000002}]},{"osd":7,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.504},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.51200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":368640,"data_stored":141379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.438},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.26600000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.38},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.437},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.44700000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.42199999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:41:44.889 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.889 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.889 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.889 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.890 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.890 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.890 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.890 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.890 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.890 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.891 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.891 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.891 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.891 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.891 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.891 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.891 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.892 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.892 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.892 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.892 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.892 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.892 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.893 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.893 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.893 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.893 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.893 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.893 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.894 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.894 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.894 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.894 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.894 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.894 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.894 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.895 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.895 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.895 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.895 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.895 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.895 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.895 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.896 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.896 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.896 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.896 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.896 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.896 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.896 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.897 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.897 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.897 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.897 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.897 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.897 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.898 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.898 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.898 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.898 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.898 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.898 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.898 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.899 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.899 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.899 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.899 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.899 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.899 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.900 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.900 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.900 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.900 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.900 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.900 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.901 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.901 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.901 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.901 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.901 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.901 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.902 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.902 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.902 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.902 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.902 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.902 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.903 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.903 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.903 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.903 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.903 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.903 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.903 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.904 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.904 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.904 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-22T08:40:33.854793+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=40, tm_sec=33, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:41:44.904 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-22T08:41:46.069 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:46.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:41:46.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:04.905 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:42:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f70a69ce640 1 Processor -- start 2023-12-22T08:42:05.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f70a69ce640 1 -- start start 2023-12-22T08:42:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f70a69ce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a00b7dc0 0x7f70a0071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f70a69ce640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a0145340 con 0x7f70a00ba480 2023-12-22T08:42:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f70a69ce640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a006b8e0 con 0x7f70a014abf0 2023-12-22T08:42:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f70a69ce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b81a0 con 0x7f70a00b7dc0 2023-12-22T08:42:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709f7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f70a00ba480 0x7f70a0070ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60808/0 (socket says 172.21.15.31:60808) 2023-12-22T08:42:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709f7fe640 1 -- 172.21.15.31:0/418785235 learned_addr learned my addr 172.21.15.31:0/418785235 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:42:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709ffff640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a00b7dc0 0x7f70a0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970884033 0 0) 0x7f70a0145340 con 0x7f70a00ba480 2023-12-22T08:42:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7088003520 con 0x7f70a00ba480 2023-12-22T08:42:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573226376 0 0) 0x7f70a006b8e0 con 0x7f70a014abf0 2023-12-22T08:42:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a0145340 con 0x7f70a014abf0 2023-12-22T08:42:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3558629001 0 0) 0x7f7088003520 con 0x7f70a00ba480 2023-12-22T08:42:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a00b7dc0 msgr2=0x7f70a0071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a00b7dc0 0x7f70a0071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 >> v1:172.21.15.69:6789/0 conn(0x7f70a014abf0 legacy=0x7f70a014b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00715d0 con 0x7f70a00ba480 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.022+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f70900015f0 con 0x7f70a00ba480 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 >> v1:172.21.15.31:6789/0 conn(0x7f70a00ba480 legacy=0x7f70a0070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709effd640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f7088003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709effd640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70880047c0 0x7f7088004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709effd640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a00b7dc0 0x7f7088005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708800ba30 con 0x7f7088003b30 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708800bb70 con 0x7f70880047c0 2023-12-22T08:42:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708800bd30 con 0x7f70a00b7dc0 2023-12-22T08:42:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709ffff640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f7088003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709f7fe640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70880047c0 0x7f7088004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f70a4f6b640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a00b7dc0 0x7f7088005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709ffff640 1 -- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a00b7dc0 msgr2=0x7f7088005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709ffff640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a00b7dc0 0x7f7088005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709ffff640 1 -- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70880047c0 msgr2=0x7f7088004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709ffff640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70880047c0 0x7f7088004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.024+0000 7f709ffff640 1 -- 172.21.15.31:0/418785235 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088003520 con 0x7f7088003b30 2023-12-22T08:42:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f709ffff640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f7088003f30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7094009ac0 tx=0x7f70880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2e5e5a13b10d47 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709402c6b0 con 0x7f7088003b30 2023-12-22T08:42:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709402c810 con 0x7f7088003b30 2023-12-22T08:42:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f709effd640 1 -- 172.21.15.31:0/418785235 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709402cba0 con 0x7f7088003b30 2023-12-22T08:42:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f70a69ce640 1 -- 172.21.15.31:0/418785235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 msgr2=0x7f7088003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f70a69ce640 1 --2- 172.21.15.31:0/418785235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f7088003f30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7094009ac0 tx=0x7f70880057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f70a4f6b640 1 -- 172.21.15.31:0/418785235 reap_dead start 2023-12-22T08:42:05.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f70a69ce640 1 -- 172.21.15.31:0/418785235 shutdown_connections 2023-12-22T08:42:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f70a69ce640 1 -- 172.21.15.31:0/418785235 >> 172.21.15.31:0/418785235 conn(0x7f70a00be150 msgr2=0x7f70a00be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.025+0000 7f70a69ce640 1 -- 172.21.15.31:0/418785235 shutdown_connections 2023-12-22T08:42:05.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.026+0000 7f70a69ce640 1 -- 172.21.15.31:0/418785235 wait complete. 2023-12-22T08:42:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 Processor -- start 2023-12-22T08:42:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 -- start start 2023-12-22T08:42:05.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f70a0147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a014eb60 0x7f70a014d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a00b9400 0x7f70a0140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0148600 con 0x7f7088003b30 2023-12-22T08:42:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a0145690 con 0x7f70a00b9400 2023-12-22T08:42:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b9880 con 0x7f70a014eb60 2023-12-22T08:42:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f70a0147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f70a0147820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36732/0 (socket says 172.21.15.31:36732) 2023-12-22T08:42:05.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 -- 172.21.15.31:0/4056737870 learned_addr learned my addr 172.21.15.31:0/4056737870 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:42:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 -- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a014eb60 msgr2=0x7f70a014d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709f7fe640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a014eb60 0x7f70a014d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a4f6b640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a00b9400 0x7f70a0140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a014eb60 0x7f70a014d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 -- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a00b9400 msgr2=0x7f70a0140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a00b9400 0x7f70a0140260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 -- 172.21.15.31:0/4056737870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a0145930 con 0x7f7088003b30 2023-12-22T08:42:05.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709ffff640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f70a0147820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7094000c00 tx=0x7f7094004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709cff9640 1 -- 172.21.15.31:0/4056737870 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094003810 con 0x7f7088003b30 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709cff9640 1 -- 172.21.15.31:0/4056737870 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094003970 con 0x7f7088003b30 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a0147300 con 0x7f7088003b30 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f709cff9640 1 -- 172.21.15.31:0/4056737870 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094003d20 con 0x7f7088003b30 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.027+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a014b630 con 0x7f7088003b30 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.029+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a0147160 con 0x7f7088003b30 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.030+0000 7f709cff9640 1 -- 172.21.15.31:0/4056737870 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7094047450 con 0x7f7088003b30 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.030+0000 7f709cff9640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f708c06a460 0x7f708c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:05.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.030+0000 7f709cff9640 1 -- 172.21.15.31:0/4056737870 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70940aac20 con 0x7f7088003b30 2023-12-22T08:42:05.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.030+0000 7f709f7fe640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f708c06a460 0x7f708c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:05.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.031+0000 7f709f7fe640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f708c06a460 0x7f708c06c920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70a00b4b50 tx=0x7f7090009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:05.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.033+0000 7f709cff9640 1 -- 172.21.15.31:0/4056737870 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f70a0147160 con 0x7f7088003b30 2023-12-22T08:42:05.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.206+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70a006b290 con 0x7f708c06a460 2023-12-22T08:42:05.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.214+0000 7f709cff9640 1 -- 172.21.15.31:0/4056737870 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288235 (secure 0 0 0) 0x7f7090000ed0 con 0x7f708c06a460 2023-12-22T08:42:05.220 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:42:05.221 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:42:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f708c06a460 msgr2=0x7f708c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f708c06a460 0x7f708c06c920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70a00b4b50 tx=0x7f7090009040 comp rx=0 tx=0).stop 2023-12-22T08:42:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 msgr2=0x7f70a0147820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f70a0147820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7094000c00 tx=0x7f7094004730 comp rx=0 tx=0).stop 2023-12-22T08:42:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 shutdown_connections 2023-12-22T08:42:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f708c06a460 0x7f708c06c920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a00b9400 0x7f70a0140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70a014eb60 0x7f70a014d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 --2- 172.21.15.31:0/4056737870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7088003b30 0x7f70a0147820 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 >> 172.21.15.31:0/4056737870 conn(0x7f70a00be150 msgr2=0x7f70a01445d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 shutdown_connections 2023-12-22T08:42:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:05.218+0000 7f70a69ce640 1 -- 172.21.15.31:0/4056737870 wait complete. 2023-12-22T08:42:05.230 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-12-22T08:42:03.802399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598261,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3952,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":4046848,"data_stored":2270618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003049"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981642+0000","last_change":"2023-12-22T08:41:27.129975+0000","last_active":"2023-12-22T08:41:29.981642+0000","last_peered":"2023-12-22T08:41:29.981642+0000","last_clean":"2023-12-22T08:41:29.981642+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:41:29.981642+0000","last_undegraded":"2023-12-22T08:41:29.981642+0000","last_fullsized":"2023-12-22T08:41:29.981642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880737+0000","last_change":"2023-12-22T08:41:27.132308+0000","last_active":"2023-12-22T08:41:28.880737+0000","last_peered":"2023-12-22T08:41:28.880737+0000","last_clean":"2023-12-22T08:41:28.880737+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:41:28.880737+0000","last_undegraded":"2023-12-22T08:41:28.880737+0000","last_fullsized":"2023-12-22T08:41:28.880737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801951+0000","last_change":"2023-12-22T08:41:27.117719+0000","last_active":"2023-12-22T08:41:28.801951+0000","last_peered":"2023-12-22T08:41:28.801951+0000","last_clean":"2023-12-22T08:41:28.801951+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:41:28.801951+0000","last_undegraded":"2023-12-22T08:41:28.801951+0000","last_fullsized":"2023-12-22T08:41:28.801951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802650+0000","last_change":"2023-12-22T08:41:27.126330+0000","last_active":"2023-12-22T08:41:28.802650+0000","last_peered":"2023-12-22T08:41:28.802650+0000","last_clean":"2023-12-22T08:41:28.802650+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:41:28.802650+0000","last_undegraded":"2023-12-22T08:41:28.802650+0000","last_fullsized":"2023-12-22T08:41:28.802650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.980780+0000","last_change":"2023-12-22T08:41:27.131419+0000","last_active":"2023-12-22T08:41:29.980780+0000","last_peered":"2023-12-22T08:41:29.980780+0000","last_clean":"2023-12-22T08:41:29.980780+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:41:29.980780+0000","last_undegraded":"2023-12-22T08:41:29.980780+0000","last_fullsized":"2023-12-22T08:41:29.980780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880462+0000","last_change":"2023-12-22T08:41:27.125465+0000","last_active":"2023-12-22T08:41:28.880462+0000","last_peered":"2023-12-22T08:41:28.880462+0000","last_clean":"2023-12-22T08:41:28.880462+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:41:28.880462+0000","last_undegraded":"2023-12-22T08:41:28.880462+0000","last_fullsized":"2023-12-22T08:41:28.880462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981309+0000","last_change":"2023-12-22T08:41:27.127918+0000","last_active":"2023-12-22T08:41:29.981309+0000","last_peered":"2023-12-22T08:41:29.981309+0000","last_clean":"2023-12-22T08:41:29.981309+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:41:29.981309+0000","last_undegraded":"2023-12-22T08:41:29.981309+0000","last_fullsized":"2023-12-22T08:41:29.981309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981140+0000","last_change":"2023-12-22T08:41:27.128397+0000","last_active":"2023-12-22T08:41:29.981140+0000","last_peered":"2023-12-22T08:41:29.981140+0000","last_clean":"2023-12-22T08:41:29.981140+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:41:29.981140+0000","last_undegraded":"2023-12-22T08:41:29.981140+0000","last_fullsized":"2023-12-22T08:41:29.981140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802184+0000","last_change":"2023-12-22T08:41:27.115975+0000","last_active":"2023-12-22T08:41:28.802184+0000","last_peered":"2023-12-22T08:41:28.802184+0000","last_clean":"2023-12-22T08:41:28.802184+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:41:28.802184+0000","last_undegraded":"2023-12-22T08:41:28.802184+0000","last_fullsized":"2023-12-22T08:41:28.802184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802706+0000","last_change":"2023-12-22T08:41:27.133760+0000","last_active":"2023-12-22T08:41:28.802706+0000","last_peered":"2023-12-22T08:41:28.802706+0000","last_clean":"2023-12-22T08:41:28.802706+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:41:28.802706+0000","last_undegraded":"2023-12-22T08:41:28.802706+0000","last_fullsized":"2023-12-22T08:41:28.802706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981674+0000","last_change":"2023-12-22T08:41:27.121357+0000","last_active":"2023-12-22T08:41:29.981674+0000","last_peered":"2023-12-22T08:41:29.981674+0000","last_clean":"2023-12-22T08:41:29.981674+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:41:29.981674+0000","last_undegraded":"2023-12-22T08:41:29.981674+0000","last_fullsized":"2023-12-22T08:41:29.981674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801903+0000","last_change":"2023-12-22T08:41:27.131986+0000","last_active":"2023-12-22T08:41:28.801903+0000","last_peered":"2023-12-22T08:41:28.801903+0000","last_clean":"2023-12-22T08:41:28.801903+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:41:28.801903+0000","last_undegraded":"2023-12-22T08:41:28.801903+0000","last_fullsized":"2023-12-22T08:41:28.801903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.291070+0000","last_change":"2023-12-22T08:41:53.291188+0000","last_active":"2023-12-22T08:41:53.291070+0000","last_peered":"2023-12-22T08:41:53.291070+0000","last_clean":"2023-12-22T08:41:53.291070+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:53.291070+0000","last_undegraded":"2023-12-22T08:41:53.291070+0000","last_fullsized":"2023-12-22T08:41:53.291070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.291048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.291048+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.291048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:45.206131+0000","scrub_duration":0.001535675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.392095+0000","last_change":"2023-12-22T08:41:46.392219+0000","last_active":"2023-12-22T08:41:46.392095+0000","last_peered":"2023-12-22T08:41:46.392095+0000","last_clean":"2023-12-22T08:41:46.392095+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:46.392095+0000","last_undegraded":"2023-12-22T08:41:46.392095+0000","last_fullsized":"2023-12-22T08:41:46.392095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:46.392071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:46.392071+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.392071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:30.117973+0000","scrub_duration":0.00134274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.425993+0000","last_change":"2023-12-22T08:41:53.426136+0000","last_active":"2023-12-22T08:41:53.425993+0000","last_peered":"2023-12-22T08:41:53.425993+0000","last_clean":"2023-12-22T08:41:53.425993+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:53.425993+0000","last_undegraded":"2023-12-22T08:41:53.425993+0000","last_fullsized":"2023-12-22T08:41:53.425993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.425974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.425974+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.425974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:07.616597+0000","scrub_duration":0.0013887210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981714+0000","last_change":"2023-12-22T08:41:27.131917+0000","last_active":"2023-12-22T08:41:29.981714+0000","last_peered":"2023-12-22T08:41:29.981714+0000","last_clean":"2023-12-22T08:41:29.981714+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:41:29.981714+0000","last_undegraded":"2023-12-22T08:41:29.981714+0000","last_fullsized":"2023-12-22T08:41:29.981714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.314989+0000","last_change":"2023-12-22T08:41:57.315100+0000","last_active":"2023-12-22T08:41:57.314989+0000","last_peered":"2023-12-22T08:41:57.314989+0000","last_clean":"2023-12-22T08:41:57.314989+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:57.314989+0000","last_undegraded":"2023-12-22T08:41:57.314989+0000","last_fullsized":"2023-12-22T08:41:57.314989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.314966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.314966+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.314966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:23.782901+0000","scrub_duration":0.0013435879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880757+0000","last_change":"2023-12-22T08:41:27.132073+0000","last_active":"2023-12-22T08:41:28.880757+0000","last_peered":"2023-12-22T08:41:28.880757+0000","last_clean":"2023-12-22T08:41:28.880757+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:41:28.880757+0000","last_undegraded":"2023-12-22T08:41:28.880757+0000","last_fullsized":"2023-12-22T08:41:28.880757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880648+0000","last_change":"2023-12-22T08:41:27.128462+0000","last_active":"2023-12-22T08:41:28.880648+0000","last_peered":"2023-12-22T08:41:28.880648+0000","last_clean":"2023-12-22T08:41:28.880648+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:41:28.880648+0000","last_undegraded":"2023-12-22T08:41:28.880648+0000","last_fullsized":"2023-12-22T08:41:28.880648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.339033+0000","last_change":"2023-12-22T08:41:57.339144+0000","last_active":"2023-12-22T08:41:57.339033+0000","last_peered":"2023-12-22T08:41:57.339033+0000","last_clean":"2023-12-22T08:41:57.339033+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:57.339033+0000","last_undegraded":"2023-12-22T08:41:57.339033+0000","last_fullsized":"2023-12-22T08:41:57.339033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.339013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.339013+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.339013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:33.075734+0000","scrub_duration":0.0019016250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801986+0000","last_change":"2023-12-22T08:41:27.120855+0000","last_active":"2023-12-22T08:41:28.801986+0000","last_peered":"2023-12-22T08:41:28.801986+0000","last_clean":"2023-12-22T08:41:28.801986+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:41:28.801986+0000","last_undegraded":"2023-12-22T08:41:28.801986+0000","last_fullsized":"2023-12-22T08:41:28.801986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801948+0000","last_change":"2023-12-22T08:41:27.129305+0000","last_active":"2023-12-22T08:41:28.801948+0000","last_peered":"2023-12-22T08:41:28.801948+0000","last_clean":"2023-12-22T08:41:28.801948+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:41:28.801948+0000","last_undegraded":"2023-12-22T08:41:28.801948+0000","last_fullsized":"2023-12-22T08:41:28.801948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.884729+0000","last_change":"2023-12-22T08:41:27.123800+0000","last_active":"2023-12-22T08:41:29.884729+0000","last_peered":"2023-12-22T08:41:29.884729+0000","last_clean":"2023-12-22T08:41:29.884729+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:29.884729+0000","last_undegraded":"2023-12-22T08:41:29.884729+0000","last_fullsized":"2023-12-22T08:41:29.884729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801828+0000","last_change":"2023-12-22T08:41:27.114600+0000","last_active":"2023-12-22T08:41:28.801828+0000","last_peered":"2023-12-22T08:41:28.801828+0000","last_clean":"2023-12-22T08:41:28.801828+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:41:28.801828+0000","last_undegraded":"2023-12-22T08:41:28.801828+0000","last_fullsized":"2023-12-22T08:41:28.801828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802715+0000","last_change":"2023-12-22T08:41:27.121608+0000","last_active":"2023-12-22T08:41:28.802715+0000","last_peered":"2023-12-22T08:41:28.802715+0000","last_clean":"2023-12-22T08:41:28.802715+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:41:28.802715+0000","last_undegraded":"2023-12-22T08:41:28.802715+0000","last_fullsized":"2023-12-22T08:41:28.802715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880803+0000","last_change":"2023-12-22T08:41:27.131698+0000","last_active":"2023-12-22T08:41:28.880803+0000","last_peered":"2023-12-22T08:41:28.880803+0000","last_clean":"2023-12-22T08:41:28.880803+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:41:28.880803+0000","last_undegraded":"2023-12-22T08:41:28.880803+0000","last_fullsized":"2023-12-22T08:41:28.880803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802681+0000","last_change":"2023-12-22T08:41:27.121328+0000","last_active":"2023-12-22T08:41:28.802681+0000","last_peered":"2023-12-22T08:41:28.802681+0000","last_clean":"2023-12-22T08:41:28.802681+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:41:28.802681+0000","last_undegraded":"2023-12-22T08:41:28.802681+0000","last_fullsized":"2023-12-22T08:41:28.802681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.466297+0000","last_change":"2023-12-22T08:41:55.466394+0000","last_active":"2023-12-22T08:41:55.466297+0000","last_peered":"2023-12-22T08:41:55.466297+0000","last_clean":"2023-12-22T08:41:55.466297+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:55.466297+0000","last_undegraded":"2023-12-22T08:41:55.466297+0000","last_fullsized":"2023-12-22T08:41:55.466297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.466276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.466276+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.466276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:21.934211+0000","scrub_duration":0.001825491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802002+0000","last_change":"2023-12-22T08:41:27.128755+0000","last_active":"2023-12-22T08:41:28.802002+0000","last_peered":"2023-12-22T08:41:28.802002+0000","last_clean":"2023-12-22T08:41:28.802002+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:41:28.802002+0000","last_undegraded":"2023-12-22T08:41:28.802002+0000","last_fullsized":"2023-12-22T08:41:28.802002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981281+0000","last_change":"2023-12-22T08:41:27.126203+0000","last_active":"2023-12-22T08:41:29.981281+0000","last_peered":"2023-12-22T08:41:29.981281+0000","last_clean":"2023-12-22T08:41:29.981281+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:41:29.981281+0000","last_undegraded":"2023-12-22T08:41:29.981281+0000","last_fullsized":"2023-12-22T08:41:29.981281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981276+0000","last_change":"2023-12-22T08:41:27.127519+0000","last_active":"2023-12-22T08:41:29.981276+0000","last_peered":"2023-12-22T08:41:29.981276+0000","last_clean":"2023-12-22T08:41:29.981276+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:41:29.981276+0000","last_undegraded":"2023-12-22T08:41:29.981276+0000","last_fullsized":"2023-12-22T08:41:29.981276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981410+0000","last_change":"2023-12-22T08:41:27.122823+0000","last_active":"2023-12-22T08:41:29.981410+0000","last_peered":"2023-12-22T08:41:29.981410+0000","last_clean":"2023-12-22T08:41:29.981410+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:41:29.981410+0000","last_undegraded":"2023-12-22T08:41:29.981410+0000","last_fullsized":"2023-12-22T08:41:29.981410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:58.192723+0000","last_change":"2023-12-22T08:41:58.192870+0000","last_active":"2023-12-22T08:41:58.192723+0000","last_peered":"2023-12-22T08:41:58.192723+0000","last_clean":"2023-12-22T08:41:58.192723+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:58.192723+0000","last_undegraded":"2023-12-22T08:41:58.192723+0000","last_fullsized":"2023-12-22T08:41:58.192723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:58.192700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:58.192700+0000","last_clean_scrub_stamp":"2023-12-22T08:41:58.192700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:12.383323+0000","scrub_duration":0.0022326899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.299908+0000","last_change":"2023-12-22T08:41:51.300027+0000","last_active":"2023-12-22T08:41:51.299908+0000","last_peered":"2023-12-22T08:41:51.299908+0000","last_clean":"2023-12-22T08:41:51.299908+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:51.299908+0000","last_undegraded":"2023-12-22T08:41:51.299908+0000","last_fullsized":"2023-12-22T08:41:51.299908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-22T08:41:51.299887+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-22T08:41:51.299887+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.299887+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:43.214970+0000","scrub_duration":0.0020055799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981744+0000","last_change":"2023-12-22T08:41:27.130511+0000","last_active":"2023-12-22T08:41:29.981744+0000","last_peered":"2023-12-22T08:41:29.981744+0000","last_clean":"2023-12-22T08:41:29.981744+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:41:29.981744+0000","last_undegraded":"2023-12-22T08:41:29.981744+0000","last_fullsized":"2023-12-22T08:41:29.981744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.156737+0000","last_change":"2023-12-22T08:41:50.156875+0000","last_active":"2023-12-22T08:41:50.156737+0000","last_peered":"2023-12-22T08:41:50.156737+0000","last_clean":"2023-12-22T08:41:50.156737+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:50.156737+0000","last_undegraded":"2023-12-22T08:41:50.156737+0000","last_fullsized":"2023-12-22T08:41:50.156737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:41:50.156716+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:41:50.156716+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.156716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:25.893437+0000","scrub_duration":0.001927249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802077+0000","last_change":"2023-12-22T08:41:27.128744+0000","last_active":"2023-12-22T08:41:28.802077+0000","last_peered":"2023-12-22T08:41:28.802077+0000","last_clean":"2023-12-22T08:41:28.802077+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:41:28.802077+0000","last_undegraded":"2023-12-22T08:41:28.802077+0000","last_fullsized":"2023-12-22T08:41:28.802077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.427547+0000","last_change":"2023-12-22T08:41:56.427658+0000","last_active":"2023-12-22T08:41:56.427547+0000","last_peered":"2023-12-22T08:41:56.427547+0000","last_clean":"2023-12-22T08:41:56.427547+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:56.427547+0000","last_undegraded":"2023-12-22T08:41:56.427547+0000","last_fullsized":"2023-12-22T08:41:56.427547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:56.427525+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:56.427525+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.427525+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:46.472349+0000","scrub_duration":0.001805772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802691+0000","last_change":"2023-12-22T08:41:27.121058+0000","last_active":"2023-12-22T08:41:28.802691+0000","last_peered":"2023-12-22T08:41:28.802691+0000","last_clean":"2023-12-22T08:41:28.802691+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:41:28.802691+0000","last_undegraded":"2023-12-22T08:41:28.802691+0000","last_fullsized":"2023-12-22T08:41:28.802691+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:43.269307+0000","last_change":"2023-12-22T08:41:43.269401+0000","last_active":"2023-12-22T08:41:43.269307+0000","last_peered":"2023-12-22T08:41:43.269307+0000","last_clean":"2023-12-22T08:41:43.269307+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:43.269307+0000","last_undegraded":"2023-12-22T08:41:43.269307+0000","last_fullsized":"2023-12-22T08:41:43.269307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:43.269287+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:43.269287+0000","last_clean_scrub_stamp":"2023-12-22T08:41:43.269287+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:58.778431+0000","scrub_duration":0.001486996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981382+0000","last_change":"2023-12-22T08:41:27.123533+0000","last_active":"2023-12-22T08:41:29.981382+0000","last_peered":"2023-12-22T08:41:29.981382+0000","last_clean":"2023-12-22T08:41:29.981382+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:41:29.981382+0000","last_undegraded":"2023-12-22T08:41:29.981382+0000","last_fullsized":"2023-12-22T08:41:29.981382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802037+0000","last_change":"2023-12-22T08:41:26.750084+0000","last_active":"2023-12-22T08:41:28.802037+0000","last_peered":"2023-12-22T08:41:28.802037+0000","last_clean":"2023-12-22T08:41:28.802037+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:41:28.802037+0000","last_undegraded":"2023-12-22T08:41:28.802037+0000","last_fullsized":"2023-12-22T08:41:28.802037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801886+0000","last_change":"2023-12-22T08:41:27.125421+0000","last_active":"2023-12-22T08:41:28.801886+0000","last_peered":"2023-12-22T08:41:28.801886+0000","last_clean":"2023-12-22T08:41:28.801886+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:41:28.801886+0000","last_undegraded":"2023-12-22T08:41:28.801886+0000","last_fullsized":"2023-12-22T08:41:28.801886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801966+0000","last_change":"2023-12-22T08:41:26.743416+0000","last_active":"2023-12-22T08:41:28.801966+0000","last_peered":"2023-12-22T08:41:28.801966+0000","last_clean":"2023-12-22T08:41:28.801966+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:41:28.801966+0000","last_undegraded":"2023-12-22T08:41:28.801966+0000","last_fullsized":"2023-12-22T08:41:28.801966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801808+0000","last_change":"2023-12-22T08:41:27.123904+0000","last_active":"2023-12-22T08:41:28.801808+0000","last_peered":"2023-12-22T08:41:28.801808+0000","last_clean":"2023-12-22T08:41:28.801808+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:41:28.801808+0000","last_undegraded":"2023-12-22T08:41:28.801808+0000","last_fullsized":"2023-12-22T08:41:28.801808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880319+0000","last_change":"2023-12-22T08:41:26.745648+0000","last_active":"2023-12-22T08:41:28.880319+0000","last_peered":"2023-12-22T08:41:28.880319+0000","last_clean":"2023-12-22T08:41:28.880319+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:41:28.880319+0000","last_undegraded":"2023-12-22T08:41:28.880319+0000","last_fullsized":"2023-12-22T08:41:28.880319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.306341+0000","last_change":"2023-12-22T08:41:57.306477+0000","last_active":"2023-12-22T08:41:57.306341+0000","last_peered":"2023-12-22T08:41:57.306341+0000","last_clean":"2023-12-22T08:41:57.306341+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:57.306341+0000","last_undegraded":"2023-12-22T08:41:57.306341+0000","last_fullsized":"2023-12-22T08:41:57.306341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.306316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.306316+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.306316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:11.496939+0000","scrub_duration":0.0017265959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:49.922113+0000","last_change":"2023-12-22T08:41:49.922221+0000","last_active":"2023-12-22T08:41:49.922113+0000","last_peered":"2023-12-22T08:41:49.922113+0000","last_clean":"2023-12-22T08:41:49.922113+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:49.922113+0000","last_undegraded":"2023-12-22T08:41:49.922113+0000","last_fullsized":"2023-12-22T08:41:49.922113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:49.922088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:49.922088+0000","last_clean_scrub_stamp":"2023-12-22T08:41:49.922088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:25.658809+0000","scrub_duration":0.0013764789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801992+0000","last_change":"2023-12-22T08:41:27.133504+0000","last_active":"2023-12-22T08:41:28.801992+0000","last_peered":"2023-12-22T08:41:28.801992+0000","last_clean":"2023-12-22T08:41:28.801992+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:41:28.801992+0000","last_undegraded":"2023-12-22T08:41:28.801992+0000","last_fullsized":"2023-12-22T08:41:28.801992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.410013+0000","last_change":"2023-12-22T08:41:47.410123+0000","last_active":"2023-12-22T08:41:47.410013+0000","last_peered":"2023-12-22T08:41:47.410013+0000","last_clean":"2023-12-22T08:41:47.410013+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:47.410013+0000","last_undegraded":"2023-12-22T08:41:47.410013+0000","last_fullsized":"2023-12-22T08:41:47.410013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.409992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.409992+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.409992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:22.478066+0000","scrub_duration":0.001809291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880773+0000","last_change":"2023-12-22T08:41:27.129547+0000","last_active":"2023-12-22T08:41:28.880773+0000","last_peered":"2023-12-22T08:41:28.880773+0000","last_clean":"2023-12-22T08:41:28.880773+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:41:28.880773+0000","last_undegraded":"2023-12-22T08:41:28.880773+0000","last_fullsized":"2023-12-22T08:41:28.880773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:49.140788+0000","last_change":"2023-12-22T08:41:49.140898+0000","last_active":"2023-12-22T08:41:49.140788+0000","last_peered":"2023-12-22T08:41:49.140788+0000","last_clean":"2023-12-22T08:41:49.140788+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:49.140788+0000","last_undegraded":"2023-12-22T08:41:49.140788+0000","last_fullsized":"2023-12-22T08:41:49.140788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:49.140767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:49.140767+0000","last_clean_scrub_stamp":"2023-12-22T08:41:49.140767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:09.673528+0000","scrub_duration":0.001512722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880663+0000","last_change":"2023-12-22T08:41:27.131773+0000","last_active":"2023-12-22T08:41:28.880663+0000","last_peered":"2023-12-22T08:41:28.880663+0000","last_clean":"2023-12-22T08:41:28.880663+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:41:28.880663+0000","last_undegraded":"2023-12-22T08:41:28.880663+0000","last_fullsized":"2023-12-22T08:41:28.880663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.404090+0000","last_change":"2023-12-22T08:41:48.404235+0000","last_active":"2023-12-22T08:41:48.404090+0000","last_peered":"2023-12-22T08:41:48.404090+0000","last_clean":"2023-12-22T08:41:48.404090+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:48.404090+0000","last_undegraded":"2023-12-22T08:41:48.404090+0000","last_fullsized":"2023-12-22T08:41:48.404090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-22T08:41:48.404066+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-22T08:41:48.404066+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.404066+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:23.472141+0000","scrub_duration":0.0021286439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801936+0000","last_change":"2023-12-22T08:41:27.118227+0000","last_active":"2023-12-22T08:41:28.801936+0000","last_peered":"2023-12-22T08:41:28.801936+0000","last_clean":"2023-12-22T08:41:28.801936+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:41:28.801936+0000","last_undegraded":"2023-12-22T08:41:28.801936+0000","last_fullsized":"2023-12-22T08:41:28.801936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'11","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.358972+0000","last_change":"2023-12-22T08:41:52.359123+0000","last_active":"2023-12-22T08:41:52.358972+0000","last_peered":"2023-12-22T08:41:52.358972+0000","last_clean":"2023-12-22T08:41:52.358972+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:52.358972+0000","last_undegraded":"2023-12-22T08:41:52.358972+0000","last_fullsized":"2023-12-22T08:41:52.358972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-22T08:41:52.358921+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-22T08:41:52.358921+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.358921+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:07:26.911753+0000","scrub_duration":0.0024584440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7095,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802619+0000","last_change":"2023-12-22T08:41:27.120378+0000","last_active":"2023-12-22T08:41:28.802619+0000","last_peered":"2023-12-22T08:41:28.802619+0000","last_clean":"2023-12-22T08:41:28.802619+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:28.802619+0000","last_undegraded":"2023-12-22T08:41:28.802619+0000","last_fullsized":"2023-12-22T08:41:28.802619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.886840+0000","last_change":"2023-12-22T08:41:48.886981+0000","last_active":"2023-12-22T08:41:48.886840+0000","last_peered":"2023-12-22T08:41:48.886840+0000","last_clean":"2023-12-22T08:41:48.886840+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:48.886840+0000","last_undegraded":"2023-12-22T08:41:48.886840+0000","last_fullsized":"2023-12-22T08:41:48.886840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:48.886803+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:48.886803+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.886803+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:09.419564+0000","scrub_duration":0.0021129059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880547+0000","last_change":"2023-12-22T08:41:27.127482+0000","last_active":"2023-12-22T08:41:28.880547+0000","last_peered":"2023-12-22T08:41:28.880547+0000","last_clean":"2023-12-22T08:41:28.880547+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:41:28.880547+0000","last_undegraded":"2023-12-22T08:41:28.880547+0000","last_fullsized":"2023-12-22T08:41:28.880547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.305618+0000","last_change":"2023-12-22T08:41:48.305733+0000","last_active":"2023-12-22T08:41:48.305618+0000","last_peered":"2023-12-22T08:41:48.305618+0000","last_clean":"2023-12-22T08:41:48.305618+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:48.305618+0000","last_undegraded":"2023-12-22T08:41:48.305618+0000","last_fullsized":"2023-12-22T08:41:48.305618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:48.305595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:48.305595+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.305595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:24.042316+0000","scrub_duration":0.0016592250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981542+0000","last_change":"2023-12-22T08:41:27.123864+0000","last_active":"2023-12-22T08:41:29.981542+0000","last_peered":"2023-12-22T08:41:29.981542+0000","last_clean":"2023-12-22T08:41:29.981542+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:41:29.981542+0000","last_undegraded":"2023-12-22T08:41:29.981542+0000","last_fullsized":"2023-12-22T08:41:29.981542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.362707+0000","last_change":"2023-12-22T08:41:50.362820+0000","last_active":"2023-12-22T08:41:50.362707+0000","last_peered":"2023-12-22T08:41:50.362707+0000","last_clean":"2023-12-22T08:41:50.362707+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:50.362707+0000","last_undegraded":"2023-12-22T08:41:50.362707+0000","last_fullsized":"2023-12-22T08:41:50.362707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:50.362682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:50.362682+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.362682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:42.575045+0000","scrub_duration":0.001768356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981383+0000","last_change":"2023-12-22T08:41:27.122673+0000","last_active":"2023-12-22T08:41:29.981383+0000","last_peered":"2023-12-22T08:41:29.981383+0000","last_clean":"2023-12-22T08:41:29.981383+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:41:29.981383+0000","last_undegraded":"2023-12-22T08:41:29.981383+0000","last_fullsized":"2023-12-22T08:41:29.981383+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880311+0000","last_change":"2023-12-22T08:41:26.748785+0000","last_active":"2023-12-22T08:41:28.880311+0000","last_peered":"2023-12-22T08:41:28.880311+0000","last_clean":"2023-12-22T08:41:28.880311+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:41:28.880311+0000","last_undegraded":"2023-12-22T08:41:28.880311+0000","last_fullsized":"2023-12-22T08:41:28.880311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802144+0000","last_change":"2023-12-22T08:41:27.118299+0000","last_active":"2023-12-22T08:41:28.802144+0000","last_peered":"2023-12-22T08:41:28.802144+0000","last_clean":"2023-12-22T08:41:28.802144+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:41:28.802144+0000","last_undegraded":"2023-12-22T08:41:28.802144+0000","last_fullsized":"2023-12-22T08:41:28.802144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.288363+0000","last_change":"2023-12-22T08:41:52.288478+0000","last_active":"2023-12-22T08:41:52.288363+0000","last_peered":"2023-12-22T08:41:52.288363+0000","last_clean":"2023-12-22T08:41:52.288363+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:52.288363+0000","last_undegraded":"2023-12-22T08:41:52.288363+0000","last_fullsized":"2023-12-22T08:41:52.288363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:41:52.288339+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:41:52.288339+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.288339+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:27.356414+0000","scrub_duration":0.0018746640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802034+0000","last_change":"2023-12-22T08:41:27.122998+0000","last_active":"2023-12-22T08:41:28.802034+0000","last_peered":"2023-12-22T08:41:28.802034+0000","last_clean":"2023-12-22T08:41:28.802034+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:41:28.802034+0000","last_undegraded":"2023-12-22T08:41:28.802034+0000","last_fullsized":"2023-12-22T08:41:28.802034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802164+0000","last_change":"2023-12-22T08:41:26.740945+0000","last_active":"2023-12-22T08:41:28.802164+0000","last_peered":"2023-12-22T08:41:28.802164+0000","last_clean":"2023-12-22T08:41:28.802164+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:41:28.802164+0000","last_undegraded":"2023-12-22T08:41:28.802164+0000","last_fullsized":"2023-12-22T08:41:28.802164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802660+0000","last_change":"2023-12-22T08:41:27.125917+0000","last_active":"2023-12-22T08:41:28.802660+0000","last_peered":"2023-12-22T08:41:28.802660+0000","last_clean":"2023-12-22T08:41:28.802660+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:41:28.802660+0000","last_undegraded":"2023-12-22T08:41:28.802660+0000","last_fullsized":"2023-12-22T08:41:28.802660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802125+0000","last_change":"2023-12-22T08:41:26.743117+0000","last_active":"2023-12-22T08:41:28.802125+0000","last_peered":"2023-12-22T08:41:28.802125+0000","last_clean":"2023-12-22T08:41:28.802125+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:41:28.802125+0000","last_undegraded":"2023-12-22T08:41:28.802125+0000","last_fullsized":"2023-12-22T08:41:28.802125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.299499+0000","last_change":"2023-12-22T08:41:56.299604+0000","last_active":"2023-12-22T08:41:56.299499+0000","last_peered":"2023-12-22T08:41:56.299499+0000","last_clean":"2023-12-22T08:41:56.299499+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:56.299499+0000","last_undegraded":"2023-12-22T08:41:56.299499+0000","last_fullsized":"2023-12-22T08:41:56.299499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:56.299477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:56.299477+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.299477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:16.832238+0000","scrub_duration":0.0020187170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802096+0000","last_change":"2023-12-22T08:41:26.744095+0000","last_active":"2023-12-22T08:41:28.802096+0000","last_peered":"2023-12-22T08:41:28.802096+0000","last_clean":"2023-12-22T08:41:28.802096+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:41:28.802096+0000","last_undegraded":"2023-12-22T08:41:28.802096+0000","last_fullsized":"2023-12-22T08:41:28.802096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:25.724457+0000","last_clean_scrub_stamp":"2023-12-22T08:41:25.724457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.328671+0000","last_change":"2023-12-22T08:41:46.328791+0000","last_active":"2023-12-22T08:41:46.328671+0000","last_peered":"2023-12-22T08:41:46.328671+0000","last_clean":"2023-12-22T08:41:46.328671+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:46.328671+0000","last_undegraded":"2023-12-22T08:41:46.328671+0000","last_fullsized":"2023-12-22T08:41:46.328671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:46.328640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:46.328640+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.328640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:27.039382+0000","scrub_duration":0.0018943460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.128855+0000","last_change":"2023-12-22T08:41:47.128988+0000","last_active":"2023-12-22T08:41:47.128855+0000","last_peered":"2023-12-22T08:41:47.128855+0000","last_clean":"2023-12-22T08:41:47.128855+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:47.128855+0000","last_undegraded":"2023-12-22T08:41:47.128855+0000","last_fullsized":"2023-12-22T08:41:47.128855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:47.128831+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:47.128831+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.128831+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:39.043914+0000","scrub_duration":0.001887012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.230079+0000","last_change":"2023-12-22T08:41:51.230192+0000","last_active":"2023-12-22T08:41:51.230079+0000","last_peered":"2023-12-22T08:41:51.230079+0000","last_clean":"2023-12-22T08:41:51.230079+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:51.230079+0000","last_undegraded":"2023-12-22T08:41:51.230079+0000","last_fullsized":"2023-12-22T08:41:51.230079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:51.230056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:51.230056+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.230056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:49.398115+0000","scrub_duration":0.0014622179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.263666+0000","last_change":"2023-12-22T08:41:50.263773+0000","last_active":"2023-12-22T08:41:50.263666+0000","last_peered":"2023-12-22T08:41:50.263666+0000","last_clean":"2023-12-22T08:41:50.263666+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:50.263666+0000","last_undegraded":"2023-12-22T08:41:50.263666+0000","last_fullsized":"2023-12-22T08:41:50.263666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:50.263645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:50.263645+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.263645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:32.038572+0000","scrub_duration":0.0016633489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.309344+0000","last_change":"2023-12-22T08:41:47.309453+0000","last_active":"2023-12-22T08:41:47.309344+0000","last_peered":"2023-12-22T08:41:47.309344+0000","last_clean":"2023-12-22T08:41:47.309344+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:47.309344+0000","last_undegraded":"2023-12-22T08:41:47.309344+0000","last_fullsized":"2023-12-22T08:41:47.309344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.309320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.309320+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.309320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:48.116826+0000","scrub_duration":0.00141676,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:44.798903+0000","last_change":"2023-12-22T08:41:44.799001+0000","last_active":"2023-12-22T08:41:44.798903+0000","last_peered":"2023-12-22T08:41:44.798903+0000","last_clean":"2023-12-22T08:41:44.798903+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:44.798903+0000","last_undegraded":"2023-12-22T08:41:44.798903+0000","last_fullsized":"2023-12-22T08:41:44.798903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:44.798881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:44.798881+0000","last_clean_scrub_stamp":"2023-12-22T08:41:44.798881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:26.573807+0000","scrub_duration":0.0014226130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981409+0000","last_change":"2023-12-22T08:41:27.125910+0000","last_active":"2023-12-22T08:41:29.981409+0000","last_peered":"2023-12-22T08:41:29.981409+0000","last_clean":"2023-12-22T08:41:29.981409+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:41:29.981409+0000","last_undegraded":"2023-12-22T08:41:29.981409+0000","last_fullsized":"2023-12-22T08:41:29.981409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.361657+0000","last_change":"2023-12-22T08:41:47.361791+0000","last_active":"2023-12-22T08:41:47.361657+0000","last_peered":"2023-12-22T08:41:47.361657+0000","last_clean":"2023-12-22T08:41:47.361657+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:47.361657+0000","last_undegraded":"2023-12-22T08:41:47.361657+0000","last_fullsized":"2023-12-22T08:41:47.361657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.361621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.361621+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.361621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:31.087523+0000","scrub_duration":0.001395547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.276194+0000","last_change":"2023-12-22T08:41:52.276348+0000","last_active":"2023-12-22T08:41:52.276194+0000","last_peered":"2023-12-22T08:41:52.276194+0000","last_clean":"2023-12-22T08:41:52.276194+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:52.276194+0000","last_undegraded":"2023-12-22T08:41:52.276194+0000","last_fullsized":"2023-12-22T08:41:52.276194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:52.276172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:52.276172+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.276172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:34.051098+0000","scrub_duration":0.0021259880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.282069+0000","last_change":"2023-12-22T08:41:51.282206+0000","last_active":"2023-12-22T08:41:51.282069+0000","last_peered":"2023-12-22T08:41:51.282069+0000","last_clean":"2023-12-22T08:41:51.282069+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:51.282069+0000","last_undegraded":"2023-12-22T08:41:51.282069+0000","last_fullsized":"2023-12-22T08:41:51.282069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:51.282050+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:51.282050+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.282050+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:35.007952+0000","scrub_duration":0.002384714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802056+0000","last_change":"2023-12-22T08:41:27.117970+0000","last_active":"2023-12-22T08:41:28.802056+0000","last_peered":"2023-12-22T08:41:28.802056+0000","last_clean":"2023-12-22T08:41:28.802056+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:41:28.802056+0000","last_undegraded":"2023-12-22T08:41:28.802056+0000","last_fullsized":"2023-12-22T08:41:28.802056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.122748+0000","last_change":"2023-12-22T08:41:46.122903+0000","last_active":"2023-12-22T08:41:46.122748+0000","last_peered":"2023-12-22T08:41:46.122748+0000","last_clean":"2023-12-22T08:41:46.122748+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:46.122748+0000","last_undegraded":"2023-12-22T08:41:46.122748+0000","last_fullsized":"2023-12-22T08:41:46.122748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-12-22T08:41:46.122706+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-12-22T08:41:46.122706+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.122706+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:27.897633+0000","scrub_duration":0.0018311670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.147837+0000","last_change":"2023-12-22T08:41:57.147966+0000","last_active":"2023-12-22T08:41:57.147837+0000","last_peered":"2023-12-22T08:41:57.147837+0000","last_clean":"2023-12-22T08:41:57.147837+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:57.147837+0000","last_undegraded":"2023-12-22T08:41:57.147837+0000","last_fullsized":"2023-12-22T08:41:57.147837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.147812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.147812+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.147812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:49.360175+0000","scrub_duration":0.0014577909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:43.414929+0000","last_change":"2023-12-22T08:41:43.415022+0000","last_active":"2023-12-22T08:41:43.414929+0000","last_peered":"2023-12-22T08:41:43.414929+0000","last_clean":"2023-12-22T08:41:43.414929+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:43.414929+0000","last_undegraded":"2023-12-22T08:41:43.414929+0000","last_fullsized":"2023-12-22T08:41:43.414929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:43.414911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:43.414911+0000","last_clean_scrub_stamp":"2023-12-22T08:41:43.414911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:25.189838+0000","scrub_duration":0.0012201849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.214421+0000","last_change":"2023-12-22T08:41:56.214556+0000","last_active":"2023-12-22T08:41:56.214421+0000","last_peered":"2023-12-22T08:41:56.214421+0000","last_clean":"2023-12-22T08:41:56.214421+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:56.214421+0000","last_undegraded":"2023-12-22T08:41:56.214421+0000","last_fullsized":"2023-12-22T08:41:56.214421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:56.214400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:56.214400+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.214400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:31.951121+0000","scrub_duration":0.0019430840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:45.114607+0000","last_change":"2023-12-22T08:41:45.114691+0000","last_active":"2023-12-22T08:41:45.114607+0000","last_peered":"2023-12-22T08:41:45.114607+0000","last_clean":"2023-12-22T08:41:45.114607+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:45.114607+0000","last_undegraded":"2023-12-22T08:41:45.114607+0000","last_fullsized":"2023-12-22T08:41:45.114607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:45.114588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:45.114588+0000","last_clean_scrub_stamp":"2023-12-22T08:41:45.114588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:43.282646+0000","scrub_duration":0.0018108930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.145172+0000","last_change":"2023-12-22T08:41:55.145289+0000","last_active":"2023-12-22T08:41:55.145172+0000","last_peered":"2023-12-22T08:41:55.145172+0000","last_clean":"2023-12-22T08:41:55.145172+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:55.145172+0000","last_undegraded":"2023-12-22T08:41:55.145172+0000","last_fullsized":"2023-12-22T08:41:55.145172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.145150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.145150+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.145150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:30.213225+0000","scrub_duration":0.0017881869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.330293+0000","last_change":"2023-12-22T08:41:47.330406+0000","last_active":"2023-12-22T08:41:47.330293+0000","last_peered":"2023-12-22T08:41:47.330293+0000","last_clean":"2023-12-22T08:41:47.330293+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:47.330293+0000","last_undegraded":"2023-12-22T08:41:47.330293+0000","last_fullsized":"2023-12-22T08:41:47.330293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.330269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.330269+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.330269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:07.863030+0000","scrub_duration":0.0019224019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880288+0000","last_change":"2023-12-22T08:41:27.122915+0000","last_active":"2023-12-22T08:41:28.880288+0000","last_peered":"2023-12-22T08:41:28.880288+0000","last_clean":"2023-12-22T08:41:28.880288+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:41:28.880288+0000","last_undegraded":"2023-12-22T08:41:28.880288+0000","last_fullsized":"2023-12-22T08:41:28.880288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.023017+0000","last_change":"2023-12-22T08:41:55.023128+0000","last_active":"2023-12-22T08:41:55.023017+0000","last_peered":"2023-12-22T08:41:55.023017+0000","last_clean":"2023-12-22T08:41:55.023017+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:55.023017+0000","last_undegraded":"2023-12-22T08:41:55.023017+0000","last_fullsized":"2023-12-22T08:41:55.023017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.022997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.022997+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.022997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:30.091071+0000","scrub_duration":0.001386246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801857+0000","last_change":"2023-12-22T08:41:27.131013+0000","last_active":"2023-12-22T08:41:28.801857+0000","last_peered":"2023-12-22T08:41:28.801857+0000","last_clean":"2023-12-22T08:41:28.801857+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:41:28.801857+0000","last_undegraded":"2023-12-22T08:41:28.801857+0000","last_fullsized":"2023-12-22T08:41:28.801857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.364835+0000","last_change":"2023-12-22T08:41:53.364984+0000","last_active":"2023-12-22T08:41:53.364835+0000","last_peered":"2023-12-22T08:41:53.364835+0000","last_clean":"2023-12-22T08:41:53.364835+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:53.364835+0000","last_undegraded":"2023-12-22T08:41:53.364835+0000","last_fullsized":"2023-12-22T08:41:53.364835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.364814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.364814+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.364814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:19.832750+0000","scrub_duration":0.0016945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.285779+0000","last_change":"2023-12-22T08:41:55.285949+0000","last_active":"2023-12-22T08:41:55.285779+0000","last_peered":"2023-12-22T08:41:55.285779+0000","last_clean":"2023-12-22T08:41:55.285779+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:55.285779+0000","last_undegraded":"2023-12-22T08:41:55.285779+0000","last_fullsized":"2023-12-22T08:41:55.285779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.285757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.285757+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.285757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:09.476380+0000","scrub_duration":0.002040563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:44.383912+0000","last_change":"2023-12-22T08:41:44.384018+0000","last_active":"2023-12-22T08:41:44.383912+0000","last_peered":"2023-12-22T08:41:44.383912+0000","last_clean":"2023-12-22T08:41:44.383912+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:44.383912+0000","last_undegraded":"2023-12-22T08:41:44.383912+0000","last_fullsized":"2023-12-22T08:41:44.383912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:44.383888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:44.383888+0000","last_clean_scrub_stamp":"2023-12-22T08:41:44.383888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:45.191395+0000","scrub_duration":0.0013960800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.351143+0000","last_change":"2023-12-22T08:41:50.351285+0000","last_active":"2023-12-22T08:41:50.351143+0000","last_peered":"2023-12-22T08:41:50.351143+0000","last_clean":"2023-12-22T08:41:50.351143+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:50.351143+0000","last_undegraded":"2023-12-22T08:41:50.351143+0000","last_fullsized":"2023-12-22T08:41:50.351143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-12-22T08:41:50.351120+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-12-22T08:41:50.351120+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.351120+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:25.419194+0000","scrub_duration":0.0078495939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7893,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69999999999999996}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.377},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42699999999999999}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.47999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.77800000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69599999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.40999999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.502}]},{"osd":1,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52000000000000002}]},{"osd":3,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.44}]},{"osd":4,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.38400000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.497},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":368640,"data_stored":141379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.441},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.52300000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.503},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.23999999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.313}]},{"osd":3,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":368640,"data_stored":141379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.27800000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.624},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.252},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.29099999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:42:05.236 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.236 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.237 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.237 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.237 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.237 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.237 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.237 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.238 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.238 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.238 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.238 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.238 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.239 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.239 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.239 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.239 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.239 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.239 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.239 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.240 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.240 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.240 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.240 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.240 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.240 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.241 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.241 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.241 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.241 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.241 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.241 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.242 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.242 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.242 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.242 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.242 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.242 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.243 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.243 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.243 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.243 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.243 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.243 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.244 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.244 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.244 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.244 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.244 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.244 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-22T08:41:25.724457+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=25, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.245 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.245 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.245 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.245 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:05.246 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-22T08:42:16.245 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:16.248 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:16.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:25.247 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:42:25.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.363+0000 7f974cba2640 1 Processor -- start 2023-12-22T08:42:25.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.363+0000 7f974cba2640 1 -- start start 2023-12-22T08:42:25.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.364+0000 7f974cba2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f97480baaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:25.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.364+0000 7f974cba2640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f97480b6850 0x7f97480b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:25.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.364+0000 7f974cba2640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9748144ed0 con 0x7f9748144af0 2023-12-22T08:42:25.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.364+0000 7f974cba2640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974814b7d0 con 0x7f97480b6850 2023-12-22T08:42:25.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.364+0000 7f974cba2640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974814e980 con 0x7f974814b390 2023-12-22T08:42:25.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.364+0000 7f9746ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f97480baaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:25.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.364+0000 7f9747fff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f97480b6850 0x7f97480b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:25.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f97477fe640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f9748144af0 0x7f974814e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.31:52008/0 (socket says 172.21.15.31:52008) 2023-12-22T08:42:25.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f97477fe640 1 -- 172.21.15.31:0/218353413 learned_addr learned my addr 172.21.15.31:0/218353413 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:42:25.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f97467fc640 1 -- 172.21.15.31:0/218353413 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112372867 0 0) 0x7f9748144ed0 con 0x7f9748144af0 2023-12-22T08:42:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f97467fc640 1 -- 172.21.15.31:0/218353413 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9730003520 con 0x7f9748144af0 2023-12-22T08:42:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f9746ffd640 1 -- 172.21.15.31:0/218353413 >> v2:172.21.15.69:3300/0 conn(0x7f97480b6850 msgr2=0x7f97480b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f9746ffd640 1 --2- 172.21.15.31:0/218353413 >> v2:172.21.15.69:3300/0 conn(0x7f97480b6850 0x7f97480b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f9746ffd640 1 -- 172.21.15.31:0/218353413 >> v1:172.21.15.69:6789/0 conn(0x7f9748144af0 legacy=0x7f974814e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f9746ffd640 1 -- 172.21.15.31:0/218353413 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974814ec30 con 0x7f974814b390 2023-12-22T08:42:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.365+0000 7f9747fff640 1 --2- 172.21.15.31:0/218353413 >> v2:172.21.15.69:3300/0 conn(0x7f97480b6850 0x7f97480b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:42:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f9746ffd640 1 --2- 172.21.15.31:0/218353413 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f97480baaf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f973c0097a0 tx=0x7f973c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fbbc68fc2e47e6c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f97467fc640 1 -- 172.21.15.31:0/218353413 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c030610 con 0x7f974814b390 2023-12-22T08:42:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f97467fc640 1 -- 172.21.15.31:0/218353413 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c030770 con 0x7f974814b390 2023-12-22T08:42:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f97467fc640 1 -- 172.21.15.31:0/218353413 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c030b00 con 0x7f974814b390 2023-12-22T08:42:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f974cba2640 1 -- 172.21.15.31:0/218353413 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 msgr2=0x7f97480baaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f974cba2640 1 --2- 172.21.15.31:0/218353413 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f97480baaf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f973c0097a0 tx=0x7f973c02b960 comp rx=0 tx=0).stop 2023-12-22T08:42:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f974cba2640 1 -- 172.21.15.31:0/218353413 shutdown_connections 2023-12-22T08:42:25.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f974cba2640 1 --2- 172.21.15.31:0/218353413 >> v2:172.21.15.69:3300/0 conn(0x7f97480b6850 0x7f97480b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f974cba2640 1 --2- 172.21.15.31:0/218353413 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f97480baaf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.366+0000 7f974cba2640 1 -- 172.21.15.31:0/218353413 >> 172.21.15.31:0/218353413 conn(0x7f97480c0170 msgr2=0x7f97480c0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.367+0000 7f974cba2640 1 -- 172.21.15.31:0/218353413 shutdown_connections 2023-12-22T08:42:25.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.367+0000 7f974cba2640 1 -- 172.21.15.31:0/218353413 wait complete. 2023-12-22T08:42:25.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.368+0000 7f974cba2640 1 Processor -- start 2023-12-22T08:42:25.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.368+0000 7f974cba2640 1 -- start start 2023-12-22T08:42:25.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.368+0000 7f974cba2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97480b6850 0x7f974814d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:25.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.368+0000 7f974cba2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9748144af0 0x7f97481485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:25.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.368+0000 7f974cba2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f9748148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:25.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.368+0000 7f974cba2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974814a360 con 0x7f97480b6850 2023-12-22T08:42:25.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.368+0000 7f974cba2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974814d780 con 0x7f9748144af0 2023-12-22T08:42:25.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.368+0000 7f974cba2640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974813b7d0 con 0x7f974814b390 2023-12-22T08:42:25.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97480b6850 0x7f974814d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:25.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97480b6850 0x7f974814d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40334/0 (socket says 172.21.15.31:40334) 2023-12-22T08:42:25.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 -- 172.21.15.31:0/2634199737 learned_addr learned my addr 172.21.15.31:0/2634199737 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:42:25.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f9747fff640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f9748148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:25.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f9746ffd640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9748144af0 0x7f97481485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:25.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 -- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 msgr2=0x7f9748148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:25.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f9748148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 -- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9748144af0 msgr2=0x7f97481485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:25.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9748144af0 0x7f97481485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 -- 172.21.15.31:0/2634199737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740009a70 con 0x7f97480b6850 2023-12-22T08:42:25.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f9747fff640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f9748148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:25.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f9746ffd640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9748144af0 0x7f97481485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:25.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f97477fe640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97480b6850 0x7f974814d240 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f973800c500 tx=0x7f973800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:25.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f972ffff640 1 -- 172.21.15.31:0/2634199737 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738005ce0 con 0x7f97480b6850 2023-12-22T08:42:25.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f972ffff640 1 -- 172.21.15.31:0/2634199737 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9738005e40 con 0x7f97480b6850 2023-12-22T08:42:25.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f972ffff640 1 -- 172.21.15.31:0/2634199737 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738007330 con 0x7f97480b6850 2023-12-22T08:42:25.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c009400 con 0x7f97480b6850 2023-12-22T08:42:25.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.369+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97481499c0 con 0x7f97480b6850 2023-12-22T08:42:25.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.370+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974814a4a0 con 0x7f97480b6850 2023-12-22T08:42:25.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.371+0000 7f972ffff640 1 -- 172.21.15.31:0/2634199737 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9738007490 con 0x7f97480b6850 2023-12-22T08:42:25.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.371+0000 7f972ffff640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f973406a460 0x7f973406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:25.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.371+0000 7f972ffff640 1 -- 172.21.15.31:0/2634199737 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9738087f20 con 0x7f97480b6850 2023-12-22T08:42:25.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.372+0000 7f9746ffd640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f973406a460 0x7f973406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:25.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.372+0000 7f9746ffd640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f973406a460 0x7f973406c920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f973c036000 tx=0x7f973c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:25.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.376+0000 7f972ffff640 1 -- 172.21.15.31:0/2634199737 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9738053660 con 0x7f97480b6850 2023-12-22T08:42:25.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.549+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f974814ab90 con 0x7f973406a460 2023-12-22T08:42:25.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.557+0000 7f972ffff640 1 -- 172.21.15.31:0/2634199737 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290072 (secure 0 0 0) 0x7f973c044470 con 0x7f973406a460 2023-12-22T08:42:25.563 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:42:25.564 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:42:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f973406a460 msgr2=0x7f973406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f973406a460 0x7f973406c920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f973c036000 tx=0x7f973c008030 comp rx=0 tx=0).stop 2023-12-22T08:42:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97480b6850 msgr2=0x7f974814d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97480b6850 0x7f974814d240 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f973800c500 tx=0x7f973800c9c0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 shutdown_connections 2023-12-22T08:42:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f973406a460 0x7f973406c920 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f974814b390 0x7f9748148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9748144af0 0x7f97481485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 --2- 172.21.15.31:0/2634199737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97480b6850 0x7f974814d240 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.560+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 >> 172.21.15.31:0/2634199737 conn(0x7f97480c0170 msgr2=0x7f97480b87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.561+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 shutdown_connections 2023-12-22T08:42:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:25.561+0000 7f974cba2640 1 -- 172.21.15.31:0/2634199737 wait complete. 2023-12-22T08:42:25.573 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-12-22T08:42:23.807067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598261,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":169,"ondisk_log_size":169,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3952,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":4046848,"data_stored":2270618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002679"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:11.223778+0000","last_change":"2023-12-22T08:42:11.223920+0000","last_active":"2023-12-22T08:42:11.223778+0000","last_peered":"2023-12-22T08:42:11.223778+0000","last_clean":"2023-12-22T08:42:11.223778+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:42:11.223778+0000","last_undegraded":"2023-12-22T08:42:11.223778+0000","last_fullsized":"2023-12-22T08:42:11.223778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:11.223740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:11.223740+0000","last_clean_scrub_stamp":"2023-12-22T08:42:11.223740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:10:01.268563+0000","scrub_duration":0.001367285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880737+0000","last_change":"2023-12-22T08:41:27.132308+0000","last_active":"2023-12-22T08:41:28.880737+0000","last_peered":"2023-12-22T08:41:28.880737+0000","last_clean":"2023-12-22T08:41:28.880737+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:41:28.880737+0000","last_undegraded":"2023-12-22T08:41:28.880737+0000","last_fullsized":"2023-12-22T08:41:28.880737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801951+0000","last_change":"2023-12-22T08:41:27.117719+0000","last_active":"2023-12-22T08:41:28.801951+0000","last_peered":"2023-12-22T08:41:28.801951+0000","last_clean":"2023-12-22T08:41:28.801951+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:41:28.801951+0000","last_undegraded":"2023-12-22T08:41:28.801951+0000","last_fullsized":"2023-12-22T08:41:28.801951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:14.199400+0000","last_change":"2023-12-22T08:42:14.199510+0000","last_active":"2023-12-22T08:42:14.199400+0000","last_peered":"2023-12-22T08:42:14.199400+0000","last_clean":"2023-12-22T08:42:14.199400+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:42:14.199400+0000","last_undegraded":"2023-12-22T08:42:14.199400+0000","last_fullsized":"2023-12-22T08:42:14.199400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:14.199377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:14.199377+0000","last_clean_scrub_stamp":"2023-12-22T08:42:14.199377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:42.543599+0000","scrub_duration":0.001571607,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.378014+0000","last_change":"2023-12-22T08:42:02.378129+0000","last_active":"2023-12-22T08:42:02.378014+0000","last_peered":"2023-12-22T08:42:02.378014+0000","last_clean":"2023-12-22T08:42:02.378014+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:42:02.378014+0000","last_undegraded":"2023-12-22T08:42:02.378014+0000","last_fullsized":"2023-12-22T08:42:02.378014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:02.377992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:02.377992+0000","last_clean_scrub_stamp":"2023-12-22T08:42:02.377992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:37.446067+0000","scrub_duration":0.001435946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880462+0000","last_change":"2023-12-22T08:41:27.125465+0000","last_active":"2023-12-22T08:41:28.880462+0000","last_peered":"2023-12-22T08:41:28.880462+0000","last_clean":"2023-12-22T08:41:28.880462+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:41:28.880462+0000","last_undegraded":"2023-12-22T08:41:28.880462+0000","last_fullsized":"2023-12-22T08:41:28.880462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:05.422750+0000","last_change":"2023-12-22T08:42:05.422865+0000","last_active":"2023-12-22T08:42:05.422750+0000","last_peered":"2023-12-22T08:42:05.422750+0000","last_clean":"2023-12-22T08:42:05.422750+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:42:05.422750+0000","last_undegraded":"2023-12-22T08:42:05.422750+0000","last_fullsized":"2023-12-22T08:42:05.422750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:05.422725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:05.422725+0000","last_clean_scrub_stamp":"2023-12-22T08:42:05.422725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:51.130668+0000","scrub_duration":0.0014389050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981140+0000","last_change":"2023-12-22T08:41:27.128397+0000","last_active":"2023-12-22T08:41:29.981140+0000","last_peered":"2023-12-22T08:41:29.981140+0000","last_clean":"2023-12-22T08:41:29.981140+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:41:29.981140+0000","last_undegraded":"2023-12-22T08:41:29.981140+0000","last_fullsized":"2023-12-22T08:41:29.981140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802184+0000","last_change":"2023-12-22T08:41:27.115975+0000","last_active":"2023-12-22T08:41:28.802184+0000","last_peered":"2023-12-22T08:41:28.802184+0000","last_clean":"2023-12-22T08:41:28.802184+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:41:28.802184+0000","last_undegraded":"2023-12-22T08:41:28.802184+0000","last_fullsized":"2023-12-22T08:41:28.802184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:16.265973+0000","last_change":"2023-12-22T08:42:16.266099+0000","last_active":"2023-12-22T08:42:16.265973+0000","last_peered":"2023-12-22T08:42:16.265973+0000","last_clean":"2023-12-22T08:42:16.265973+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:42:16.265973+0000","last_undegraded":"2023-12-22T08:42:16.265973+0000","last_fullsized":"2023-12-22T08:42:16.265973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:16.265936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:16.265936+0000","last_clean_scrub_stamp":"2023-12-22T08:42:16.265936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:19.357741+0000","scrub_duration":0.001699812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:09.400698+0000","last_change":"2023-12-22T08:42:09.400812+0000","last_active":"2023-12-22T08:42:09.400698+0000","last_peered":"2023-12-22T08:42:09.400698+0000","last_clean":"2023-12-22T08:42:09.400698+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:42:09.400698+0000","last_undegraded":"2023-12-22T08:42:09.400698+0000","last_fullsized":"2023-12-22T08:42:09.400698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:09.400677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:09.400677+0000","last_clean_scrub_stamp":"2023-12-22T08:42:09.400677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:10.769071+0000","scrub_duration":0.0018771250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:12.545179+0000","last_change":"2023-12-22T08:42:12.545295+0000","last_active":"2023-12-22T08:42:12.545179+0000","last_peered":"2023-12-22T08:42:12.545179+0000","last_clean":"2023-12-22T08:42:12.545179+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:42:12.545179+0000","last_undegraded":"2023-12-22T08:42:12.545179+0000","last_fullsized":"2023-12-22T08:42:12.545179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:12.545159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:12.545159+0000","last_clean_scrub_stamp":"2023-12-22T08:42:12.545159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:40.889382+0000","scrub_duration":0.0018251529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.291070+0000","last_change":"2023-12-22T08:41:53.291188+0000","last_active":"2023-12-22T08:41:53.291070+0000","last_peered":"2023-12-22T08:41:53.291070+0000","last_clean":"2023-12-22T08:41:53.291070+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:53.291070+0000","last_undegraded":"2023-12-22T08:41:53.291070+0000","last_fullsized":"2023-12-22T08:41:53.291070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.291048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.291048+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.291048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:45.206131+0000","scrub_duration":0.001535675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.392095+0000","last_change":"2023-12-22T08:41:46.392219+0000","last_active":"2023-12-22T08:41:46.392095+0000","last_peered":"2023-12-22T08:41:46.392095+0000","last_clean":"2023-12-22T08:41:46.392095+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:46.392095+0000","last_undegraded":"2023-12-22T08:41:46.392095+0000","last_fullsized":"2023-12-22T08:41:46.392095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:46.392071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:46.392071+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.392071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:30.117973+0000","scrub_duration":0.00134274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.425993+0000","last_change":"2023-12-22T08:41:53.426136+0000","last_active":"2023-12-22T08:41:53.425993+0000","last_peered":"2023-12-22T08:41:53.425993+0000","last_clean":"2023-12-22T08:41:53.425993+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:53.425993+0000","last_undegraded":"2023-12-22T08:41:53.425993+0000","last_fullsized":"2023-12-22T08:41:53.425993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.425974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.425974+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.425974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:07.616597+0000","scrub_duration":0.0013887210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:12.398366+0000","last_change":"2023-12-22T08:42:12.398500+0000","last_active":"2023-12-22T08:42:12.398366+0000","last_peered":"2023-12-22T08:42:12.398366+0000","last_clean":"2023-12-22T08:42:12.398366+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:42:12.398366+0000","last_undegraded":"2023-12-22T08:42:12.398366+0000","last_fullsized":"2023-12-22T08:42:12.398366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:12.398346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:12.398346+0000","last_clean_scrub_stamp":"2023-12-22T08:42:12.398346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:40.742568+0000","scrub_duration":0.0019663440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.314989+0000","last_change":"2023-12-22T08:41:57.315100+0000","last_active":"2023-12-22T08:41:57.314989+0000","last_peered":"2023-12-22T08:41:57.314989+0000","last_clean":"2023-12-22T08:41:57.314989+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:57.314989+0000","last_undegraded":"2023-12-22T08:41:57.314989+0000","last_fullsized":"2023-12-22T08:41:57.314989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.314966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.314966+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.314966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:23.782901+0000","scrub_duration":0.0013435879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880757+0000","last_change":"2023-12-22T08:41:27.132073+0000","last_active":"2023-12-22T08:41:28.880757+0000","last_peered":"2023-12-22T08:41:28.880757+0000","last_clean":"2023-12-22T08:41:28.880757+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:41:28.880757+0000","last_undegraded":"2023-12-22T08:41:28.880757+0000","last_fullsized":"2023-12-22T08:41:28.880757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:09.364502+0000","last_change":"2023-12-22T08:42:09.364634+0000","last_active":"2023-12-22T08:42:09.364502+0000","last_peered":"2023-12-22T08:42:09.364502+0000","last_clean":"2023-12-22T08:42:09.364502+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:42:09.364502+0000","last_undegraded":"2023-12-22T08:42:09.364502+0000","last_fullsized":"2023-12-22T08:42:09.364502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:09.364480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:09.364480+0000","last_clean_scrub_stamp":"2023-12-22T08:42:09.364480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:22.488029+0000","scrub_duration":0.0014474620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.339033+0000","last_change":"2023-12-22T08:41:57.339144+0000","last_active":"2023-12-22T08:41:57.339033+0000","last_peered":"2023-12-22T08:41:57.339033+0000","last_clean":"2023-12-22T08:41:57.339033+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:57.339033+0000","last_undegraded":"2023-12-22T08:41:57.339033+0000","last_fullsized":"2023-12-22T08:41:57.339033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.339013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.339013+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.339013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:33.075734+0000","scrub_duration":0.0019016250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801986+0000","last_change":"2023-12-22T08:41:27.120855+0000","last_active":"2023-12-22T08:41:28.801986+0000","last_peered":"2023-12-22T08:41:28.801986+0000","last_clean":"2023-12-22T08:41:28.801986+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:41:28.801986+0000","last_undegraded":"2023-12-22T08:41:28.801986+0000","last_fullsized":"2023-12-22T08:41:28.801986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801948+0000","last_change":"2023-12-22T08:41:27.129305+0000","last_active":"2023-12-22T08:41:28.801948+0000","last_peered":"2023-12-22T08:41:28.801948+0000","last_clean":"2023-12-22T08:41:28.801948+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:41:28.801948+0000","last_undegraded":"2023-12-22T08:41:28.801948+0000","last_fullsized":"2023-12-22T08:41:28.801948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:59.181028+0000","last_change":"2023-12-22T08:41:59.181163+0000","last_active":"2023-12-22T08:41:59.181028+0000","last_peered":"2023-12-22T08:41:59.181028+0000","last_clean":"2023-12-22T08:41:59.181028+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:59.181028+0000","last_undegraded":"2023-12-22T08:41:59.181028+0000","last_fullsized":"2023-12-22T08:41:59.181028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.181005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.181005+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.181005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:56:27.331411+0000","scrub_duration":0.0021759510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:09.543105+0000","last_change":"2023-12-22T08:42:09.543228+0000","last_active":"2023-12-22T08:42:09.543105+0000","last_peered":"2023-12-22T08:42:09.543105+0000","last_clean":"2023-12-22T08:42:09.543105+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:42:09.543105+0000","last_undegraded":"2023-12-22T08:42:09.543105+0000","last_fullsized":"2023-12-22T08:42:09.543105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:09.543087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:09.543087+0000","last_clean_scrub_stamp":"2023-12-22T08:42:09.543087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:10.911481+0000","scrub_duration":0.001879384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.223139+0000","last_change":"2023-12-22T08:42:02.223246+0000","last_active":"2023-12-22T08:42:02.223139+0000","last_peered":"2023-12-22T08:42:02.223139+0000","last_clean":"2023-12-22T08:42:02.223139+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:42:02.223139+0000","last_undegraded":"2023-12-22T08:42:02.223139+0000","last_fullsized":"2023-12-22T08:42:02.223139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:02.223117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:02.223117+0000","last_clean_scrub_stamp":"2023-12-22T08:42:02.223117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:52.267940+0000","scrub_duration":0.0015338839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880803+0000","last_change":"2023-12-22T08:41:27.131698+0000","last_active":"2023-12-22T08:41:28.880803+0000","last_peered":"2023-12-22T08:41:28.880803+0000","last_clean":"2023-12-22T08:41:28.880803+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:41:28.880803+0000","last_undegraded":"2023-12-22T08:41:28.880803+0000","last_fullsized":"2023-12-22T08:41:28.880803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:15.220962+0000","last_change":"2023-12-22T08:42:15.221070+0000","last_active":"2023-12-22T08:42:15.220962+0000","last_peered":"2023-12-22T08:42:15.220962+0000","last_clean":"2023-12-22T08:42:15.220962+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:42:15.220962+0000","last_undegraded":"2023-12-22T08:42:15.220962+0000","last_fullsized":"2023-12-22T08:42:15.220962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:15.220930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:15.220930+0000","last_clean_scrub_stamp":"2023-12-22T08:42:15.220930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:28.344479+0000","scrub_duration":0.0021046849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.466297+0000","last_change":"2023-12-22T08:41:55.466394+0000","last_active":"2023-12-22T08:41:55.466297+0000","last_peered":"2023-12-22T08:41:55.466297+0000","last_clean":"2023-12-22T08:41:55.466297+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:55.466297+0000","last_undegraded":"2023-12-22T08:41:55.466297+0000","last_fullsized":"2023-12-22T08:41:55.466297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.466276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.466276+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.466276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:21.934211+0000","scrub_duration":0.001825491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802002+0000","last_change":"2023-12-22T08:41:27.128755+0000","last_active":"2023-12-22T08:41:28.802002+0000","last_peered":"2023-12-22T08:41:28.802002+0000","last_clean":"2023-12-22T08:41:28.802002+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:41:28.802002+0000","last_undegraded":"2023-12-22T08:41:28.802002+0000","last_fullsized":"2023-12-22T08:41:28.802002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:14.468468+0000","last_change":"2023-12-22T08:42:14.468583+0000","last_active":"2023-12-22T08:42:14.468468+0000","last_peered":"2023-12-22T08:42:14.468468+0000","last_clean":"2023-12-22T08:42:14.468468+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:42:14.468468+0000","last_undegraded":"2023-12-22T08:42:14.468468+0000","last_fullsized":"2023-12-22T08:42:14.468468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:14.468446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:14.468446+0000","last_clean_scrub_stamp":"2023-12-22T08:42:14.468446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:17.560251+0000","scrub_duration":0.0014294589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:08.224457+0000","last_change":"2023-12-22T08:42:08.224561+0000","last_active":"2023-12-22T08:42:08.224457+0000","last_peered":"2023-12-22T08:42:08.224457+0000","last_clean":"2023-12-22T08:42:08.224457+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:42:08.224457+0000","last_undegraded":"2023-12-22T08:42:08.224457+0000","last_fullsized":"2023-12-22T08:42:08.224457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:08.224435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:08.224435+0000","last_clean_scrub_stamp":"2023-12-22T08:42:08.224435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:34.692370+0000","scrub_duration":0.0015900809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981410+0000","last_change":"2023-12-22T08:41:27.122823+0000","last_active":"2023-12-22T08:41:29.981410+0000","last_peered":"2023-12-22T08:41:29.981410+0000","last_clean":"2023-12-22T08:41:29.981410+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:41:29.981410+0000","last_undegraded":"2023-12-22T08:41:29.981410+0000","last_fullsized":"2023-12-22T08:41:29.981410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:58.192723+0000","last_change":"2023-12-22T08:41:58.192870+0000","last_active":"2023-12-22T08:41:58.192723+0000","last_peered":"2023-12-22T08:41:58.192723+0000","last_clean":"2023-12-22T08:41:58.192723+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:58.192723+0000","last_undegraded":"2023-12-22T08:41:58.192723+0000","last_fullsized":"2023-12-22T08:41:58.192723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:58.192700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:58.192700+0000","last_clean_scrub_stamp":"2023-12-22T08:41:58.192700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:12.383323+0000","scrub_duration":0.0022326899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.299908+0000","last_change":"2023-12-22T08:41:51.300027+0000","last_active":"2023-12-22T08:41:51.299908+0000","last_peered":"2023-12-22T08:41:51.299908+0000","last_clean":"2023-12-22T08:41:51.299908+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:51.299908+0000","last_undegraded":"2023-12-22T08:41:51.299908+0000","last_fullsized":"2023-12-22T08:41:51.299908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-22T08:41:51.299887+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-22T08:41:51.299887+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.299887+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:43.214970+0000","scrub_duration":0.0020055799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:06.274006+0000","last_change":"2023-12-22T08:42:06.274117+0000","last_active":"2023-12-22T08:42:06.274006+0000","last_peered":"2023-12-22T08:42:06.274006+0000","last_clean":"2023-12-22T08:42:06.274006+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:42:06.274006+0000","last_undegraded":"2023-12-22T08:42:06.274006+0000","last_fullsized":"2023-12-22T08:42:06.274006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:06.273986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:06.273986+0000","last_clean_scrub_stamp":"2023-12-22T08:42:06.273986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:20.464609+0000","scrub_duration":0.0013312599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.156737+0000","last_change":"2023-12-22T08:41:50.156875+0000","last_active":"2023-12-22T08:41:50.156737+0000","last_peered":"2023-12-22T08:41:50.156737+0000","last_clean":"2023-12-22T08:41:50.156737+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:50.156737+0000","last_undegraded":"2023-12-22T08:41:50.156737+0000","last_fullsized":"2023-12-22T08:41:50.156737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:41:50.156716+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:41:50.156716+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.156716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:25.893437+0000","scrub_duration":0.001927249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802077+0000","last_change":"2023-12-22T08:41:27.128744+0000","last_active":"2023-12-22T08:41:28.802077+0000","last_peered":"2023-12-22T08:41:28.802077+0000","last_clean":"2023-12-22T08:41:28.802077+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:41:28.802077+0000","last_undegraded":"2023-12-22T08:41:28.802077+0000","last_fullsized":"2023-12-22T08:41:28.802077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.427547+0000","last_change":"2023-12-22T08:41:56.427658+0000","last_active":"2023-12-22T08:41:56.427547+0000","last_peered":"2023-12-22T08:41:56.427547+0000","last_clean":"2023-12-22T08:41:56.427547+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:56.427547+0000","last_undegraded":"2023-12-22T08:41:56.427547+0000","last_fullsized":"2023-12-22T08:41:56.427547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:56.427525+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:56.427525+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.427525+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:46.472349+0000","scrub_duration":0.001805772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:11.208353+0000","last_change":"2023-12-22T08:42:11.208471+0000","last_active":"2023-12-22T08:42:11.208353+0000","last_peered":"2023-12-22T08:42:11.208353+0000","last_clean":"2023-12-22T08:42:11.208353+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:42:11.208353+0000","last_undegraded":"2023-12-22T08:42:11.208353+0000","last_fullsized":"2023-12-22T08:42:11.208353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:11.208330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:11.208330+0000","last_clean_scrub_stamp":"2023-12-22T08:42:11.208330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:12.576724+0000","scrub_duration":0.0020785819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:43.269307+0000","last_change":"2023-12-22T08:41:43.269401+0000","last_active":"2023-12-22T08:41:43.269307+0000","last_peered":"2023-12-22T08:41:43.269307+0000","last_clean":"2023-12-22T08:41:43.269307+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:43.269307+0000","last_undegraded":"2023-12-22T08:41:43.269307+0000","last_fullsized":"2023-12-22T08:41:43.269307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:43.269287+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:43.269287+0000","last_clean_scrub_stamp":"2023-12-22T08:41:43.269287+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:58.778431+0000","scrub_duration":0.001486996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:00.299382+0000","last_change":"2023-12-22T08:42:00.299499+0000","last_active":"2023-12-22T08:42:00.299382+0000","last_peered":"2023-12-22T08:42:00.299382+0000","last_clean":"2023-12-22T08:42:00.299382+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:42:00.299382+0000","last_undegraded":"2023-12-22T08:42:00.299382+0000","last_fullsized":"2023-12-22T08:42:00.299382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.299360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.299360+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.299360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:50.344183+0000","scrub_duration":0.001476085,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:15.998974+0000","last_change":"2023-12-22T08:42:15.999104+0000","last_active":"2023-12-22T08:42:15.998974+0000","last_peered":"2023-12-22T08:42:15.998974+0000","last_clean":"2023-12-22T08:42:15.998974+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:42:15.998974+0000","last_undegraded":"2023-12-22T08:42:15.998974+0000","last_fullsized":"2023-12-22T08:42:15.998974+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:42:15.998951+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:42:15.998951+0000","last_clean_scrub_stamp":"2023-12-22T08:42:15.998951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:17.367345+0000","scrub_duration":0.0021258280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:13.520406+0000","last_change":"2023-12-22T08:42:13.520542+0000","last_active":"2023-12-22T08:42:13.520406+0000","last_peered":"2023-12-22T08:42:13.520406+0000","last_clean":"2023-12-22T08:42:13.520406+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:42:13.520406+0000","last_undegraded":"2023-12-22T08:42:13.520406+0000","last_fullsized":"2023-12-22T08:42:13.520406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:13.520383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:13.520383+0000","last_clean_scrub_stamp":"2023-12-22T08:42:13.520383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:26.643931+0000","scrub_duration":0.0018536119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:05.932870+0000","last_change":"2023-12-22T08:42:05.933007+0000","last_active":"2023-12-22T08:42:05.932870+0000","last_peered":"2023-12-22T08:42:05.932870+0000","last_clean":"2023-12-22T08:42:05.932870+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:42:05.932870+0000","last_undegraded":"2023-12-22T08:42:05.932870+0000","last_fullsized":"2023-12-22T08:42:05.932870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:42:05.932848+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:42:05.932848+0000","last_clean_scrub_stamp":"2023-12-22T08:42:05.932848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:55.977671+0000","scrub_duration":0.002003964,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:17.992428+0000","last_change":"2023-12-22T08:42:17.992538+0000","last_active":"2023-12-22T08:42:17.992428+0000","last_peered":"2023-12-22T08:42:17.992428+0000","last_clean":"2023-12-22T08:42:17.992428+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:42:17.992428+0000","last_undegraded":"2023-12-22T08:42:17.992428+0000","last_fullsized":"2023-12-22T08:42:17.992428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:17.992406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:17.992406+0000","last_clean_scrub_stamp":"2023-12-22T08:42:17.992406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:46.336628+0000","scrub_duration":0.001487527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:05.365009+0000","last_change":"2023-12-22T08:42:05.365114+0000","last_active":"2023-12-22T08:42:05.365009+0000","last_peered":"2023-12-22T08:42:05.365009+0000","last_clean":"2023-12-22T08:42:05.365009+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:42:05.365009+0000","last_undegraded":"2023-12-22T08:42:05.365009+0000","last_fullsized":"2023-12-22T08:42:05.365009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:05.364991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:05.364991+0000","last_clean_scrub_stamp":"2023-12-22T08:42:05.364991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:06.733385+0000","scrub_duration":0.0010969059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.306341+0000","last_change":"2023-12-22T08:41:57.306477+0000","last_active":"2023-12-22T08:41:57.306341+0000","last_peered":"2023-12-22T08:41:57.306341+0000","last_clean":"2023-12-22T08:41:57.306341+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:57.306341+0000","last_undegraded":"2023-12-22T08:41:57.306341+0000","last_fullsized":"2023-12-22T08:41:57.306341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.306316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.306316+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.306316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:11.496939+0000","scrub_duration":0.0017265959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:49.922113+0000","last_change":"2023-12-22T08:41:49.922221+0000","last_active":"2023-12-22T08:41:49.922113+0000","last_peered":"2023-12-22T08:41:49.922113+0000","last_clean":"2023-12-22T08:41:49.922113+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:49.922113+0000","last_undegraded":"2023-12-22T08:41:49.922113+0000","last_fullsized":"2023-12-22T08:41:49.922113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:49.922088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:49.922088+0000","last_clean_scrub_stamp":"2023-12-22T08:41:49.922088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:25.658809+0000","scrub_duration":0.0013764789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:05.596253+0000","last_change":"2023-12-22T08:42:05.596353+0000","last_active":"2023-12-22T08:42:05.596253+0000","last_peered":"2023-12-22T08:42:05.596253+0000","last_clean":"2023-12-22T08:42:05.596253+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:42:05.596253+0000","last_undegraded":"2023-12-22T08:42:05.596253+0000","last_fullsized":"2023-12-22T08:42:05.596253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:05.596231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:05.596231+0000","last_clean_scrub_stamp":"2023-12-22T08:42:05.596231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:51.304174+0000","scrub_duration":0.001640084,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.410013+0000","last_change":"2023-12-22T08:41:47.410123+0000","last_active":"2023-12-22T08:41:47.410013+0000","last_peered":"2023-12-22T08:41:47.410013+0000","last_clean":"2023-12-22T08:41:47.410013+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:47.410013+0000","last_undegraded":"2023-12-22T08:41:47.410013+0000","last_fullsized":"2023-12-22T08:41:47.410013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.409992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.409992+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.409992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:22.478066+0000","scrub_duration":0.001809291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.880773+0000","last_change":"2023-12-22T08:41:27.129547+0000","last_active":"2023-12-22T08:41:28.880773+0000","last_peered":"2023-12-22T08:41:28.880773+0000","last_clean":"2023-12-22T08:41:28.880773+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:41:28.880773+0000","last_undegraded":"2023-12-22T08:41:28.880773+0000","last_fullsized":"2023-12-22T08:41:28.880773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:49.140788+0000","last_change":"2023-12-22T08:41:49.140898+0000","last_active":"2023-12-22T08:41:49.140788+0000","last_peered":"2023-12-22T08:41:49.140788+0000","last_clean":"2023-12-22T08:41:49.140788+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:49.140788+0000","last_undegraded":"2023-12-22T08:41:49.140788+0000","last_fullsized":"2023-12-22T08:41:49.140788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:49.140767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:49.140767+0000","last_clean_scrub_stamp":"2023-12-22T08:41:49.140767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:09.673528+0000","scrub_duration":0.001512722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:10.370609+0000","last_change":"2023-12-22T08:42:10.370716+0000","last_active":"2023-12-22T08:42:10.370609+0000","last_peered":"2023-12-22T08:42:10.370609+0000","last_clean":"2023-12-22T08:42:10.370609+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:42:10.370609+0000","last_undegraded":"2023-12-22T08:42:10.370609+0000","last_fullsized":"2023-12-22T08:42:10.370609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:10.370587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:10.370587+0000","last_clean_scrub_stamp":"2023-12-22T08:42:10.370587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:13.462392+0000","scrub_duration":0.0019557609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.404090+0000","last_change":"2023-12-22T08:41:48.404235+0000","last_active":"2023-12-22T08:41:48.404090+0000","last_peered":"2023-12-22T08:41:48.404090+0000","last_clean":"2023-12-22T08:41:48.404090+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:48.404090+0000","last_undegraded":"2023-12-22T08:41:48.404090+0000","last_fullsized":"2023-12-22T08:41:48.404090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-22T08:41:48.404066+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-22T08:41:48.404066+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.404066+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:23.472141+0000","scrub_duration":0.0021286439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801936+0000","last_change":"2023-12-22T08:41:27.118227+0000","last_active":"2023-12-22T08:41:28.801936+0000","last_peered":"2023-12-22T08:41:28.801936+0000","last_clean":"2023-12-22T08:41:28.801936+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:41:28.801936+0000","last_undegraded":"2023-12-22T08:41:28.801936+0000","last_fullsized":"2023-12-22T08:41:28.801936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'11","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.358972+0000","last_change":"2023-12-22T08:41:52.359123+0000","last_active":"2023-12-22T08:41:52.358972+0000","last_peered":"2023-12-22T08:41:52.358972+0000","last_clean":"2023-12-22T08:41:52.358972+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:52.358972+0000","last_undegraded":"2023-12-22T08:41:52.358972+0000","last_fullsized":"2023-12-22T08:41:52.358972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-22T08:41:52.358921+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-22T08:41:52.358921+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.358921+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:07:26.911753+0000","scrub_duration":0.0024584440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7095,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:59.285558+0000","last_change":"2023-12-22T08:41:59.285671+0000","last_active":"2023-12-22T08:41:59.285558+0000","last_peered":"2023-12-22T08:41:59.285558+0000","last_clean":"2023-12-22T08:41:59.285558+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:59.285558+0000","last_undegraded":"2023-12-22T08:41:59.285558+0000","last_fullsized":"2023-12-22T08:41:59.285558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.285536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.285536+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.285536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:25.753471+0000","scrub_duration":0.0017918680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.886840+0000","last_change":"2023-12-22T08:41:48.886981+0000","last_active":"2023-12-22T08:41:48.886840+0000","last_peered":"2023-12-22T08:41:48.886840+0000","last_clean":"2023-12-22T08:41:48.886840+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:48.886840+0000","last_undegraded":"2023-12-22T08:41:48.886840+0000","last_fullsized":"2023-12-22T08:41:48.886840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:48.886803+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:48.886803+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.886803+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:09.419564+0000","scrub_duration":0.0021129059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:08.333054+0000","last_change":"2023-12-22T08:42:08.333177+0000","last_active":"2023-12-22T08:42:08.333054+0000","last_peered":"2023-12-22T08:42:08.333054+0000","last_clean":"2023-12-22T08:42:08.333054+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:42:08.333054+0000","last_undegraded":"2023-12-22T08:42:08.333054+0000","last_fullsized":"2023-12-22T08:42:08.333054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:08.333029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:08.333029+0000","last_clean_scrub_stamp":"2023-12-22T08:42:08.333029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:36.677252+0000","scrub_duration":0.0014875649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.305618+0000","last_change":"2023-12-22T08:41:48.305733+0000","last_active":"2023-12-22T08:41:48.305618+0000","last_peered":"2023-12-22T08:41:48.305618+0000","last_clean":"2023-12-22T08:41:48.305618+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:48.305618+0000","last_undegraded":"2023-12-22T08:41:48.305618+0000","last_fullsized":"2023-12-22T08:41:48.305618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:48.305595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:48.305595+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.305595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:24.042316+0000","scrub_duration":0.0016592250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:29.981542+0000","last_change":"2023-12-22T08:41:27.123864+0000","last_active":"2023-12-22T08:41:29.981542+0000","last_peered":"2023-12-22T08:41:29.981542+0000","last_clean":"2023-12-22T08:41:29.981542+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:41:29.981542+0000","last_undegraded":"2023-12-22T08:41:29.981542+0000","last_fullsized":"2023-12-22T08:41:29.981542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.362707+0000","last_change":"2023-12-22T08:41:50.362820+0000","last_active":"2023-12-22T08:41:50.362707+0000","last_peered":"2023-12-22T08:41:50.362707+0000","last_clean":"2023-12-22T08:41:50.362707+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:50.362707+0000","last_undegraded":"2023-12-22T08:41:50.362707+0000","last_fullsized":"2023-12-22T08:41:50.362707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:50.362682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:50.362682+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.362682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:42.575045+0000","scrub_duration":0.001768356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.246099+0000","last_change":"2023-12-22T08:42:01.246204+0000","last_active":"2023-12-22T08:42:01.246099+0000","last_peered":"2023-12-22T08:42:01.246099+0000","last_clean":"2023-12-22T08:42:01.246099+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:42:01.246099+0000","last_undegraded":"2023-12-22T08:42:01.246099+0000","last_fullsized":"2023-12-22T08:42:01.246099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:01.246078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:01.246078+0000","last_clean_scrub_stamp":"2023-12-22T08:42:01.246078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:36.314153+0000","scrub_duration":0.001295802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'12","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.427232+0000","last_change":"2023-12-22T08:42:01.427340+0000","last_active":"2023-12-22T08:42:01.427232+0000","last_peered":"2023-12-22T08:42:01.427232+0000","last_clean":"2023-12-22T08:42:01.427232+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:42:01.427232+0000","last_undegraded":"2023-12-22T08:42:01.427232+0000","last_fullsized":"2023-12-22T08:42:01.427232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2023-12-22T08:42:01.427209+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2023-12-22T08:42:01.427209+0000","last_clean_scrub_stamp":"2023-12-22T08:42:01.427209+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:47.135152+0000","scrub_duration":0.0050823769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802144+0000","last_change":"2023-12-22T08:41:27.118299+0000","last_active":"2023-12-22T08:41:28.802144+0000","last_peered":"2023-12-22T08:41:28.802144+0000","last_clean":"2023-12-22T08:41:28.802144+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:41:28.802144+0000","last_undegraded":"2023-12-22T08:41:28.802144+0000","last_fullsized":"2023-12-22T08:41:28.802144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.288363+0000","last_change":"2023-12-22T08:41:52.288478+0000","last_active":"2023-12-22T08:41:52.288363+0000","last_peered":"2023-12-22T08:41:52.288363+0000","last_clean":"2023-12-22T08:41:52.288363+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:52.288363+0000","last_undegraded":"2023-12-22T08:41:52.288363+0000","last_fullsized":"2023-12-22T08:41:52.288363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:41:52.288339+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:41:52.288339+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.288339+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:27.356414+0000","scrub_duration":0.0018746640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.802034+0000","last_change":"2023-12-22T08:41:27.122998+0000","last_active":"2023-12-22T08:41:28.802034+0000","last_peered":"2023-12-22T08:41:28.802034+0000","last_clean":"2023-12-22T08:41:28.802034+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:41:28.802034+0000","last_undegraded":"2023-12-22T08:41:28.802034+0000","last_fullsized":"2023-12-22T08:41:28.802034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.036387+0000","last_change":"2023-12-22T08:42:01.036500+0000","last_active":"2023-12-22T08:42:01.036387+0000","last_peered":"2023-12-22T08:42:01.036387+0000","last_clean":"2023-12-22T08:42:01.036387+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:42:01.036387+0000","last_undegraded":"2023-12-22T08:42:01.036387+0000","last_fullsized":"2023-12-22T08:42:01.036387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-22T08:42:01.036364+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-22T08:42:01.036364+0000","last_clean_scrub_stamp":"2023-12-22T08:42:01.036364+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:07:35.589196+0000","scrub_duration":0.00263291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:07.259310+0000","last_change":"2023-12-22T08:42:07.259425+0000","last_active":"2023-12-22T08:42:07.259310+0000","last_peered":"2023-12-22T08:42:07.259310+0000","last_clean":"2023-12-22T08:42:07.259310+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:42:07.259310+0000","last_undegraded":"2023-12-22T08:42:07.259310+0000","last_fullsized":"2023-12-22T08:42:07.259310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:07.259286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:07.259286+0000","last_clean_scrub_stamp":"2023-12-22T08:42:07.259286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:52.967229+0000","scrub_duration":0.001673316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:12.033382+0000","last_change":"2023-12-22T08:42:12.033503+0000","last_active":"2023-12-22T08:42:12.033382+0000","last_peered":"2023-12-22T08:42:12.033382+0000","last_clean":"2023-12-22T08:42:12.033382+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:42:12.033382+0000","last_undegraded":"2023-12-22T08:42:12.033382+0000","last_fullsized":"2023-12-22T08:42:12.033382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-22T08:42:12.033358+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-22T08:42:12.033358+0000","last_clean_scrub_stamp":"2023-12-22T08:42:12.033358+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:57.741301+0000","scrub_duration":0.00370273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.299499+0000","last_change":"2023-12-22T08:41:56.299604+0000","last_active":"2023-12-22T08:41:56.299499+0000","last_peered":"2023-12-22T08:41:56.299499+0000","last_clean":"2023-12-22T08:41:56.299499+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:56.299499+0000","last_undegraded":"2023-12-22T08:41:56.299499+0000","last_fullsized":"2023-12-22T08:41:56.299499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:56.299477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:56.299477+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.299477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:16.832238+0000","scrub_duration":0.0020187170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.047098+0000","last_change":"2023-12-22T08:42:02.047221+0000","last_active":"2023-12-22T08:42:02.047098+0000","last_peered":"2023-12-22T08:42:02.047098+0000","last_clean":"2023-12-22T08:42:02.047098+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:42:02.047098+0000","last_undegraded":"2023-12-22T08:42:02.047098+0000","last_fullsized":"2023-12-22T08:42:02.047098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:02.047079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:02.047079+0000","last_clean_scrub_stamp":"2023-12-22T08:42:02.047079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:28.515014+0000","scrub_duration":0.00185714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.328671+0000","last_change":"2023-12-22T08:41:46.328791+0000","last_active":"2023-12-22T08:41:46.328671+0000","last_peered":"2023-12-22T08:41:46.328671+0000","last_clean":"2023-12-22T08:41:46.328671+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:46.328671+0000","last_undegraded":"2023-12-22T08:41:46.328671+0000","last_fullsized":"2023-12-22T08:41:46.328671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:46.328640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:46.328640+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.328640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:27.039382+0000","scrub_duration":0.0018943460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.128855+0000","last_change":"2023-12-22T08:41:47.128988+0000","last_active":"2023-12-22T08:41:47.128855+0000","last_peered":"2023-12-22T08:41:47.128855+0000","last_clean":"2023-12-22T08:41:47.128855+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:47.128855+0000","last_undegraded":"2023-12-22T08:41:47.128855+0000","last_fullsized":"2023-12-22T08:41:47.128855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:47.128831+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:47.128831+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.128831+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:39.043914+0000","scrub_duration":0.001887012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.230079+0000","last_change":"2023-12-22T08:41:51.230192+0000","last_active":"2023-12-22T08:41:51.230079+0000","last_peered":"2023-12-22T08:41:51.230079+0000","last_clean":"2023-12-22T08:41:51.230079+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:51.230079+0000","last_undegraded":"2023-12-22T08:41:51.230079+0000","last_fullsized":"2023-12-22T08:41:51.230079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:51.230056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:51.230056+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.230056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:49.398115+0000","scrub_duration":0.0014622179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.263666+0000","last_change":"2023-12-22T08:41:50.263773+0000","last_active":"2023-12-22T08:41:50.263666+0000","last_peered":"2023-12-22T08:41:50.263666+0000","last_clean":"2023-12-22T08:41:50.263666+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:50.263666+0000","last_undegraded":"2023-12-22T08:41:50.263666+0000","last_fullsized":"2023-12-22T08:41:50.263666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:50.263645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:50.263645+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.263645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:32.038572+0000","scrub_duration":0.0016633489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.309344+0000","last_change":"2023-12-22T08:41:47.309453+0000","last_active":"2023-12-22T08:41:47.309344+0000","last_peered":"2023-12-22T08:41:47.309344+0000","last_clean":"2023-12-22T08:41:47.309344+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:47.309344+0000","last_undegraded":"2023-12-22T08:41:47.309344+0000","last_fullsized":"2023-12-22T08:41:47.309344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.309320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.309320+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.309320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:48.116826+0000","scrub_duration":0.00141676,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:44.798903+0000","last_change":"2023-12-22T08:41:44.799001+0000","last_active":"2023-12-22T08:41:44.798903+0000","last_peered":"2023-12-22T08:41:44.798903+0000","last_clean":"2023-12-22T08:41:44.798903+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:44.798903+0000","last_undegraded":"2023-12-22T08:41:44.798903+0000","last_fullsized":"2023-12-22T08:41:44.798903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:44.798881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:44.798881+0000","last_clean_scrub_stamp":"2023-12-22T08:41:44.798881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:26.573807+0000","scrub_duration":0.0014226130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:13.448030+0000","last_change":"2023-12-22T08:42:13.448137+0000","last_active":"2023-12-22T08:42:13.448030+0000","last_peered":"2023-12-22T08:42:13.448030+0000","last_clean":"2023-12-22T08:42:13.448030+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:42:13.448030+0000","last_undegraded":"2023-12-22T08:42:13.448030+0000","last_fullsized":"2023-12-22T08:42:13.448030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:13.448000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:13.448000+0000","last_clean_scrub_stamp":"2023-12-22T08:42:13.448000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:26.571549+0000","scrub_duration":0.0014410860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.361657+0000","last_change":"2023-12-22T08:41:47.361791+0000","last_active":"2023-12-22T08:41:47.361657+0000","last_peered":"2023-12-22T08:41:47.361657+0000","last_clean":"2023-12-22T08:41:47.361657+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:47.361657+0000","last_undegraded":"2023-12-22T08:41:47.361657+0000","last_fullsized":"2023-12-22T08:41:47.361657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.361621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.361621+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.361621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:31.087523+0000","scrub_duration":0.001395547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.276194+0000","last_change":"2023-12-22T08:41:52.276348+0000","last_active":"2023-12-22T08:41:52.276194+0000","last_peered":"2023-12-22T08:41:52.276194+0000","last_clean":"2023-12-22T08:41:52.276194+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:52.276194+0000","last_undegraded":"2023-12-22T08:41:52.276194+0000","last_fullsized":"2023-12-22T08:41:52.276194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:52.276172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:52.276172+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.276172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:34.051098+0000","scrub_duration":0.0021259880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.282069+0000","last_change":"2023-12-22T08:41:51.282206+0000","last_active":"2023-12-22T08:41:51.282069+0000","last_peered":"2023-12-22T08:41:51.282069+0000","last_clean":"2023-12-22T08:41:51.282069+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:51.282069+0000","last_undegraded":"2023-12-22T08:41:51.282069+0000","last_fullsized":"2023-12-22T08:41:51.282069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:51.282050+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:51.282050+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.282050+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:35.007952+0000","scrub_duration":0.002384714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:14.480650+0000","last_change":"2023-12-22T08:42:14.480764+0000","last_active":"2023-12-22T08:42:14.480650+0000","last_peered":"2023-12-22T08:42:14.480650+0000","last_clean":"2023-12-22T08:42:14.480650+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:42:14.480650+0000","last_undegraded":"2023-12-22T08:42:14.480650+0000","last_fullsized":"2023-12-22T08:42:14.480650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:14.480630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:14.480630+0000","last_clean_scrub_stamp":"2023-12-22T08:42:14.480630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:17.572434+0000","scrub_duration":0.001815657,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.122748+0000","last_change":"2023-12-22T08:41:46.122903+0000","last_active":"2023-12-22T08:41:46.122748+0000","last_peered":"2023-12-22T08:41:46.122748+0000","last_clean":"2023-12-22T08:41:46.122748+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:46.122748+0000","last_undegraded":"2023-12-22T08:41:46.122748+0000","last_fullsized":"2023-12-22T08:41:46.122748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-12-22T08:41:46.122706+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-12-22T08:41:46.122706+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.122706+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:27.897633+0000","scrub_duration":0.0018311670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.147837+0000","last_change":"2023-12-22T08:41:57.147966+0000","last_active":"2023-12-22T08:41:57.147837+0000","last_peered":"2023-12-22T08:41:57.147837+0000","last_clean":"2023-12-22T08:41:57.147837+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:57.147837+0000","last_undegraded":"2023-12-22T08:41:57.147837+0000","last_fullsized":"2023-12-22T08:41:57.147837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.147812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.147812+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.147812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:49.360175+0000","scrub_duration":0.0014577909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:43.414929+0000","last_change":"2023-12-22T08:41:43.415022+0000","last_active":"2023-12-22T08:41:43.414929+0000","last_peered":"2023-12-22T08:41:43.414929+0000","last_clean":"2023-12-22T08:41:43.414929+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:43.414929+0000","last_undegraded":"2023-12-22T08:41:43.414929+0000","last_fullsized":"2023-12-22T08:41:43.414929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:43.414911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:43.414911+0000","last_clean_scrub_stamp":"2023-12-22T08:41:43.414911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:25.189838+0000","scrub_duration":0.0012201849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.214421+0000","last_change":"2023-12-22T08:41:56.214556+0000","last_active":"2023-12-22T08:41:56.214421+0000","last_peered":"2023-12-22T08:41:56.214421+0000","last_clean":"2023-12-22T08:41:56.214421+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:56.214421+0000","last_undegraded":"2023-12-22T08:41:56.214421+0000","last_fullsized":"2023-12-22T08:41:56.214421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:56.214400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:56.214400+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.214400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:31.951121+0000","scrub_duration":0.0019430840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:45.114607+0000","last_change":"2023-12-22T08:41:45.114691+0000","last_active":"2023-12-22T08:41:45.114607+0000","last_peered":"2023-12-22T08:41:45.114607+0000","last_clean":"2023-12-22T08:41:45.114607+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:45.114607+0000","last_undegraded":"2023-12-22T08:41:45.114607+0000","last_fullsized":"2023-12-22T08:41:45.114607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:45.114588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:45.114588+0000","last_clean_scrub_stamp":"2023-12-22T08:41:45.114588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:43.282646+0000","scrub_duration":0.0018108930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.145172+0000","last_change":"2023-12-22T08:41:55.145289+0000","last_active":"2023-12-22T08:41:55.145172+0000","last_peered":"2023-12-22T08:41:55.145172+0000","last_clean":"2023-12-22T08:41:55.145172+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:55.145172+0000","last_undegraded":"2023-12-22T08:41:55.145172+0000","last_fullsized":"2023-12-22T08:41:55.145172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.145150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.145150+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.145150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:30.213225+0000","scrub_duration":0.0017881869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.330293+0000","last_change":"2023-12-22T08:41:47.330406+0000","last_active":"2023-12-22T08:41:47.330293+0000","last_peered":"2023-12-22T08:41:47.330293+0000","last_clean":"2023-12-22T08:41:47.330293+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:47.330293+0000","last_undegraded":"2023-12-22T08:41:47.330293+0000","last_fullsized":"2023-12-22T08:41:47.330293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.330269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.330269+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.330269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:07.863030+0000","scrub_duration":0.0019224019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:15.465432+0000","last_change":"2023-12-22T08:42:15.465543+0000","last_active":"2023-12-22T08:42:15.465432+0000","last_peered":"2023-12-22T08:42:15.465432+0000","last_clean":"2023-12-22T08:42:15.465432+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:42:15.465432+0000","last_undegraded":"2023-12-22T08:42:15.465432+0000","last_fullsized":"2023-12-22T08:42:15.465432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:15.465413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:15.465413+0000","last_clean_scrub_stamp":"2023-12-22T08:42:15.465413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:12.584297+0000","scrub_duration":0.0013329629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.023017+0000","last_change":"2023-12-22T08:41:55.023128+0000","last_active":"2023-12-22T08:41:55.023017+0000","last_peered":"2023-12-22T08:41:55.023017+0000","last_clean":"2023-12-22T08:41:55.023017+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:55.023017+0000","last_undegraded":"2023-12-22T08:41:55.023017+0000","last_fullsized":"2023-12-22T08:41:55.023017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.022997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.022997+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.022997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:30.091071+0000","scrub_duration":0.001386246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:28.801857+0000","last_change":"2023-12-22T08:41:27.131013+0000","last_active":"2023-12-22T08:41:28.801857+0000","last_peered":"2023-12-22T08:41:28.801857+0000","last_clean":"2023-12-22T08:41:28.801857+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:41:28.801857+0000","last_undegraded":"2023-12-22T08:41:28.801857+0000","last_fullsized":"2023-12-22T08:41:28.801857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:26.726325+0000","last_clean_scrub_stamp":"2023-12-22T08:41:26.726325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.364835+0000","last_change":"2023-12-22T08:41:53.364984+0000","last_active":"2023-12-22T08:41:53.364835+0000","last_peered":"2023-12-22T08:41:53.364835+0000","last_clean":"2023-12-22T08:41:53.364835+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:53.364835+0000","last_undegraded":"2023-12-22T08:41:53.364835+0000","last_fullsized":"2023-12-22T08:41:53.364835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.364814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.364814+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.364814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:19.832750+0000","scrub_duration":0.0016945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.285779+0000","last_change":"2023-12-22T08:41:55.285949+0000","last_active":"2023-12-22T08:41:55.285779+0000","last_peered":"2023-12-22T08:41:55.285779+0000","last_clean":"2023-12-22T08:41:55.285779+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:55.285779+0000","last_undegraded":"2023-12-22T08:41:55.285779+0000","last_fullsized":"2023-12-22T08:41:55.285779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.285757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.285757+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.285757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:09.476380+0000","scrub_duration":0.002040563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:44.383912+0000","last_change":"2023-12-22T08:41:44.384018+0000","last_active":"2023-12-22T08:41:44.383912+0000","last_peered":"2023-12-22T08:41:44.383912+0000","last_clean":"2023-12-22T08:41:44.383912+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:44.383912+0000","last_undegraded":"2023-12-22T08:41:44.383912+0000","last_fullsized":"2023-12-22T08:41:44.383912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:44.383888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:44.383888+0000","last_clean_scrub_stamp":"2023-12-22T08:41:44.383888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:45.191395+0000","scrub_duration":0.0013960800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.351143+0000","last_change":"2023-12-22T08:41:50.351285+0000","last_active":"2023-12-22T08:41:50.351143+0000","last_peered":"2023-12-22T08:41:50.351143+0000","last_clean":"2023-12-22T08:41:50.351143+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:50.351143+0000","last_undegraded":"2023-12-22T08:41:50.351143+0000","last_fullsized":"2023-12-22T08:41:50.351143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-12-22T08:41:50.351120+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-12-22T08:41:50.351120+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.351120+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:25.419194+0000","scrub_duration":0.0078495939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7893,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42699999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.495},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.62}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.499}]},{"osd":2,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36099999999999999}]},{"osd":5,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Dec 22 08:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.438}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.504},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.622}]},{"osd":4,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.38400000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.36399999999999999}]},{"osd":7,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.441}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.61199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":368640,"data_stored":141379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.38},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.624}]},{"osd":7,"last update":"Fri Dec 22 08:41:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.83899999999999997}]},{"osd":6,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.90700000000000003}]},{"osd":7,"last update":"Fri Dec 22 08:41:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.97199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":368640,"data_stored":141379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.378},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.432}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.316}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.50900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.5},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.627},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Dec 22 08:41:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:42:25.578 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.579 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.579 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.579 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.579 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.579 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.580 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.580 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.580 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.580 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.580 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.581 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.581 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.581 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.581 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.582 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.582 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.582 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-22T08:41:26.726325+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=26, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=8, tm_min=41, tm_sec=39, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T08:42:25.582 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-22T08:42:45.583 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T08:42:45.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.700+0000 7ff12054e640 1 Processor -- start 2023-12-22T08:42:45.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.700+0000 7ff12054e640 1 -- start start 2023-12-22T08:42:45.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff12054e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1180ba290 0x7ff11806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff12054e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff11806d770 0x7ff11814aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff12054e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11806b820 con 0x7ff11806f420 2023-12-22T08:42:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff12054e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11806de60 con 0x7ff1180ba290 2023-12-22T08:42:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff12054e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11806eac0 con 0x7ff11806d770 2023-12-22T08:42:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff11e2ea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1180ba290 0x7ff11806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff11e2ea640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1180ba290 0x7ff11806eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43116/0 (socket says 172.21.15.31:43116) 2023-12-22T08:42:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff11e2ea640 1 -- 172.21.15.31:0/1462758985 learned_addr learned my addr 172.21.15.31:0/1462758985 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:42:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff11dae9640 1 --2- 172.21.15.31:0/1462758985 >> v2:172.21.15.69:3300/0 conn(0x7ff11806d770 0x7ff11814aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff11e2ea640 1 -- 172.21.15.31:0/1462758985 >> v2:172.21.15.69:3300/0 conn(0x7ff11806d770 msgr2=0x7ff11814aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:45.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff11e2ea640 1 --2- 172.21.15.31:0/1462758985 >> v2:172.21.15.69:3300/0 conn(0x7ff11806d770 0x7ff11814aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff11e2ea640 1 -- 172.21.15.31:0/1462758985 >> v1:172.21.15.69:6789/0 conn(0x7ff11806f420 legacy=0x7ff11814e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.701+0000 7ff11e2ea640 1 -- 172.21.15.31:0/1462758985 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11806aef0 con 0x7ff1180ba290 2023-12-22T08:42:45.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.702+0000 7ff11e2ea640 1 --2- 172.21.15.31:0/1462758985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1180ba290 0x7ff11806eee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff118071f10 tx=0x7ff11402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a014030286b961 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.702+0000 7ff11d2e8640 1 -- 172.21.15.31:0/1462758985 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11402f850 con 0x7ff1180ba290 2023-12-22T08:42:45.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.702+0000 7ff11d2e8640 1 -- 172.21.15.31:0/1462758985 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11402f9b0 con 0x7ff1180ba290 2023-12-22T08:42:45.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.702+0000 7ff11d2e8640 1 -- 172.21.15.31:0/1462758985 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11402fd40 con 0x7ff1180ba290 2023-12-22T08:42:45.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.703+0000 7ff12054e640 1 -- 172.21.15.31:0/1462758985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1180ba290 msgr2=0x7ff11806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.703+0000 7ff12054e640 1 --2- 172.21.15.31:0/1462758985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1180ba290 0x7ff11806eee0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff118071f10 tx=0x7ff11402ba30 comp rx=0 tx=0).stop 2023-12-22T08:42:45.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.703+0000 7ff12054e640 1 -- 172.21.15.31:0/1462758985 shutdown_connections 2023-12-22T08:42:45.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.703+0000 7ff12054e640 1 --2- 172.21.15.31:0/1462758985 >> v2:172.21.15.69:3300/0 conn(0x7ff11806d770 0x7ff11814aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.703+0000 7ff12054e640 1 --2- 172.21.15.31:0/1462758985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1180ba290 0x7ff11806eee0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.703+0000 7ff12054e640 1 -- 172.21.15.31:0/1462758985 >> 172.21.15.31:0/1462758985 conn(0x7ff1180bac30 msgr2=0x7ff1180bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.703+0000 7ff12054e640 1 -- 172.21.15.31:0/1462758985 shutdown_connections 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.703+0000 7ff12054e640 1 -- 172.21.15.31:0/1462758985 wait complete. 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.704+0000 7ff12054e640 1 Processor -- start 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.704+0000 7ff12054e640 1 -- start start 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff12054e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11806d770 0x7ff11814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff12054e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11806f420 0x7ff1181453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff12054e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff1180ba290 0x7ff118145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff12054e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1181475e0 con 0x7ff11806f420 2023-12-22T08:42:45.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff12054e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118149c80 con 0x7ff11806d770 2023-12-22T08:42:45.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff12054e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff118147e60 con 0x7ff1180ba290 2023-12-22T08:42:45.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11dae9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11806f420 0x7ff1181453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11dae9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11806f420 0x7ff1181453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43126/0 (socket says 172.21.15.31:43126) 2023-12-22T08:42:45.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11dae9640 1 -- 172.21.15.31:0/1381678377 learned_addr learned my addr 172.21.15.31:0/1381678377 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:42:45.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11e2ea640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11806d770 0x7ff11814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11eaeb640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff1180ba290 0x7ff118145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11dae9640 1 -- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff1180ba290 msgr2=0x7ff118145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11dae9640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff1180ba290 0x7ff118145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11dae9640 1 -- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11806d770 msgr2=0x7ff11814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11dae9640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11806d770 0x7ff11814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.705+0000 7ff11dae9640 1 -- 172.21.15.31:0/1381678377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140094d0 con 0x7ff11806f420 2023-12-22T08:42:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.706+0000 7ff11dae9640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11806f420 0x7ff1181453f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff10800e8a0 tx=0x7ff10800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.706+0000 7ff10effd640 1 -- 172.21.15.31:0/1381678377 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080094f0 con 0x7ff11806f420 2023-12-22T08:42:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.706+0000 7ff10effd640 1 -- 172.21.15.31:0/1381678377 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800c940 con 0x7ff11806f420 2023-12-22T08:42:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.706+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11814e760 con 0x7ff11806f420 2023-12-22T08:42:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.706+0000 7ff10effd640 1 -- 172.21.15.31:0/1381678377 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800ccf0 con 0x7ff11806f420 2023-12-22T08:42:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.706+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff118147810 con 0x7ff11806f420 2023-12-22T08:42:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.707+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11806e5b0 con 0x7ff11806f420 2023-12-22T08:42:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.707+0000 7ff10effd640 1 -- 172.21.15.31:0/1381678377 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff108013470 con 0x7ff11806f420 2023-12-22T08:42:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.708+0000 7ff10effd640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.708+0000 7ff10effd640 1 -- 172.21.15.31:0/1381678377 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff108088950 con 0x7ff11806f420 2023-12-22T08:42:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.708+0000 7ff11e2ea640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.709+0000 7ff11e2ea640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff114036000 tx=0x7ff114008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.712+0000 7ff10effd640 1 -- 172.21.15.31:0/1381678377 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff108053f60 con 0x7ff11806f420 2023-12-22T08:42:45.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.885+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 --> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff11806b1d0 con 0x7ff0fc06a430 2023-12-22T08:42:45.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.893+0000 7ff10effd640 1 -- 172.21.15.31:0/1381678377 <== mgr.4103 v2:172.21.15.69:6832/119711 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291201 (secure 0 0 0) 0x7ff11402fb20 con 0x7ff0fc06a430 2023-12-22T08:42:45.899 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:42:45.901 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-12-22T08:42:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0fc06a430 msgr2=0x7ff0fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff114036000 tx=0x7ff114008030 comp rx=0 tx=0).stop 2023-12-22T08:42:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11806f420 msgr2=0x7ff1181453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11806f420 0x7ff1181453f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff10800e8a0 tx=0x7ff10800ed60 comp rx=0 tx=0).stop 2023-12-22T08:42:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 shutdown_connections 2023-12-22T08:42:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff1180ba290 0x7ff118145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff11806f420 0x7ff1181453f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 --2- 172.21.15.31:0/1381678377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff11806d770 0x7ff11814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:45.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 >> 172.21.15.31:0/1381678377 conn(0x7ff1180bac30 msgr2=0x7ff1180a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:45.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 shutdown_connections 2023-12-22T08:42:45.904 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:45.896+0000 7ff12054e640 1 -- 172.21.15.31:0/1381678377 wait complete. 2023-12-22T08:42:45.909 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-12-22T08:42:45.812719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598261,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":169,"ondisk_log_size":169,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3952,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":4046848,"data_stored":2270618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003138"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:11.223778+0000","last_change":"2023-12-22T08:42:11.223920+0000","last_active":"2023-12-22T08:42:11.223778+0000","last_peered":"2023-12-22T08:42:11.223778+0000","last_clean":"2023-12-22T08:42:11.223778+0000","last_became_active":"2023-12-22T08:41:27.129647+0000","last_became_peered":"2023-12-22T08:41:27.129647+0000","last_unstale":"2023-12-22T08:42:11.223778+0000","last_undegraded":"2023-12-22T08:42:11.223778+0000","last_fullsized":"2023-12-22T08:42:11.223778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:11.223740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:11.223740+0000","last_clean_scrub_stamp":"2023-12-22T08:42:11.223740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:10:01.268563+0000","scrub_duration":0.001367285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:26.520994+0000","last_change":"2023-12-22T08:42:26.521121+0000","last_active":"2023-12-22T08:42:26.520994+0000","last_peered":"2023-12-22T08:42:26.520994+0000","last_clean":"2023-12-22T08:42:26.520994+0000","last_became_active":"2023-12-22T08:41:27.131757+0000","last_became_peered":"2023-12-22T08:41:27.131757+0000","last_unstale":"2023-12-22T08:42:26.520994+0000","last_undegraded":"2023-12-22T08:42:26.520994+0000","last_fullsized":"2023-12-22T08:42:26.520994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:26.520968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:26.520968+0000","last_clean_scrub_stamp":"2023-12-22T08:42:26.520968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:45:27.934545+0000","scrub_duration":0.001399406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:19.431664+0000","last_change":"2023-12-22T08:42:19.431772+0000","last_active":"2023-12-22T08:42:19.431664+0000","last_peered":"2023-12-22T08:42:19.431664+0000","last_clean":"2023-12-22T08:42:19.431664+0000","last_became_active":"2023-12-22T08:41:27.117345+0000","last_became_peered":"2023-12-22T08:41:27.117345+0000","last_unstale":"2023-12-22T08:42:19.431664+0000","last_undegraded":"2023-12-22T08:42:19.431664+0000","last_fullsized":"2023-12-22T08:42:19.431664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:19.431644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:19.431644+0000","last_clean_scrub_stamp":"2023-12-22T08:42:19.431644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:16.550528+0000","scrub_duration":0.0016878520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:14.199400+0000","last_change":"2023-12-22T08:42:14.199510+0000","last_active":"2023-12-22T08:42:14.199400+0000","last_peered":"2023-12-22T08:42:14.199400+0000","last_clean":"2023-12-22T08:42:14.199400+0000","last_became_active":"2023-12-22T08:41:27.126054+0000","last_became_peered":"2023-12-22T08:41:27.126054+0000","last_unstale":"2023-12-22T08:42:14.199400+0000","last_undegraded":"2023-12-22T08:42:14.199400+0000","last_fullsized":"2023-12-22T08:42:14.199400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:14.199377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:14.199377+0000","last_clean_scrub_stamp":"2023-12-22T08:42:14.199377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:42.543599+0000","scrub_duration":0.001571607,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.378014+0000","last_change":"2023-12-22T08:42:02.378129+0000","last_active":"2023-12-22T08:42:02.378014+0000","last_peered":"2023-12-22T08:42:02.378014+0000","last_clean":"2023-12-22T08:42:02.378014+0000","last_became_active":"2023-12-22T08:41:27.131159+0000","last_became_peered":"2023-12-22T08:41:27.131159+0000","last_unstale":"2023-12-22T08:42:02.378014+0000","last_undegraded":"2023-12-22T08:42:02.378014+0000","last_fullsized":"2023-12-22T08:42:02.378014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:02.377992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:02.377992+0000","last_clean_scrub_stamp":"2023-12-22T08:42:02.377992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:37.446067+0000","scrub_duration":0.001435946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:22.468592+0000","last_change":"2023-12-22T08:42:22.468752+0000","last_active":"2023-12-22T08:42:22.468592+0000","last_peered":"2023-12-22T08:42:22.468592+0000","last_clean":"2023-12-22T08:42:22.468592+0000","last_became_active":"2023-12-22T08:41:27.125208+0000","last_became_peered":"2023-12-22T08:41:27.125208+0000","last_unstale":"2023-12-22T08:42:22.468592+0000","last_undegraded":"2023-12-22T08:42:22.468592+0000","last_fullsized":"2023-12-22T08:42:22.468592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:22.468571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:22.468571+0000","last_clean_scrub_stamp":"2023-12-22T08:42:22.468571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:40:15.558381+0000","scrub_duration":0.0019722720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:05.422750+0000","last_change":"2023-12-22T08:42:05.422865+0000","last_active":"2023-12-22T08:42:05.422750+0000","last_peered":"2023-12-22T08:42:05.422750+0000","last_clean":"2023-12-22T08:42:05.422750+0000","last_became_active":"2023-12-22T08:41:27.127682+0000","last_became_peered":"2023-12-22T08:41:27.127682+0000","last_unstale":"2023-12-22T08:42:05.422750+0000","last_undegraded":"2023-12-22T08:42:05.422750+0000","last_fullsized":"2023-12-22T08:42:05.422750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:05.422725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:05.422725+0000","last_clean_scrub_stamp":"2023-12-22T08:42:05.422725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:51.130668+0000","scrub_duration":0.0014389050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:26.314896+0000","last_change":"2023-12-22T08:42:26.315010+0000","last_active":"2023-12-22T08:42:26.314896+0000","last_peered":"2023-12-22T08:42:26.314896+0000","last_clean":"2023-12-22T08:42:26.314896+0000","last_became_active":"2023-12-22T08:41:27.128172+0000","last_became_peered":"2023-12-22T08:41:27.128172+0000","last_unstale":"2023-12-22T08:42:26.314896+0000","last_undegraded":"2023-12-22T08:42:26.314896+0000","last_fullsized":"2023-12-22T08:42:26.314896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:26.314858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:26.314858+0000","last_clean_scrub_stamp":"2023-12-22T08:42:26.314858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:40:19.404668+0000","scrub_duration":0.0016834619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:26.094646+0000","last_change":"2023-12-22T08:42:26.094804+0000","last_active":"2023-12-22T08:42:26.094646+0000","last_peered":"2023-12-22T08:42:26.094646+0000","last_clean":"2023-12-22T08:42:26.094646+0000","last_became_active":"2023-12-22T08:41:27.115728+0000","last_became_peered":"2023-12-22T08:41:27.115728+0000","last_unstale":"2023-12-22T08:42:26.094646+0000","last_undegraded":"2023-12-22T08:42:26.094646+0000","last_fullsized":"2023-12-22T08:42:26.094646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:26.094611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:26.094611+0000","last_clean_scrub_stamp":"2023-12-22T08:42:26.094611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:23.213495+0000","scrub_duration":0.0019182380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:16.265973+0000","last_change":"2023-12-22T08:42:16.266099+0000","last_active":"2023-12-22T08:42:16.265973+0000","last_peered":"2023-12-22T08:42:16.265973+0000","last_clean":"2023-12-22T08:42:16.265973+0000","last_became_active":"2023-12-22T08:41:27.133448+0000","last_became_peered":"2023-12-22T08:41:27.133448+0000","last_unstale":"2023-12-22T08:42:16.265973+0000","last_undegraded":"2023-12-22T08:42:16.265973+0000","last_fullsized":"2023-12-22T08:42:16.265973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:16.265936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:16.265936+0000","last_clean_scrub_stamp":"2023-12-22T08:42:16.265936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:19.357741+0000","scrub_duration":0.001699812,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:09.400698+0000","last_change":"2023-12-22T08:42:09.400812+0000","last_active":"2023-12-22T08:42:09.400698+0000","last_peered":"2023-12-22T08:42:09.400698+0000","last_clean":"2023-12-22T08:42:09.400698+0000","last_became_active":"2023-12-22T08:41:27.121128+0000","last_became_peered":"2023-12-22T08:41:27.121128+0000","last_unstale":"2023-12-22T08:42:09.400698+0000","last_undegraded":"2023-12-22T08:42:09.400698+0000","last_fullsized":"2023-12-22T08:42:09.400698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:09.400677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:09.400677+0000","last_clean_scrub_stamp":"2023-12-22T08:42:09.400677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:10.769071+0000","scrub_duration":0.0018771250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:12.545179+0000","last_change":"2023-12-22T08:42:12.545295+0000","last_active":"2023-12-22T08:42:12.545179+0000","last_peered":"2023-12-22T08:42:12.545179+0000","last_clean":"2023-12-22T08:42:12.545179+0000","last_became_active":"2023-12-22T08:41:27.131754+0000","last_became_peered":"2023-12-22T08:41:27.131754+0000","last_unstale":"2023-12-22T08:42:12.545179+0000","last_undegraded":"2023-12-22T08:42:12.545179+0000","last_fullsized":"2023-12-22T08:42:12.545179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:12.545159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:12.545159+0000","last_clean_scrub_stamp":"2023-12-22T08:42:12.545159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:40.889382+0000","scrub_duration":0.0018251529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.291070+0000","last_change":"2023-12-22T08:41:53.291188+0000","last_active":"2023-12-22T08:41:53.291070+0000","last_peered":"2023-12-22T08:41:53.291070+0000","last_clean":"2023-12-22T08:41:53.291070+0000","last_became_active":"2023-12-22T08:41:27.120483+0000","last_became_peered":"2023-12-22T08:41:27.120483+0000","last_unstale":"2023-12-22T08:41:53.291070+0000","last_undegraded":"2023-12-22T08:41:53.291070+0000","last_fullsized":"2023-12-22T08:41:53.291070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.291048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.291048+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.291048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:45.206131+0000","scrub_duration":0.001535675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.392095+0000","last_change":"2023-12-22T08:41:46.392219+0000","last_active":"2023-12-22T08:41:46.392095+0000","last_peered":"2023-12-22T08:41:46.392095+0000","last_clean":"2023-12-22T08:41:46.392095+0000","last_became_active":"2023-12-22T08:41:27.127081+0000","last_became_peered":"2023-12-22T08:41:27.127081+0000","last_unstale":"2023-12-22T08:41:46.392095+0000","last_undegraded":"2023-12-22T08:41:46.392095+0000","last_fullsized":"2023-12-22T08:41:46.392095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:46.392071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:46.392071+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.392071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:30.117973+0000","scrub_duration":0.00134274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.425993+0000","last_change":"2023-12-22T08:41:53.426136+0000","last_active":"2023-12-22T08:41:53.425993+0000","last_peered":"2023-12-22T08:41:53.425993+0000","last_clean":"2023-12-22T08:41:53.425993+0000","last_became_active":"2023-12-22T08:41:27.123994+0000","last_became_peered":"2023-12-22T08:41:27.123994+0000","last_unstale":"2023-12-22T08:41:53.425993+0000","last_undegraded":"2023-12-22T08:41:53.425993+0000","last_fullsized":"2023-12-22T08:41:53.425993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.425974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.425974+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.425974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:07.616597+0000","scrub_duration":0.0013887210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:12.398366+0000","last_change":"2023-12-22T08:42:12.398500+0000","last_active":"2023-12-22T08:42:12.398366+0000","last_peered":"2023-12-22T08:42:12.398366+0000","last_clean":"2023-12-22T08:42:12.398366+0000","last_became_active":"2023-12-22T08:41:27.131665+0000","last_became_peered":"2023-12-22T08:41:27.131665+0000","last_unstale":"2023-12-22T08:42:12.398366+0000","last_undegraded":"2023-12-22T08:42:12.398366+0000","last_fullsized":"2023-12-22T08:42:12.398366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:12.398346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:12.398346+0000","last_clean_scrub_stamp":"2023-12-22T08:42:12.398346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:40.742568+0000","scrub_duration":0.0019663440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.314989+0000","last_change":"2023-12-22T08:41:57.315100+0000","last_active":"2023-12-22T08:41:57.314989+0000","last_peered":"2023-12-22T08:41:57.314989+0000","last_clean":"2023-12-22T08:41:57.314989+0000","last_became_active":"2023-12-22T08:41:27.126509+0000","last_became_peered":"2023-12-22T08:41:27.126509+0000","last_unstale":"2023-12-22T08:41:57.314989+0000","last_undegraded":"2023-12-22T08:41:57.314989+0000","last_fullsized":"2023-12-22T08:41:57.314989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.314966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.314966+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.314966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:23.782901+0000","scrub_duration":0.0013435879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:24.540084+0000","last_change":"2023-12-22T08:42:24.540207+0000","last_active":"2023-12-22T08:42:24.540084+0000","last_peered":"2023-12-22T08:42:24.540084+0000","last_clean":"2023-12-22T08:42:24.540084+0000","last_became_active":"2023-12-22T08:41:27.131443+0000","last_became_peered":"2023-12-22T08:41:27.131443+0000","last_unstale":"2023-12-22T08:42:24.540084+0000","last_undegraded":"2023-12-22T08:42:24.540084+0000","last_fullsized":"2023-12-22T08:42:24.540084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:24.540062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:24.540062+0000","last_clean_scrub_stamp":"2023-12-22T08:42:24.540062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:25:59.097623+0000","scrub_duration":0.0014866289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:09.364502+0000","last_change":"2023-12-22T08:42:09.364634+0000","last_active":"2023-12-22T08:42:09.364502+0000","last_peered":"2023-12-22T08:42:09.364502+0000","last_clean":"2023-12-22T08:42:09.364502+0000","last_became_active":"2023-12-22T08:41:27.127227+0000","last_became_peered":"2023-12-22T08:41:27.127227+0000","last_unstale":"2023-12-22T08:42:09.364502+0000","last_undegraded":"2023-12-22T08:42:09.364502+0000","last_fullsized":"2023-12-22T08:42:09.364502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:09.364480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:09.364480+0000","last_clean_scrub_stamp":"2023-12-22T08:42:09.364480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:22.488029+0000","scrub_duration":0.0014474620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.339033+0000","last_change":"2023-12-22T08:41:57.339144+0000","last_active":"2023-12-22T08:41:57.339033+0000","last_peered":"2023-12-22T08:41:57.339033+0000","last_clean":"2023-12-22T08:41:57.339033+0000","last_became_active":"2023-12-22T08:41:27.124450+0000","last_became_peered":"2023-12-22T08:41:27.124450+0000","last_unstale":"2023-12-22T08:41:57.339033+0000","last_undegraded":"2023-12-22T08:41:57.339033+0000","last_fullsized":"2023-12-22T08:41:57.339033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.339013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.339013+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.339013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:33.075734+0000","scrub_duration":0.0019016250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:34.187333+0000","last_change":"2023-12-22T08:42:34.187436+0000","last_active":"2023-12-22T08:42:34.187333+0000","last_peered":"2023-12-22T08:42:34.187333+0000","last_clean":"2023-12-22T08:42:34.187333+0000","last_became_active":"2023-12-22T08:41:27.120621+0000","last_became_peered":"2023-12-22T08:41:27.120621+0000","last_unstale":"2023-12-22T08:42:34.187333+0000","last_undegraded":"2023-12-22T08:42:34.187333+0000","last_fullsized":"2023-12-22T08:42:34.187333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:34.187310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:34.187310+0000","last_clean_scrub_stamp":"2023-12-22T08:42:34.187310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:26:08.744871+0000","scrub_duration":0.0017133719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:22.128075+0000","last_change":"2023-12-22T08:42:22.128183+0000","last_active":"2023-12-22T08:42:22.128075+0000","last_peered":"2023-12-22T08:42:22.128075+0000","last_clean":"2023-12-22T08:42:22.128075+0000","last_became_active":"2023-12-22T08:41:27.129059+0000","last_became_peered":"2023-12-22T08:41:27.129059+0000","last_unstale":"2023-12-22T08:42:22.128075+0000","last_undegraded":"2023-12-22T08:42:22.128075+0000","last_fullsized":"2023-12-22T08:42:22.128075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:22.128053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:22.128053+0000","last_clean_scrub_stamp":"2023-12-22T08:42:22.128053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:25.219857+0000","scrub_duration":0.001933225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:59.181028+0000","last_change":"2023-12-22T08:41:59.181163+0000","last_active":"2023-12-22T08:41:59.181028+0000","last_peered":"2023-12-22T08:41:59.181028+0000","last_clean":"2023-12-22T08:41:59.181028+0000","last_became_active":"2023-12-22T08:41:27.123570+0000","last_became_peered":"2023-12-22T08:41:27.123570+0000","last_unstale":"2023-12-22T08:41:59.181028+0000","last_undegraded":"2023-12-22T08:41:59.181028+0000","last_fullsized":"2023-12-22T08:41:59.181028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.181005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.181005+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.181005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:56:27.331411+0000","scrub_duration":0.0021759510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:09.543105+0000","last_change":"2023-12-22T08:42:09.543228+0000","last_active":"2023-12-22T08:42:09.543105+0000","last_peered":"2023-12-22T08:42:09.543105+0000","last_clean":"2023-12-22T08:42:09.543105+0000","last_became_active":"2023-12-22T08:41:27.114360+0000","last_became_peered":"2023-12-22T08:41:27.114360+0000","last_unstale":"2023-12-22T08:42:09.543105+0000","last_undegraded":"2023-12-22T08:42:09.543105+0000","last_fullsized":"2023-12-22T08:42:09.543105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:09.543087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:09.543087+0000","last_clean_scrub_stamp":"2023-12-22T08:42:09.543087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:10.911481+0000","scrub_duration":0.001879384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.223139+0000","last_change":"2023-12-22T08:42:02.223246+0000","last_active":"2023-12-22T08:42:02.223139+0000","last_peered":"2023-12-22T08:42:02.223139+0000","last_clean":"2023-12-22T08:42:02.223139+0000","last_became_active":"2023-12-22T08:41:27.121363+0000","last_became_peered":"2023-12-22T08:41:27.121363+0000","last_unstale":"2023-12-22T08:42:02.223139+0000","last_undegraded":"2023-12-22T08:42:02.223139+0000","last_fullsized":"2023-12-22T08:42:02.223139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:02.223117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:02.223117+0000","last_clean_scrub_stamp":"2023-12-22T08:42:02.223117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:52.267940+0000","scrub_duration":0.0015338839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:23.513884+0000","last_change":"2023-12-22T08:42:23.514020+0000","last_active":"2023-12-22T08:42:23.513884+0000","last_peered":"2023-12-22T08:42:23.513884+0000","last_clean":"2023-12-22T08:42:23.513884+0000","last_became_active":"2023-12-22T08:41:27.130454+0000","last_became_peered":"2023-12-22T08:41:27.130454+0000","last_unstale":"2023-12-22T08:42:23.513884+0000","last_undegraded":"2023-12-22T08:42:23.513884+0000","last_fullsized":"2023-12-22T08:42:23.513884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:23.513857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:23.513857+0000","last_clean_scrub_stamp":"2023-12-22T08:42:23.513857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:44.947870+0000","scrub_duration":0.001889691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:15.220962+0000","last_change":"2023-12-22T08:42:15.221070+0000","last_active":"2023-12-22T08:42:15.220962+0000","last_peered":"2023-12-22T08:42:15.220962+0000","last_clean":"2023-12-22T08:42:15.220962+0000","last_became_active":"2023-12-22T08:41:27.121081+0000","last_became_peered":"2023-12-22T08:41:27.121081+0000","last_unstale":"2023-12-22T08:42:15.220962+0000","last_undegraded":"2023-12-22T08:42:15.220962+0000","last_fullsized":"2023-12-22T08:42:15.220962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:15.220930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:15.220930+0000","last_clean_scrub_stamp":"2023-12-22T08:42:15.220930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:28.344479+0000","scrub_duration":0.0021046849999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.466297+0000","last_change":"2023-12-22T08:41:55.466394+0000","last_active":"2023-12-22T08:41:55.466297+0000","last_peered":"2023-12-22T08:41:55.466297+0000","last_clean":"2023-12-22T08:41:55.466297+0000","last_became_active":"2023-12-22T08:41:27.116903+0000","last_became_peered":"2023-12-22T08:41:27.116903+0000","last_unstale":"2023-12-22T08:41:55.466297+0000","last_undegraded":"2023-12-22T08:41:55.466297+0000","last_fullsized":"2023-12-22T08:41:55.466297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.466276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.466276+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.466276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:21.934211+0000","scrub_duration":0.001825491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:30.120957+0000","last_change":"2023-12-22T08:42:30.121084+0000","last_active":"2023-12-22T08:42:30.120957+0000","last_peered":"2023-12-22T08:42:30.120957+0000","last_clean":"2023-12-22T08:42:30.120957+0000","last_became_active":"2023-12-22T08:41:27.128507+0000","last_became_peered":"2023-12-22T08:41:27.128507+0000","last_unstale":"2023-12-22T08:42:30.120957+0000","last_undegraded":"2023-12-22T08:42:30.120957+0000","last_fullsized":"2023-12-22T08:42:30.120957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:30.120933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:30.120933+0000","last_clean_scrub_stamp":"2023-12-22T08:42:30.120933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:21:02.125277+0000","scrub_duration":0.0019839609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:14.468468+0000","last_change":"2023-12-22T08:42:14.468583+0000","last_active":"2023-12-22T08:42:14.468468+0000","last_peered":"2023-12-22T08:42:14.468468+0000","last_clean":"2023-12-22T08:42:14.468468+0000","last_became_active":"2023-12-22T08:41:27.125859+0000","last_became_peered":"2023-12-22T08:41:27.125859+0000","last_unstale":"2023-12-22T08:42:14.468468+0000","last_undegraded":"2023-12-22T08:42:14.468468+0000","last_fullsized":"2023-12-22T08:42:14.468468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:14.468446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:14.468446+0000","last_clean_scrub_stamp":"2023-12-22T08:42:14.468446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:17.560251+0000","scrub_duration":0.0014294589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:08.224457+0000","last_change":"2023-12-22T08:42:08.224561+0000","last_active":"2023-12-22T08:42:08.224457+0000","last_peered":"2023-12-22T08:42:08.224457+0000","last_clean":"2023-12-22T08:42:08.224457+0000","last_became_active":"2023-12-22T08:41:27.127289+0000","last_became_peered":"2023-12-22T08:41:27.127289+0000","last_unstale":"2023-12-22T08:42:08.224457+0000","last_undegraded":"2023-12-22T08:42:08.224457+0000","last_fullsized":"2023-12-22T08:42:08.224457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:08.224435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:08.224435+0000","last_clean_scrub_stamp":"2023-12-22T08:42:08.224435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:34.692370+0000","scrub_duration":0.0015900809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:23.391399+0000","last_change":"2023-12-22T08:42:23.391523+0000","last_active":"2023-12-22T08:42:23.391399+0000","last_peered":"2023-12-22T08:42:23.391399+0000","last_clean":"2023-12-22T08:42:23.391399+0000","last_became_active":"2023-12-22T08:41:27.122606+0000","last_became_peered":"2023-12-22T08:41:27.122606+0000","last_unstale":"2023-12-22T08:42:23.391399+0000","last_undegraded":"2023-12-22T08:42:23.391399+0000","last_fullsized":"2023-12-22T08:42:23.391399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:23.391379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:23.391379+0000","last_clean_scrub_stamp":"2023-12-22T08:42:23.391379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:30.284180+0000","scrub_duration":0.0012532649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:58.192723+0000","last_change":"2023-12-22T08:41:58.192870+0000","last_active":"2023-12-22T08:41:58.192723+0000","last_peered":"2023-12-22T08:41:58.192723+0000","last_clean":"2023-12-22T08:41:58.192723+0000","last_became_active":"2023-12-22T08:41:27.121475+0000","last_became_peered":"2023-12-22T08:41:27.121475+0000","last_unstale":"2023-12-22T08:41:58.192723+0000","last_undegraded":"2023-12-22T08:41:58.192723+0000","last_fullsized":"2023-12-22T08:41:58.192723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:58.192700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:58.192700+0000","last_clean_scrub_stamp":"2023-12-22T08:41:58.192700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:12.383323+0000","scrub_duration":0.0022326899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.299908+0000","last_change":"2023-12-22T08:41:51.300027+0000","last_active":"2023-12-22T08:41:51.299908+0000","last_peered":"2023-12-22T08:41:51.299908+0000","last_clean":"2023-12-22T08:41:51.299908+0000","last_became_active":"2023-12-22T08:41:26.742567+0000","last_became_peered":"2023-12-22T08:41:26.742567+0000","last_unstale":"2023-12-22T08:41:51.299908+0000","last_undegraded":"2023-12-22T08:41:51.299908+0000","last_fullsized":"2023-12-22T08:41:51.299908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-12-22T08:41:51.299887+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-12-22T08:41:51.299887+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.299887+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:43.214970+0000","scrub_duration":0.0020055799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:06.274006+0000","last_change":"2023-12-22T08:42:06.274117+0000","last_active":"2023-12-22T08:42:06.274006+0000","last_peered":"2023-12-22T08:42:06.274006+0000","last_clean":"2023-12-22T08:42:06.274006+0000","last_became_active":"2023-12-22T08:41:27.130231+0000","last_became_peered":"2023-12-22T08:41:27.130231+0000","last_unstale":"2023-12-22T08:42:06.274006+0000","last_undegraded":"2023-12-22T08:42:06.274006+0000","last_fullsized":"2023-12-22T08:42:06.274006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:06.273986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:06.273986+0000","last_clean_scrub_stamp":"2023-12-22T08:42:06.273986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:20.464609+0000","scrub_duration":0.0013312599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.156737+0000","last_change":"2023-12-22T08:41:50.156875+0000","last_active":"2023-12-22T08:41:50.156737+0000","last_peered":"2023-12-22T08:41:50.156737+0000","last_clean":"2023-12-22T08:41:50.156737+0000","last_became_active":"2023-12-22T08:41:26.742897+0000","last_became_peered":"2023-12-22T08:41:26.742897+0000","last_unstale":"2023-12-22T08:41:50.156737+0000","last_undegraded":"2023-12-22T08:41:50.156737+0000","last_fullsized":"2023-12-22T08:41:50.156737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:41:50.156716+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:41:50.156716+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.156716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:25.893437+0000","scrub_duration":0.001927249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:32.116893+0000","last_change":"2023-12-22T08:42:32.117006+0000","last_active":"2023-12-22T08:42:32.116893+0000","last_peered":"2023-12-22T08:42:32.116893+0000","last_clean":"2023-12-22T08:42:32.116893+0000","last_became_active":"2023-12-22T08:41:27.128472+0000","last_became_peered":"2023-12-22T08:41:27.128472+0000","last_unstale":"2023-12-22T08:42:32.116893+0000","last_undegraded":"2023-12-22T08:42:32.116893+0000","last_fullsized":"2023-12-22T08:42:32.116893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:32.116873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:32.116873+0000","last_clean_scrub_stamp":"2023-12-22T08:42:32.116873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:40:25.206683+0000","scrub_duration":0.0018831010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.427547+0000","last_change":"2023-12-22T08:41:56.427658+0000","last_active":"2023-12-22T08:41:56.427547+0000","last_peered":"2023-12-22T08:41:56.427547+0000","last_clean":"2023-12-22T08:41:56.427547+0000","last_became_active":"2023-12-22T08:41:26.747066+0000","last_became_peered":"2023-12-22T08:41:26.747066+0000","last_unstale":"2023-12-22T08:41:56.427547+0000","last_undegraded":"2023-12-22T08:41:56.427547+0000","last_fullsized":"2023-12-22T08:41:56.427547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:56.427525+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:56.427525+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.427525+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:46.472349+0000","scrub_duration":0.001805772,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:11.208353+0000","last_change":"2023-12-22T08:42:11.208471+0000","last_active":"2023-12-22T08:42:11.208353+0000","last_peered":"2023-12-22T08:42:11.208353+0000","last_clean":"2023-12-22T08:42:11.208353+0000","last_became_active":"2023-12-22T08:41:27.120798+0000","last_became_peered":"2023-12-22T08:41:27.120798+0000","last_unstale":"2023-12-22T08:42:11.208353+0000","last_undegraded":"2023-12-22T08:42:11.208353+0000","last_fullsized":"2023-12-22T08:42:11.208353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:11.208330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:11.208330+0000","last_clean_scrub_stamp":"2023-12-22T08:42:11.208330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:12.576724+0000","scrub_duration":0.0020785819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:43.269307+0000","last_change":"2023-12-22T08:41:43.269401+0000","last_active":"2023-12-22T08:41:43.269307+0000","last_peered":"2023-12-22T08:41:43.269307+0000","last_clean":"2023-12-22T08:41:43.269307+0000","last_became_active":"2023-12-22T08:41:26.746964+0000","last_became_peered":"2023-12-22T08:41:26.746964+0000","last_unstale":"2023-12-22T08:41:43.269307+0000","last_undegraded":"2023-12-22T08:41:43.269307+0000","last_fullsized":"2023-12-22T08:41:43.269307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:43.269287+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:43.269287+0000","last_clean_scrub_stamp":"2023-12-22T08:41:43.269287+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:26:58.778431+0000","scrub_duration":0.001486996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:00.299382+0000","last_change":"2023-12-22T08:42:00.299499+0000","last_active":"2023-12-22T08:42:00.299382+0000","last_peered":"2023-12-22T08:42:00.299382+0000","last_clean":"2023-12-22T08:42:00.299382+0000","last_became_active":"2023-12-22T08:41:27.123301+0000","last_became_peered":"2023-12-22T08:41:27.123301+0000","last_unstale":"2023-12-22T08:42:00.299382+0000","last_undegraded":"2023-12-22T08:42:00.299382+0000","last_fullsized":"2023-12-22T08:42:00.299382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:00.299360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:00.299360+0000","last_clean_scrub_stamp":"2023-12-22T08:42:00.299360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:50.344183+0000","scrub_duration":0.001476085,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:15.998974+0000","last_change":"2023-12-22T08:42:15.999104+0000","last_active":"2023-12-22T08:42:15.998974+0000","last_peered":"2023-12-22T08:42:15.998974+0000","last_clean":"2023-12-22T08:42:15.998974+0000","last_became_active":"2023-12-22T08:41:26.749842+0000","last_became_peered":"2023-12-22T08:41:26.749842+0000","last_unstale":"2023-12-22T08:42:15.998974+0000","last_undegraded":"2023-12-22T08:42:15.998974+0000","last_fullsized":"2023-12-22T08:42:15.998974+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:42:15.998951+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:42:15.998951+0000","last_clean_scrub_stamp":"2023-12-22T08:42:15.998951+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:17.367345+0000","scrub_duration":0.0021258280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:13.520406+0000","last_change":"2023-12-22T08:42:13.520542+0000","last_active":"2023-12-22T08:42:13.520406+0000","last_peered":"2023-12-22T08:42:13.520406+0000","last_clean":"2023-12-22T08:42:13.520406+0000","last_became_active":"2023-12-22T08:41:27.125171+0000","last_became_peered":"2023-12-22T08:41:27.125171+0000","last_unstale":"2023-12-22T08:42:13.520406+0000","last_undegraded":"2023-12-22T08:42:13.520406+0000","last_fullsized":"2023-12-22T08:42:13.520406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:13.520383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:13.520383+0000","last_clean_scrub_stamp":"2023-12-22T08:42:13.520383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:26.643931+0000","scrub_duration":0.0018536119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:05.932870+0000","last_change":"2023-12-22T08:42:05.933007+0000","last_active":"2023-12-22T08:42:05.932870+0000","last_peered":"2023-12-22T08:42:05.932870+0000","last_clean":"2023-12-22T08:42:05.932870+0000","last_became_active":"2023-12-22T08:41:26.743192+0000","last_became_peered":"2023-12-22T08:41:26.743192+0000","last_unstale":"2023-12-22T08:42:05.932870+0000","last_undegraded":"2023-12-22T08:42:05.932870+0000","last_fullsized":"2023-12-22T08:42:05.932870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:42:05.932848+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:42:05.932848+0000","last_clean_scrub_stamp":"2023-12-22T08:42:05.932848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:09:55.977671+0000","scrub_duration":0.002003964,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:17.992428+0000","last_change":"2023-12-22T08:42:17.992538+0000","last_active":"2023-12-22T08:42:17.992428+0000","last_peered":"2023-12-22T08:42:17.992428+0000","last_clean":"2023-12-22T08:42:17.992428+0000","last_became_active":"2023-12-22T08:41:27.123670+0000","last_became_peered":"2023-12-22T08:41:27.123670+0000","last_unstale":"2023-12-22T08:42:17.992428+0000","last_undegraded":"2023-12-22T08:42:17.992428+0000","last_fullsized":"2023-12-22T08:42:17.992428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:17.992406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:17.992406+0000","last_clean_scrub_stamp":"2023-12-22T08:42:17.992406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:46.336628+0000","scrub_duration":0.001487527,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:05.365009+0000","last_change":"2023-12-22T08:42:05.365114+0000","last_active":"2023-12-22T08:42:05.365009+0000","last_peered":"2023-12-22T08:42:05.365009+0000","last_clean":"2023-12-22T08:42:05.365009+0000","last_became_active":"2023-12-22T08:41:26.745355+0000","last_became_peered":"2023-12-22T08:41:26.745355+0000","last_unstale":"2023-12-22T08:42:05.365009+0000","last_undegraded":"2023-12-22T08:42:05.365009+0000","last_fullsized":"2023-12-22T08:42:05.365009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:05.364991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:05.364991+0000","last_clean_scrub_stamp":"2023-12-22T08:42:05.364991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:09:06.733385+0000","scrub_duration":0.0010969059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.306341+0000","last_change":"2023-12-22T08:41:57.306477+0000","last_active":"2023-12-22T08:41:57.306341+0000","last_peered":"2023-12-22T08:41:57.306341+0000","last_clean":"2023-12-22T08:41:57.306341+0000","last_became_active":"2023-12-22T08:41:27.125907+0000","last_became_peered":"2023-12-22T08:41:27.125907+0000","last_unstale":"2023-12-22T08:41:57.306341+0000","last_undegraded":"2023-12-22T08:41:57.306341+0000","last_fullsized":"2023-12-22T08:41:57.306341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.306316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.306316+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.306316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:11.496939+0000","scrub_duration":0.0017265959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:49.922113+0000","last_change":"2023-12-22T08:41:49.922221+0000","last_active":"2023-12-22T08:41:49.922113+0000","last_peered":"2023-12-22T08:41:49.922113+0000","last_clean":"2023-12-22T08:41:49.922113+0000","last_became_active":"2023-12-22T08:41:26.739458+0000","last_became_peered":"2023-12-22T08:41:26.739458+0000","last_unstale":"2023-12-22T08:41:49.922113+0000","last_undegraded":"2023-12-22T08:41:49.922113+0000","last_fullsized":"2023-12-22T08:41:49.922113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:49.922088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:49.922088+0000","last_clean_scrub_stamp":"2023-12-22T08:41:49.922088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:25.658809+0000","scrub_duration":0.0013764789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:05.596253+0000","last_change":"2023-12-22T08:42:05.596353+0000","last_active":"2023-12-22T08:42:05.596253+0000","last_peered":"2023-12-22T08:42:05.596253+0000","last_clean":"2023-12-22T08:42:05.596253+0000","last_became_active":"2023-12-22T08:41:27.133320+0000","last_became_peered":"2023-12-22T08:41:27.133320+0000","last_unstale":"2023-12-22T08:42:05.596253+0000","last_undegraded":"2023-12-22T08:42:05.596253+0000","last_fullsized":"2023-12-22T08:42:05.596253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:05.596231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:05.596231+0000","last_clean_scrub_stamp":"2023-12-22T08:42:05.596231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:51.304174+0000","scrub_duration":0.001640084,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.410013+0000","last_change":"2023-12-22T08:41:47.410123+0000","last_active":"2023-12-22T08:41:47.410013+0000","last_peered":"2023-12-22T08:41:47.410013+0000","last_clean":"2023-12-22T08:41:47.410013+0000","last_became_active":"2023-12-22T08:41:26.742900+0000","last_became_peered":"2023-12-22T08:41:26.742900+0000","last_unstale":"2023-12-22T08:41:47.410013+0000","last_undegraded":"2023-12-22T08:41:47.410013+0000","last_fullsized":"2023-12-22T08:41:47.410013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.409992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.409992+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.409992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:22.478066+0000","scrub_duration":0.001809291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:19.500637+0000","last_change":"2023-12-22T08:42:19.500751+0000","last_active":"2023-12-22T08:42:19.500637+0000","last_peered":"2023-12-22T08:42:19.500637+0000","last_clean":"2023-12-22T08:42:19.500637+0000","last_became_active":"2023-12-22T08:41:27.129275+0000","last_became_peered":"2023-12-22T08:41:27.129275+0000","last_unstale":"2023-12-22T08:42:19.500637+0000","last_undegraded":"2023-12-22T08:42:19.500637+0000","last_fullsized":"2023-12-22T08:42:19.500637+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:19.500615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:19.500615+0000","last_clean_scrub_stamp":"2023-12-22T08:42:19.500615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:26.393416+0000","scrub_duration":0.001464314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:49.140788+0000","last_change":"2023-12-22T08:41:49.140898+0000","last_active":"2023-12-22T08:41:49.140788+0000","last_peered":"2023-12-22T08:41:49.140788+0000","last_clean":"2023-12-22T08:41:49.140788+0000","last_became_active":"2023-12-22T08:41:26.743285+0000","last_became_peered":"2023-12-22T08:41:26.743285+0000","last_unstale":"2023-12-22T08:41:49.140788+0000","last_undegraded":"2023-12-22T08:41:49.140788+0000","last_fullsized":"2023-12-22T08:41:49.140788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:49.140767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:49.140767+0000","last_clean_scrub_stamp":"2023-12-22T08:41:49.140767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:09.673528+0000","scrub_duration":0.001512722,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:10.370609+0000","last_change":"2023-12-22T08:42:10.370716+0000","last_active":"2023-12-22T08:42:10.370609+0000","last_peered":"2023-12-22T08:42:10.370609+0000","last_clean":"2023-12-22T08:42:10.370609+0000","last_became_active":"2023-12-22T08:41:27.130689+0000","last_became_peered":"2023-12-22T08:41:27.130689+0000","last_unstale":"2023-12-22T08:42:10.370609+0000","last_undegraded":"2023-12-22T08:42:10.370609+0000","last_fullsized":"2023-12-22T08:42:10.370609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:10.370587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:10.370587+0000","last_clean_scrub_stamp":"2023-12-22T08:42:10.370587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:13.462392+0000","scrub_duration":0.0019557609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.404090+0000","last_change":"2023-12-22T08:41:48.404235+0000","last_active":"2023-12-22T08:41:48.404090+0000","last_peered":"2023-12-22T08:41:48.404090+0000","last_clean":"2023-12-22T08:41:48.404090+0000","last_became_active":"2023-12-22T08:41:26.745364+0000","last_became_peered":"2023-12-22T08:41:26.745364+0000","last_unstale":"2023-12-22T08:41:48.404090+0000","last_undegraded":"2023-12-22T08:41:48.404090+0000","last_fullsized":"2023-12-22T08:41:48.404090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-22T08:41:48.404066+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-22T08:41:48.404066+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.404066+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:23.472141+0000","scrub_duration":0.0021286439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:26.391751+0000","last_change":"2023-12-22T08:42:26.391853+0000","last_active":"2023-12-22T08:42:26.391751+0000","last_peered":"2023-12-22T08:42:26.391751+0000","last_clean":"2023-12-22T08:42:26.391751+0000","last_became_active":"2023-12-22T08:41:27.117991+0000","last_became_peered":"2023-12-22T08:41:27.117991+0000","last_unstale":"2023-12-22T08:42:26.391751+0000","last_undegraded":"2023-12-22T08:42:26.391751+0000","last_fullsized":"2023-12-22T08:42:26.391751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:26.391733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:26.391733+0000","last_clean_scrub_stamp":"2023-12-22T08:42:26.391733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T11:40:19.481543+0000","scrub_duration":0.00191687,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'11","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.358972+0000","last_change":"2023-12-22T08:41:52.359123+0000","last_active":"2023-12-22T08:41:52.358972+0000","last_peered":"2023-12-22T08:41:52.358972+0000","last_clean":"2023-12-22T08:41:52.358972+0000","last_became_active":"2023-12-22T08:41:26.747729+0000","last_became_peered":"2023-12-22T08:41:26.747729+0000","last_unstale":"2023-12-22T08:41:52.358972+0000","last_undegraded":"2023-12-22T08:41:52.358972+0000","last_fullsized":"2023-12-22T08:41:52.358972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2023-12-22T08:41:52.358921+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2023-12-22T08:41:52.358921+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.358921+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:07:26.911753+0000","scrub_duration":0.0024584440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7095,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:59.285558+0000","last_change":"2023-12-22T08:41:59.285671+0000","last_active":"2023-12-22T08:41:59.285558+0000","last_peered":"2023-12-22T08:41:59.285558+0000","last_clean":"2023-12-22T08:41:59.285558+0000","last_became_active":"2023-12-22T08:41:27.120120+0000","last_became_peered":"2023-12-22T08:41:27.120120+0000","last_unstale":"2023-12-22T08:41:59.285558+0000","last_undegraded":"2023-12-22T08:41:59.285558+0000","last_fullsized":"2023-12-22T08:41:59.285558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:59.285536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:59.285536+0000","last_clean_scrub_stamp":"2023-12-22T08:41:59.285536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:25.753471+0000","scrub_duration":0.0017918680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.886840+0000","last_change":"2023-12-22T08:41:48.886981+0000","last_active":"2023-12-22T08:41:48.886840+0000","last_peered":"2023-12-22T08:41:48.886840+0000","last_clean":"2023-12-22T08:41:48.886840+0000","last_became_active":"2023-12-22T08:41:26.740274+0000","last_became_peered":"2023-12-22T08:41:26.740274+0000","last_unstale":"2023-12-22T08:41:48.886840+0000","last_undegraded":"2023-12-22T08:41:48.886840+0000","last_fullsized":"2023-12-22T08:41:48.886840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:48.886803+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:48.886803+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.886803+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:09.419564+0000","scrub_duration":0.0021129059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:08.333054+0000","last_change":"2023-12-22T08:42:08.333177+0000","last_active":"2023-12-22T08:42:08.333054+0000","last_peered":"2023-12-22T08:42:08.333054+0000","last_clean":"2023-12-22T08:42:08.333054+0000","last_became_active":"2023-12-22T08:41:27.127235+0000","last_became_peered":"2023-12-22T08:41:27.127235+0000","last_unstale":"2023-12-22T08:42:08.333054+0000","last_undegraded":"2023-12-22T08:42:08.333054+0000","last_fullsized":"2023-12-22T08:42:08.333054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:08.333029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:08.333029+0000","last_clean_scrub_stamp":"2023-12-22T08:42:08.333029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:57:36.677252+0000","scrub_duration":0.0014875649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:48.305618+0000","last_change":"2023-12-22T08:41:48.305733+0000","last_active":"2023-12-22T08:41:48.305618+0000","last_peered":"2023-12-22T08:41:48.305618+0000","last_clean":"2023-12-22T08:41:48.305618+0000","last_became_active":"2023-12-22T08:41:26.746278+0000","last_became_peered":"2023-12-22T08:41:26.746278+0000","last_unstale":"2023-12-22T08:41:48.305618+0000","last_undegraded":"2023-12-22T08:41:48.305618+0000","last_fullsized":"2023-12-22T08:41:48.305618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:48.305595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:48.305595+0000","last_clean_scrub_stamp":"2023-12-22T08:41:48.305595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:24.042316+0000","scrub_duration":0.0016592250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:19.415303+0000","last_change":"2023-12-22T08:42:19.415412+0000","last_active":"2023-12-22T08:42:19.415303+0000","last_peered":"2023-12-22T08:42:19.415303+0000","last_clean":"2023-12-22T08:42:19.415303+0000","last_became_active":"2023-12-22T08:41:27.123641+0000","last_became_peered":"2023-12-22T08:41:27.123641+0000","last_unstale":"2023-12-22T08:42:19.415303+0000","last_undegraded":"2023-12-22T08:42:19.415303+0000","last_fullsized":"2023-12-22T08:42:19.415303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:19.415281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:19.415281+0000","last_clean_scrub_stamp":"2023-12-22T08:42:19.415281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:16.534166+0000","scrub_duration":0.0015449000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.362707+0000","last_change":"2023-12-22T08:41:50.362820+0000","last_active":"2023-12-22T08:41:50.362707+0000","last_peered":"2023-12-22T08:41:50.362707+0000","last_clean":"2023-12-22T08:41:50.362707+0000","last_became_active":"2023-12-22T08:41:26.742235+0000","last_became_peered":"2023-12-22T08:41:26.742235+0000","last_unstale":"2023-12-22T08:41:50.362707+0000","last_undegraded":"2023-12-22T08:41:50.362707+0000","last_fullsized":"2023-12-22T08:41:50.362707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:50.362682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:50.362682+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.362682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:42.575045+0000","scrub_duration":0.001768356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.246099+0000","last_change":"2023-12-22T08:42:01.246204+0000","last_active":"2023-12-22T08:42:01.246099+0000","last_peered":"2023-12-22T08:42:01.246099+0000","last_clean":"2023-12-22T08:42:01.246099+0000","last_became_active":"2023-12-22T08:41:27.122443+0000","last_became_peered":"2023-12-22T08:41:27.122443+0000","last_unstale":"2023-12-22T08:42:01.246099+0000","last_undegraded":"2023-12-22T08:42:01.246099+0000","last_fullsized":"2023-12-22T08:42:01.246099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:01.246078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:01.246078+0000","last_clean_scrub_stamp":"2023-12-22T08:42:01.246078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:36.314153+0000","scrub_duration":0.001295802,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'12","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.427232+0000","last_change":"2023-12-22T08:42:01.427340+0000","last_active":"2023-12-22T08:42:01.427232+0000","last_peered":"2023-12-22T08:42:01.427232+0000","last_clean":"2023-12-22T08:42:01.427232+0000","last_became_active":"2023-12-22T08:41:26.748515+0000","last_became_peered":"2023-12-22T08:41:26.748515+0000","last_unstale":"2023-12-22T08:42:01.427232+0000","last_undegraded":"2023-12-22T08:42:01.427232+0000","last_fullsized":"2023-12-22T08:42:01.427232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2023-12-22T08:42:01.427209+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2023-12-22T08:42:01.427209+0000","last_clean_scrub_stamp":"2023-12-22T08:42:01.427209+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:47.135152+0000","scrub_duration":0.0050823769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:29.085692+0000","last_change":"2023-12-22T08:42:29.085794+0000","last_active":"2023-12-22T08:42:29.085692+0000","last_peered":"2023-12-22T08:42:29.085692+0000","last_clean":"2023-12-22T08:42:29.085692+0000","last_became_active":"2023-12-22T08:41:27.118034+0000","last_became_peered":"2023-12-22T08:41:27.118034+0000","last_unstale":"2023-12-22T08:42:29.085692+0000","last_undegraded":"2023-12-22T08:42:29.085692+0000","last_fullsized":"2023-12-22T08:42:29.085692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:29.085668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:29.085668+0000","last_clean_scrub_stamp":"2023-12-22T08:42:29.085668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:21:04.662523+0000","scrub_duration":0.0014322930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.288363+0000","last_change":"2023-12-22T08:41:52.288478+0000","last_active":"2023-12-22T08:41:52.288363+0000","last_peered":"2023-12-22T08:41:52.288363+0000","last_clean":"2023-12-22T08:41:52.288363+0000","last_became_active":"2023-12-22T08:41:26.751446+0000","last_became_peered":"2023-12-22T08:41:26.751446+0000","last_unstale":"2023-12-22T08:41:52.288363+0000","last_undegraded":"2023-12-22T08:41:52.288363+0000","last_fullsized":"2023-12-22T08:41:52.288363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2023-12-22T08:41:52.288339+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2023-12-22T08:41:52.288339+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.288339+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:27.356414+0000","scrub_duration":0.0018746640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:23.378532+0000","last_change":"2023-12-22T08:42:23.378668+0000","last_active":"2023-12-22T08:42:23.378532+0000","last_peered":"2023-12-22T08:42:23.378532+0000","last_clean":"2023-12-22T08:42:23.378532+0000","last_became_active":"2023-12-22T08:41:27.122691+0000","last_became_peered":"2023-12-22T08:41:27.122691+0000","last_unstale":"2023-12-22T08:42:23.378532+0000","last_undegraded":"2023-12-22T08:42:23.378532+0000","last_fullsized":"2023-12-22T08:42:23.378532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:23.378512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:23.378512+0000","last_clean_scrub_stamp":"2023-12-22T08:42:23.378512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T17:18:30.271313+0000","scrub_duration":0.001337895,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:01.036387+0000","last_change":"2023-12-22T08:42:01.036500+0000","last_active":"2023-12-22T08:42:01.036387+0000","last_peered":"2023-12-22T08:42:01.036387+0000","last_clean":"2023-12-22T08:42:01.036387+0000","last_became_active":"2023-12-22T08:41:26.740679+0000","last_became_peered":"2023-12-22T08:41:26.740679+0000","last_unstale":"2023-12-22T08:42:01.036387+0000","last_undegraded":"2023-12-22T08:42:01.036387+0000","last_fullsized":"2023-12-22T08:42:01.036387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-22T08:42:01.036364+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-22T08:42:01.036364+0000","last_clean_scrub_stamp":"2023-12-22T08:42:01.036364+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:07:35.589196+0000","scrub_duration":0.00263291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:07.259310+0000","last_change":"2023-12-22T08:42:07.259425+0000","last_active":"2023-12-22T08:42:07.259310+0000","last_peered":"2023-12-22T08:42:07.259310+0000","last_clean":"2023-12-22T08:42:07.259310+0000","last_became_active":"2023-12-22T08:41:27.125646+0000","last_became_peered":"2023-12-22T08:41:27.125646+0000","last_unstale":"2023-12-22T08:42:07.259310+0000","last_undegraded":"2023-12-22T08:42:07.259310+0000","last_fullsized":"2023-12-22T08:42:07.259310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:07.259286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:07.259286+0000","last_clean_scrub_stamp":"2023-12-22T08:42:07.259286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:52.967229+0000","scrub_duration":0.001673316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:12.033382+0000","last_change":"2023-12-22T08:42:12.033503+0000","last_active":"2023-12-22T08:42:12.033382+0000","last_peered":"2023-12-22T08:42:12.033382+0000","last_clean":"2023-12-22T08:42:12.033382+0000","last_became_active":"2023-12-22T08:41:26.742866+0000","last_became_peered":"2023-12-22T08:41:26.742866+0000","last_unstale":"2023-12-22T08:42:12.033382+0000","last_undegraded":"2023-12-22T08:42:12.033382+0000","last_fullsized":"2023-12-22T08:42:12.033382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-22T08:42:12.033358+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-22T08:42:12.033358+0000","last_clean_scrub_stamp":"2023-12-22T08:42:12.033358+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T19:16:57.741301+0000","scrub_duration":0.00370273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.299499+0000","last_change":"2023-12-22T08:41:56.299604+0000","last_active":"2023-12-22T08:41:56.299499+0000","last_peered":"2023-12-22T08:41:56.299499+0000","last_clean":"2023-12-22T08:41:56.299499+0000","last_became_active":"2023-12-22T08:41:27.125728+0000","last_became_peered":"2023-12-22T08:41:27.125728+0000","last_unstale":"2023-12-22T08:41:56.299499+0000","last_undegraded":"2023-12-22T08:41:56.299499+0000","last_fullsized":"2023-12-22T08:41:56.299499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:56.299477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:56.299477+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.299477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:16.832238+0000","scrub_duration":0.0020187170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:02.047098+0000","last_change":"2023-12-22T08:42:02.047221+0000","last_active":"2023-12-22T08:42:02.047098+0000","last_peered":"2023-12-22T08:42:02.047098+0000","last_clean":"2023-12-22T08:42:02.047098+0000","last_became_active":"2023-12-22T08:41:26.743821+0000","last_became_peered":"2023-12-22T08:41:26.743821+0000","last_unstale":"2023-12-22T08:42:02.047098+0000","last_undegraded":"2023-12-22T08:42:02.047098+0000","last_fullsized":"2023-12-22T08:42:02.047098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:02.047079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:02.047079+0000","last_clean_scrub_stamp":"2023-12-22T08:42:02.047079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:28.515014+0000","scrub_duration":0.00185714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.328671+0000","last_change":"2023-12-22T08:41:46.328791+0000","last_active":"2023-12-22T08:41:46.328671+0000","last_peered":"2023-12-22T08:41:46.328671+0000","last_clean":"2023-12-22T08:41:46.328671+0000","last_became_active":"2023-12-22T08:41:27.125142+0000","last_became_peered":"2023-12-22T08:41:27.125142+0000","last_unstale":"2023-12-22T08:41:46.328671+0000","last_undegraded":"2023-12-22T08:41:46.328671+0000","last_fullsized":"2023-12-22T08:41:46.328671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:46.328640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:46.328640+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.328640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:44:27.039382+0000","scrub_duration":0.0018943460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.128855+0000","last_change":"2023-12-22T08:41:47.128988+0000","last_active":"2023-12-22T08:41:47.128855+0000","last_peered":"2023-12-22T08:41:47.128855+0000","last_clean":"2023-12-22T08:41:47.128855+0000","last_became_active":"2023-12-22T08:41:26.746959+0000","last_became_peered":"2023-12-22T08:41:26.746959+0000","last_unstale":"2023-12-22T08:41:47.128855+0000","last_undegraded":"2023-12-22T08:41:47.128855+0000","last_fullsized":"2023-12-22T08:41:47.128855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:47.128831+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:47.128831+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.128831+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:38:39.043914+0000","scrub_duration":0.001887012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.230079+0000","last_change":"2023-12-22T08:41:51.230192+0000","last_active":"2023-12-22T08:41:51.230079+0000","last_peered":"2023-12-22T08:41:51.230079+0000","last_clean":"2023-12-22T08:41:51.230079+0000","last_became_active":"2023-12-22T08:41:27.121890+0000","last_became_peered":"2023-12-22T08:41:27.121890+0000","last_unstale":"2023-12-22T08:41:51.230079+0000","last_undegraded":"2023-12-22T08:41:51.230079+0000","last_fullsized":"2023-12-22T08:41:51.230079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:51.230056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:51.230056+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.230056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:49.398115+0000","scrub_duration":0.0014622179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.263666+0000","last_change":"2023-12-22T08:41:50.263773+0000","last_active":"2023-12-22T08:41:50.263666+0000","last_peered":"2023-12-22T08:41:50.263666+0000","last_clean":"2023-12-22T08:41:50.263666+0000","last_became_active":"2023-12-22T08:41:26.746600+0000","last_became_peered":"2023-12-22T08:41:26.746600+0000","last_unstale":"2023-12-22T08:41:50.263666+0000","last_undegraded":"2023-12-22T08:41:50.263666+0000","last_fullsized":"2023-12-22T08:41:50.263666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:50.263645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:50.263645+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.263645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:32.038572+0000","scrub_duration":0.0016633489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.309344+0000","last_change":"2023-12-22T08:41:47.309453+0000","last_active":"2023-12-22T08:41:47.309344+0000","last_peered":"2023-12-22T08:41:47.309344+0000","last_clean":"2023-12-22T08:41:47.309344+0000","last_became_active":"2023-12-22T08:41:27.120921+0000","last_became_peered":"2023-12-22T08:41:27.120921+0000","last_unstale":"2023-12-22T08:41:47.309344+0000","last_undegraded":"2023-12-22T08:41:47.309344+0000","last_fullsized":"2023-12-22T08:41:47.309344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.309320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.309320+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.309320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:48.116826+0000","scrub_duration":0.00141676,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:44.798903+0000","last_change":"2023-12-22T08:41:44.799001+0000","last_active":"2023-12-22T08:41:44.798903+0000","last_peered":"2023-12-22T08:41:44.798903+0000","last_clean":"2023-12-22T08:41:44.798903+0000","last_became_active":"2023-12-22T08:41:26.743974+0000","last_became_peered":"2023-12-22T08:41:26.743974+0000","last_unstale":"2023-12-22T08:41:44.798903+0000","last_undegraded":"2023-12-22T08:41:44.798903+0000","last_fullsized":"2023-12-22T08:41:44.798903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:44.798881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:44.798881+0000","last_clean_scrub_stamp":"2023-12-22T08:41:44.798881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:26.573807+0000","scrub_duration":0.0014226130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:13.448030+0000","last_change":"2023-12-22T08:42:13.448137+0000","last_active":"2023-12-22T08:42:13.448030+0000","last_peered":"2023-12-22T08:42:13.448030+0000","last_clean":"2023-12-22T08:42:13.448030+0000","last_became_active":"2023-12-22T08:41:27.125657+0000","last_became_peered":"2023-12-22T08:41:27.125657+0000","last_unstale":"2023-12-22T08:42:13.448030+0000","last_undegraded":"2023-12-22T08:42:13.448030+0000","last_fullsized":"2023-12-22T08:42:13.448030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:13.448000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:13.448000+0000","last_clean_scrub_stamp":"2023-12-22T08:42:13.448000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:12:26.571549+0000","scrub_duration":0.0014410860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.361657+0000","last_change":"2023-12-22T08:41:47.361791+0000","last_active":"2023-12-22T08:41:47.361657+0000","last_peered":"2023-12-22T08:41:47.361657+0000","last_clean":"2023-12-22T08:41:47.361657+0000","last_became_active":"2023-12-22T08:41:26.746817+0000","last_became_peered":"2023-12-22T08:41:26.746817+0000","last_unstale":"2023-12-22T08:41:47.361657+0000","last_undegraded":"2023-12-22T08:41:47.361657+0000","last_fullsized":"2023-12-22T08:41:47.361657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.361621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.361621+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.361621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:31.087523+0000","scrub_duration":0.001395547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:52.276194+0000","last_change":"2023-12-22T08:41:52.276348+0000","last_active":"2023-12-22T08:41:52.276194+0000","last_peered":"2023-12-22T08:41:52.276194+0000","last_clean":"2023-12-22T08:41:52.276194+0000","last_became_active":"2023-12-22T08:41:27.121808+0000","last_became_peered":"2023-12-22T08:41:27.121808+0000","last_unstale":"2023-12-22T08:41:52.276194+0000","last_undegraded":"2023-12-22T08:41:52.276194+0000","last_fullsized":"2023-12-22T08:41:52.276194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:52.276172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:52.276172+0000","last_clean_scrub_stamp":"2023-12-22T08:41:52.276172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:34.051098+0000","scrub_duration":0.0021259880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:51.282069+0000","last_change":"2023-12-22T08:41:51.282206+0000","last_active":"2023-12-22T08:41:51.282069+0000","last_peered":"2023-12-22T08:41:51.282069+0000","last_clean":"2023-12-22T08:41:51.282069+0000","last_became_active":"2023-12-22T08:41:26.748191+0000","last_became_peered":"2023-12-22T08:41:26.748191+0000","last_unstale":"2023-12-22T08:41:51.282069+0000","last_undegraded":"2023-12-22T08:41:51.282069+0000","last_fullsized":"2023-12-22T08:41:51.282069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-12-22T08:41:51.282050+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-12-22T08:41:51.282050+0000","last_clean_scrub_stamp":"2023-12-22T08:41:51.282050+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T12:04:35.007952+0000","scrub_duration":0.002384714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:14.480650+0000","last_change":"2023-12-22T08:42:14.480764+0000","last_active":"2023-12-22T08:42:14.480650+0000","last_peered":"2023-12-22T08:42:14.480650+0000","last_clean":"2023-12-22T08:42:14.480650+0000","last_became_active":"2023-12-22T08:41:27.117658+0000","last_became_peered":"2023-12-22T08:41:27.117658+0000","last_unstale":"2023-12-22T08:42:14.480650+0000","last_undegraded":"2023-12-22T08:42:14.480650+0000","last_fullsized":"2023-12-22T08:42:14.480650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:14.480630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:14.480630+0000","last_clean_scrub_stamp":"2023-12-22T08:42:14.480630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:16:17.572434+0000","scrub_duration":0.001815657,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:46.122748+0000","last_change":"2023-12-22T08:41:46.122903+0000","last_active":"2023-12-22T08:41:46.122748+0000","last_peered":"2023-12-22T08:41:46.122748+0000","last_clean":"2023-12-22T08:41:46.122748+0000","last_became_active":"2023-12-22T08:41:26.744125+0000","last_became_peered":"2023-12-22T08:41:26.744125+0000","last_unstale":"2023-12-22T08:41:46.122748+0000","last_undegraded":"2023-12-22T08:41:46.122748+0000","last_fullsized":"2023-12-22T08:41:46.122748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-12-22T08:41:46.122706+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-12-22T08:41:46.122706+0000","last_clean_scrub_stamp":"2023-12-22T08:41:46.122706+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:27.897633+0000","scrub_duration":0.0018311670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:57.147837+0000","last_change":"2023-12-22T08:41:57.147966+0000","last_active":"2023-12-22T08:41:57.147837+0000","last_peered":"2023-12-22T08:41:57.147837+0000","last_clean":"2023-12-22T08:41:57.147837+0000","last_became_active":"2023-12-22T08:41:27.121334+0000","last_became_peered":"2023-12-22T08:41:27.121334+0000","last_unstale":"2023-12-22T08:41:57.147837+0000","last_undegraded":"2023-12-22T08:41:57.147837+0000","last_fullsized":"2023-12-22T08:41:57.147837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:57.147812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:57.147812+0000","last_clean_scrub_stamp":"2023-12-22T08:41:57.147812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T09:35:49.360175+0000","scrub_duration":0.0014577909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:43.414929+0000","last_change":"2023-12-22T08:41:43.415022+0000","last_active":"2023-12-22T08:41:43.414929+0000","last_peered":"2023-12-22T08:41:43.414929+0000","last_clean":"2023-12-22T08:41:43.414929+0000","last_became_active":"2023-12-22T08:41:26.748024+0000","last_became_peered":"2023-12-22T08:41:26.748024+0000","last_unstale":"2023-12-22T08:41:43.414929+0000","last_undegraded":"2023-12-22T08:41:43.414929+0000","last_fullsized":"2023-12-22T08:41:43.414929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:43.414911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:43.414911+0000","last_clean_scrub_stamp":"2023-12-22T08:41:43.414911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T20:20:25.189838+0000","scrub_duration":0.0012201849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:56.214421+0000","last_change":"2023-12-22T08:41:56.214556+0000","last_active":"2023-12-22T08:41:56.214421+0000","last_peered":"2023-12-22T08:41:56.214421+0000","last_clean":"2023-12-22T08:41:56.214421+0000","last_became_active":"2023-12-22T08:41:27.123200+0000","last_became_peered":"2023-12-22T08:41:27.123200+0000","last_unstale":"2023-12-22T08:41:56.214421+0000","last_undegraded":"2023-12-22T08:41:56.214421+0000","last_fullsized":"2023-12-22T08:41:56.214421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:56.214400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:56.214400+0000","last_clean_scrub_stamp":"2023-12-22T08:41:56.214400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T15:47:31.951121+0000","scrub_duration":0.0019430840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:45.114607+0000","last_change":"2023-12-22T08:41:45.114691+0000","last_active":"2023-12-22T08:41:45.114607+0000","last_peered":"2023-12-22T08:41:45.114607+0000","last_clean":"2023-12-22T08:41:45.114607+0000","last_became_active":"2023-12-22T08:41:26.739985+0000","last_became_peered":"2023-12-22T08:41:26.739985+0000","last_unstale":"2023-12-22T08:41:45.114607+0000","last_undegraded":"2023-12-22T08:41:45.114607+0000","last_fullsized":"2023-12-22T08:41:45.114607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:45.114588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:45.114588+0000","last_clean_scrub_stamp":"2023-12-22T08:41:45.114588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:22:43.282646+0000","scrub_duration":0.0018108930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.145172+0000","last_change":"2023-12-22T08:41:55.145289+0000","last_active":"2023-12-22T08:41:55.145172+0000","last_peered":"2023-12-22T08:41:55.145172+0000","last_clean":"2023-12-22T08:41:55.145172+0000","last_became_active":"2023-12-22T08:41:27.120799+0000","last_became_peered":"2023-12-22T08:41:27.120799+0000","last_unstale":"2023-12-22T08:41:55.145172+0000","last_undegraded":"2023-12-22T08:41:55.145172+0000","last_fullsized":"2023-12-22T08:41:55.145172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.145150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.145150+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.145150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:30.213225+0000","scrub_duration":0.0017881869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:47.330293+0000","last_change":"2023-12-22T08:41:47.330406+0000","last_active":"2023-12-22T08:41:47.330293+0000","last_peered":"2023-12-22T08:41:47.330293+0000","last_clean":"2023-12-22T08:41:47.330293+0000","last_became_active":"2023-12-22T08:41:26.746901+0000","last_became_peered":"2023-12-22T08:41:26.746901+0000","last_unstale":"2023-12-22T08:41:47.330293+0000","last_undegraded":"2023-12-22T08:41:47.330293+0000","last_fullsized":"2023-12-22T08:41:47.330293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:47.330269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:47.330269+0000","last_clean_scrub_stamp":"2023-12-22T08:41:47.330269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T13:42:07.863030+0000","scrub_duration":0.0019224019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:15.465432+0000","last_change":"2023-12-22T08:42:15.465543+0000","last_active":"2023-12-22T08:42:15.465432+0000","last_peered":"2023-12-22T08:42:15.465432+0000","last_clean":"2023-12-22T08:42:15.465432+0000","last_became_active":"2023-12-22T08:41:27.122645+0000","last_became_peered":"2023-12-22T08:41:27.122645+0000","last_unstale":"2023-12-22T08:42:15.465432+0000","last_undegraded":"2023-12-22T08:42:15.465432+0000","last_fullsized":"2023-12-22T08:42:15.465432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:15.465413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:15.465413+0000","last_clean_scrub_stamp":"2023-12-22T08:42:15.465413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:28:12.584297+0000","scrub_duration":0.0013329629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.023017+0000","last_change":"2023-12-22T08:41:55.023128+0000","last_active":"2023-12-22T08:41:55.023017+0000","last_peered":"2023-12-22T08:41:55.023017+0000","last_clean":"2023-12-22T08:41:55.023017+0000","last_became_active":"2023-12-22T08:41:26.739376+0000","last_became_peered":"2023-12-22T08:41:26.739376+0000","last_unstale":"2023-12-22T08:41:55.023017+0000","last_undegraded":"2023-12-22T08:41:55.023017+0000","last_fullsized":"2023-12-22T08:41:55.023017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.022997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.022997+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.022997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:30.091071+0000","scrub_duration":0.001386246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:42:33.161474+0000","last_change":"2023-12-22T08:42:33.161589+0000","last_active":"2023-12-22T08:42:33.161474+0000","last_peered":"2023-12-22T08:42:33.161474+0000","last_clean":"2023-12-22T08:42:33.161474+0000","last_became_active":"2023-12-22T08:41:27.130750+0000","last_became_peered":"2023-12-22T08:41:27.130750+0000","last_unstale":"2023-12-22T08:42:33.161474+0000","last_undegraded":"2023-12-22T08:42:33.161474+0000","last_fullsized":"2023-12-22T08:42:33.161474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:42:33.161453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:42:33.161453+0000","last_clean_scrub_stamp":"2023-12-22T08:42:33.161453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:55:54.595466+0000","scrub_duration":0.0018881810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:53.364835+0000","last_change":"2023-12-22T08:41:53.364984+0000","last_active":"2023-12-22T08:41:53.364835+0000","last_peered":"2023-12-22T08:41:53.364835+0000","last_clean":"2023-12-22T08:41:53.364835+0000","last_became_active":"2023-12-22T08:41:26.744729+0000","last_became_peered":"2023-12-22T08:41:26.744729+0000","last_unstale":"2023-12-22T08:41:53.364835+0000","last_undegraded":"2023-12-22T08:41:53.364835+0000","last_fullsized":"2023-12-22T08:41:53.364835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:53.364814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:53.364814+0000","last_clean_scrub_stamp":"2023-12-22T08:41:53.364814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T14:04:19.832750+0000","scrub_duration":0.0016945,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:55.285779+0000","last_change":"2023-12-22T08:41:55.285949+0000","last_active":"2023-12-22T08:41:55.285779+0000","last_peered":"2023-12-22T08:41:55.285779+0000","last_clean":"2023-12-22T08:41:55.285779+0000","last_became_active":"2023-12-22T08:41:27.128086+0000","last_became_peered":"2023-12-22T08:41:27.128086+0000","last_unstale":"2023-12-22T08:41:55.285779+0000","last_undegraded":"2023-12-22T08:41:55.285779+0000","last_fullsized":"2023-12-22T08:41:55.285779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:55.285757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:55.285757+0000","last_clean_scrub_stamp":"2023-12-22T08:41:55.285757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T18:22:09.476380+0000","scrub_duration":0.002040563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:44.383912+0000","last_change":"2023-12-22T08:41:44.384018+0000","last_active":"2023-12-22T08:41:44.383912+0000","last_peered":"2023-12-22T08:41:44.383912+0000","last_clean":"2023-12-22T08:41:44.383912+0000","last_became_active":"2023-12-22T08:41:26.742368+0000","last_became_peered":"2023-12-22T08:41:26.742368+0000","last_unstale":"2023-12-22T08:41:44.383912+0000","last_undegraded":"2023-12-22T08:41:44.383912+0000","last_fullsized":"2023-12-22T08:41:44.383912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T08:41:44.383888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T08:41:44.383888+0000","last_clean_scrub_stamp":"2023-12-22T08:41:44.383888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T10:38:45.191395+0000","scrub_duration":0.0013960800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-22T08:41:50.351285+0000","last_change":"2023-12-22T08:41:50.351285+0000","last_active":"2023-12-22T08:41:50.351285+0000","last_peered":"2023-12-22T08:41:50.351285+0000","last_clean":"2023-12-22T08:41:50.351285+0000","last_became_active":"2023-12-22T08:40:34.959052+0000","last_became_peered":"2023-12-22T08:40:34.959052+0000","last_unstale":"2023-12-22T08:41:50.351285+0000","last_undegraded":"2023-12-22T08:41:50.351285+0000","last_fullsized":"2023-12-22T08:41:50.351285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2023-12-22T08:41:50.351120+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2023-12-22T08:41:50.351120+0000","last_clean_scrub_stamp":"2023-12-22T08:41:50.351120+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-23T16:13:25.419194+0000","scrub_duration":0.0078495939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7893,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.70399999999999996,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.51700000000000002},"min":{"1min":0.39500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.497}]},{"osd":1,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.68000000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68100000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":0.68600000000000005,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.46400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.67100000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.60899999999999999,"5min":0.754,"15min":0.754},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.433,"5min":0.373,"15min":0.373},"max":{"1min":0.69999999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.49299999999999999,"15min":0.501},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58499999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.499,"15min":0.505},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64300000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68400000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70699999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66200000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.38}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.41799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76500000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.45500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76800000000000002,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78700000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.749},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73599999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.59999999999999998,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34599999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65400000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.42399999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70399999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.62},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.41399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66900000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55300000000000005}]},{"osd":1,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51300000000000001,"15min":0.50600000000000001},"min":{"1min":0.40400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.64700000000000002,"5min":0.753,"15min":0.753},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.378,"5min":0.374,"15min":0.374},"max":{"1min":0.65300000000000002,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.64700000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.495}]},{"osd":3,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.47899999999999998,"15min":0.49199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.63,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.50600000000000001,"15min":0.52000000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.58399999999999996,"5min":0.755,"15min":0.755},"last":0.47799999999999998}]},{"osd":6,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63500000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.62},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66600000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Dec 22 08:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53900000000000003,"15min":0.54900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.61799999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64700000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69099999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.40500000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.626}]},{"osd":1,"last update":"Fri Dec 22 08:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.41399999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.38900000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68500000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52700000000000002,"15min":0.52000000000000002},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72599999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.50800000000000001,"15min":0.499},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71999999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Dec 22 08:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.44600000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.745,"5min":0.75,"15min":0.75},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Dec 22 08:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71099999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.38400000000000001}]},{"osd":6,"last update":"Fri Dec 22 08:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.504},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.45200000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":368640,"data_stored":141379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.313},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.33300000000000002},"min":{"1min":0.23899999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.503}]},{"osd":1,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.38100000000000001,"15min":0.374},"min":{"1min":0.255,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.40400000000000003,"15min":0.39400000000000002},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64200000000000002,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71399999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.435,"5min":0.379,"15min":0.379},"max":{"1min":0.78900000000000003,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45600000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.80300000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63}]},{"osd":6,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72899999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82799999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Dec 22 08:42:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.76700000000000002,"5min":1.095,"15min":1.095},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.79900000000000004,"5min":1.135,"15min":1.135},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.33000000000000002,"15min":0.32200000000000001},"min":{"1min":0.27700000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34100000000000003},"min":{"1min":0.23999999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.29999999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.48899999999999999}]},{"osd":3,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.38},"min":{"1min":0.35299999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.34200000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.61799999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.435}]},{"osd":4,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89200000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85799999999999998,"5min":1.131,"15min":1.131},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93600000000000005,"5min":0.998,"15min":0.998},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.96599999999999997,"5min":1.173,"15min":1.173},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":368640,"data_stored":141379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34699999999999998,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.501,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.443},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.378,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60099999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58299999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.374,"15min":0.37},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.51600000000000001,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.314,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.55500000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.314,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.54500000000000004,"5min":1.161,"15min":1.161},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63,"15min":0.63300000000000001},"min":{"1min":0.442,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.78300000000000003,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.623,"15min":0.624},"min":{"1min":0.46899999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.81599999999999995,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.5,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77600000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.39900000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.82899999999999996,"5min":1.216,"15min":1.216},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63600000000000001,"15min":0.63900000000000001},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80400000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.74399999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.80000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34399999999999997,"15min":0.34100000000000003},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34599999999999997,"15min":0.34300000000000003},"min":{"1min":0.26600000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54200000000000004,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39700000000000002,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.254,"15min":0.254},"max":{"1min":0.55000000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.43099999999999999},"min":{"1min":0.315,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.58899999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.41999999999999998}]},{"osd":3,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.59099999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.377},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45000000000000001,"15min":0.44800000000000001},"min":{"1min":0.36299999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.63200000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.437,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80000000000000004,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":1.002,"15min":1.002},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.47299999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.78900000000000003,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88400000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91500000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81999999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Dec 22 08:42:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63400000000000001,"15min":0.63100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89800000000000002,"5min":1.266,"15min":1.266},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88800000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T08:42:45.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-22T08:42:46.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.052+0000 7f31423c4640 1 Processor -- start 2023-12-22T08:42:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.052+0000 7f31423c4640 1 -- start start 2023-12-22T08:42:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f31423c4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c0bc000 0x7f313c0b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f31423c4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313c0b5f00 con 0x7f313c14be60 2023-12-22T08:42:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f31423c4640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313c0b61e0 con 0x7f313c0bb1c0 2023-12-22T08:42:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f31423c4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0b8650 con 0x7f313c0bc000 2023-12-22T08:42:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f3140961640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f313c14be60 0x7f313c1426a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41284/0 (socket says 172.21.15.31:41284) 2023-12-22T08:42:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f3140961640 1 -- 172.21.15.31:0/3472146843 learned_addr learned my addr 172.21.15.31:0/3472146843 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313b7fe640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c0bc000 0x7f313c0b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015348019 0 0) 0x7f313c0b5f00 con 0x7f313c14be60 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3128003520 con 0x7f313c14be60 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564751858 0 0) 0x7f313c0b61e0 con 0x7f313c0bb1c0 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f313c0b5f00 con 0x7f313c0bb1c0 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2189105854 0 0) 0x7f3128003520 con 0x7f313c14be60 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c0bc000 msgr2=0x7f313c0b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c0bc000 0x7f313c0b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 >> v1:172.21.15.69:6789/0 conn(0x7f313c0bb1c0 legacy=0x7f313c0b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c0b7910 con 0x7f313c14be60 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f31340019f0 con 0x7f313c14be60 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 >> v1:172.21.15.31:6789/0 conn(0x7f313c14be60 legacy=0x7f313c1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3128003b30 0x7f3128003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c0bc000 0x7f31280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.053+0000 7f313affd640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128004d00 0x7f3128005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0b8650 con 0x7f3128003b30 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312800ba30 con 0x7f3128004d00 2023-12-22T08:42:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312800bbf0 con 0x7f313c0bc000 2023-12-22T08:42:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313bfff640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3128003b30 0x7f3128003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313b7fe640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c0bc000 0x7f31280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f3140961640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128004d00 0x7f3128005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313bfff640 1 -- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c0bc000 msgr2=0x7f31280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313bfff640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c0bc000 0x7f31280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313bfff640 1 -- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128004d00 msgr2=0x7f3128005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313bfff640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128004d00 0x7f3128005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f313bfff640 1 -- 172.21.15.31:0/3472146843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3128003520 con 0x7f3128003b30 2023-12-22T08:42:46.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.054+0000 7f3140961640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128004d00 0x7f3128005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T08:42:46.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f313bfff640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3128003b30 0x7f3128003f30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f31240018d0 tx=0x7f31280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593a1a9e066bedcb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240052d0 con 0x7f3128003b30 2023-12-22T08:42:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124005430 con 0x7f3128003b30 2023-12-22T08:42:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f313affd640 1 -- 172.21.15.31:0/3472146843 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124003810 con 0x7f3128003b30 2023-12-22T08:42:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f31423c4640 1 -- 172.21.15.31:0/3472146843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3128003b30 msgr2=0x7f3128003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f31423c4640 1 --2- 172.21.15.31:0/3472146843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3128003b30 0x7f3128003f30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f31240018d0 tx=0x7f31280057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f3140961640 1 -- 172.21.15.31:0/3472146843 reap_dead start 2023-12-22T08:42:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f31423c4640 1 -- 172.21.15.31:0/3472146843 shutdown_connections 2023-12-22T08:42:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f31423c4640 1 -- 172.21.15.31:0/3472146843 >> 172.21.15.31:0/3472146843 conn(0x7f313c069ee0 msgr2=0x7f313c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f31423c4640 1 -- 172.21.15.31:0/3472146843 shutdown_connections 2023-12-22T08:42:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.055+0000 7f31423c4640 1 -- 172.21.15.31:0/3472146843 wait complete. 2023-12-22T08:42:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.056+0000 7f31423c4640 1 Processor -- start 2023-12-22T08:42:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f31423c4640 1 -- start start 2023-12-22T08:42:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f31423c4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128003b30 0x7f313c143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f31423c4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c147080 0x7f313c13af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f31423c4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313c145790 0x7f313c1e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f31423c4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1de8d0 con 0x7f313c145790 2023-12-22T08:42:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f31423c4640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c147540 con 0x7f3128003b30 2023-12-22T08:42:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f31423c4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c145350 con 0x7f313c147080 2023-12-22T08:42:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f3140961640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313c145790 0x7f313c1e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f3140961640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313c145790 0x7f313c1e14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43144/0 (socket says 172.21.15.31:43144) 2023-12-22T08:42:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f3140961640 1 -- 172.21.15.31:0/2473436960 learned_addr learned my addr 172.21.15.31:0/2473436960 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:42:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.057+0000 7f313bfff640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128003b30 0x7f313c143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3140961640 1 -- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c147080 msgr2=0x7f313c13af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3140961640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c147080 0x7f313c13af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3140961640 1 -- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128003b30 msgr2=0x7f313c143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3140961640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128003b30 0x7f313c143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3140961640 1 -- 172.21.15.31:0/2473436960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c1ddfa0 con 0x7f313c145790 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f313bfff640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128003b30 0x7f313c143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3140961640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313c145790 0x7f313c1e14a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f313c14c240 tx=0x7f313400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3138ff9640 1 -- 172.21.15.31:0/2473436960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400ec10 con 0x7f313c145790 2023-12-22T08:42:46.071 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3138ff9640 1 -- 172.21.15.31:0/2473436960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313400ed70 con 0x7f313c145790 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c1de280 con 0x7f313c145790 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f3138ff9640 1 -- 172.21.15.31:0/2473436960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400eee0 con 0x7f313c145790 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.058+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c1499b0 con 0x7f313c145790 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.059+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c1dea80 con 0x7f313c145790 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.059+0000 7f3138ff9640 1 -- 172.21.15.31:0/2473436960 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3134013660 con 0x7f313c145790 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.060+0000 7f3138ff9640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f311c06a430 0x7f311c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.060+0000 7f3138ff9640 1 -- 172.21.15.31:0/2473436960 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3134088d30 con 0x7f313c145790 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.060+0000 7f313bfff640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f311c06a430 0x7f311c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.072 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.060+0000 7f313bfff640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f311c06a430 0x7f311c06c8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3124034000 tx=0x7f3124031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.064+0000 7f3138ff9640 1 -- 172.21.15.31:0/2473436960 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f313c1dea80 con 0x7f313c145790 2023-12-22T08:42:46.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.241+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f313c073a40 con 0x7f313c145790 2023-12-22T08:42:46.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.244+0000 7f3138ff9640 1 -- 172.21.15.31:0/2473436960 <== mon.0 v2:172.21.15.31:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f31340543b0 con 0x7f313c145790 2023-12-22T08:42:46.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.245+0000 7f3138ff9640 1 -- 172.21.15.31:0/2473436960 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3134057e40 con 0x7f313c145790 2023-12-22T08:42:46.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f311c06a430 msgr2=0x7f311c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f311c06a430 0x7f311c06c8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3124034000 tx=0x7f3124031000 comp rx=0 tx=0).stop 2023-12-22T08:42:46.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313c145790 msgr2=0x7f313c1e14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313c145790 0x7f313c1e14a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f313c14c240 tx=0x7f313400e530 comp rx=0 tx=0).stop 2023-12-22T08:42:46.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 shutdown_connections 2023-12-22T08:42:46.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f311c06a430 0x7f311c06c8f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313c145790 0x7f313c1e14a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f313c147080 0x7f313c13af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 --2- 172.21.15.31:0/2473436960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3128003b30 0x7f313c143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 >> 172.21.15.31:0/2473436960 conn(0x7f313c069ee0 msgr2=0x7f313c13cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 shutdown_connections 2023-12-22T08:42:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.248+0000 7f31423c4640 1 -- 172.21.15.31:0/2473436960 wait complete. 2023-12-22T08:42:46.260 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T08:42:46.261 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T08:42:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.364+0000 7f7c80a96640 1 Processor -- start 2023-12-22T08:42:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.364+0000 7f7c80a96640 1 -- start start 2023-12-22T08:42:46.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c80a96640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7c7c0ba550 0x7f7c7c0b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c80a96640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 0x7f7c7c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c80a96640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c0bb310 con 0x7f7c7c06a6d0 2023-12-22T08:42:46.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c80a96640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c0bf960 con 0x7f7c7c0ba550 2023-12-22T08:42:46.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c80a96640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0bb5b0 con 0x7f7c7c0ba000 2023-12-22T08:42:46.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c7a59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7c7c06a6d0 0x7f7c7c14acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41290/0 (socket says 172.21.15.31:41290) 2023-12-22T08:42:46.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c7a59c640 1 -- 172.21.15.31:0/3173737102 learned_addr learned my addr 172.21.15.31:0/3173737102 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-12-22T08:42:46.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c73fff640 1 --2- 172.21.15.31:0/3173737102 >> v2:172.21.15.69:3300/0 conn(0x7f7c7c0ba550 0x7f7c7c0b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c7ad9d640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 0x7f7c7c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.365+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480848608 0 0) 0x7f7c7c0bb310 con 0x7f7c7c06a6d0 2023-12-22T08:42:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c68003520 con 0x7f7c7c06a6d0 2023-12-22T08:42:46.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934311157 0 0) 0x7f7c68003520 con 0x7f7c7c06a6d0 2023-12-22T08:42:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 msgr2=0x7f7c7c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 0x7f7c7c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 >> v2:172.21.15.69:3300/0 conn(0x7f7c7c0ba550 msgr2=0x7f7c7c0b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 --2- 172.21.15.31:0/3173737102 >> v2:172.21.15.69:3300/0 conn(0x7f7c7c0ba550 0x7f7c7c0b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0c0120 con 0x7f7c7c06a6d0 2023-12-22T08:42:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1495239541 0 0) 0x7f7c6c001670 con 0x7f7c7c06a6d0 2023-12-22T08:42:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c7ad9d640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 0x7f7c7c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:42:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 >> v1:172.21.15.31:6789/0 conn(0x7f7c7c06a6d0 legacy=0x7f7c7c14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 0x7f7c68003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c68003eb0 0x7f7c680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0bf960 con 0x7f7c68004d00 2023-12-22T08:42:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0bb5b0 con 0x7f7c68003eb0 2023-12-22T08:42:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6800b980 con 0x7f7c7c0ba000 2023-12-22T08:42:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c73fff640 1 --2- 172.21.15.31:0/3173737102 >> v2:172.21.15.69:3300/0 conn(0x7f7c7c0ba550 0x7f7c7c0b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-22T08:42:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c7ad9d640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c7a59c640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 0x7f7c68003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c73fff640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c68003eb0 0x7f7c680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c7ad9d640 1 -- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 msgr2=0x7f7c68003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c7ad9d640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c0ba000 0x7f7c68003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c7ad9d640 1 -- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c68003eb0 msgr2=0x7f7c680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T08:42:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c7ad9d640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c68003eb0 0x7f7c680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.366+0000 7f7c7ad9d640 1 -- 172.21.15.31:0/3173737102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74009a70 con 0x7f7c68004d00 2023-12-22T08:42:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.367+0000 7f7c7ad9d640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c68005180 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400e350 tx=0x7f7c680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff0fe162db06f6d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.367+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7402cd70 con 0x7f7c68004d00 2023-12-22T08:42:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.367+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7c7400f040 con 0x7f7c68004d00 2023-12-22T08:42:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.367+0000 7f7c79d9b640 1 -- 172.21.15.31:0/3173737102 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74034660 con 0x7f7c68004d00 2023-12-22T08:42:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.368+0000 7f7c80a96640 1 -- 172.21.15.31:0/3173737102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 msgr2=0x7f7c68005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.368+0000 7f7c80a96640 1 --2- 172.21.15.31:0/3173737102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c68005180 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400e350 tx=0x7f7c680057f0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.368+0000 7f7c7ad9d640 1 -- 172.21.15.31:0/3173737102 reap_dead start 2023-12-22T08:42:46.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.368+0000 7f7c80a96640 1 -- 172.21.15.31:0/3173737102 shutdown_connections 2023-12-22T08:42:46.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.368+0000 7f7c80a96640 1 -- 172.21.15.31:0/3173737102 >> 172.21.15.31:0/3173737102 conn(0x7f7c7c0c0350 msgr2=0x7f7c7c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:46.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.368+0000 7f7c80a96640 1 -- 172.21.15.31:0/3173737102 shutdown_connections 2023-12-22T08:42:46.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.368+0000 7f7c80a96640 1 -- 172.21.15.31:0/3173737102 wait complete. 2023-12-22T08:42:46.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.369+0000 7f7c80a96640 1 Processor -- start 2023-12-22T08:42:46.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.369+0000 7f7c80a96640 1 -- start start 2023-12-22T08:42:46.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c80a96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c7c0a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c80a96640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c09d510 0x7f7c7c09afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c80a96640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c7c09d970 0x7f7c7c09b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c80a96640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0a5c20 con 0x7f7c68004d00 2023-12-22T08:42:46.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c80a96640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09ab60 con 0x7f7c7c09d970 2023-12-22T08:42:46.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c80a96640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c09ea10 con 0x7f7c7c09d510 2023-12-22T08:42:46.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c7c0a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c7c0a56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43164/0 (socket says 172.21.15.31:43164) 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 -- 172.21.15.31:0/4167334877 learned_addr learned my addr 172.21.15.31:0/4167334877 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c73fff640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c09d510 0x7f7c7c09afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7ad9d640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c7c09d970 0x7f7c7c09b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 -- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c09d510 msgr2=0x7f7c7c09afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c09d510 0x7f7c7c09afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 -- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c7c09d970 msgr2=0x7f7c7c09b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c7c09d970 0x7f7c7c09b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 -- 172.21.15.31:0/4167334877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c09df40 con 0x7f7c68004d00 2023-12-22T08:42:46.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c7a59c640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c7c0a56e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c007340 tx=0x7f7c6c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c72ffd640 1 -- 172.21.15.31:0/4167334877 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00f9a0 con 0x7f7c68004d00 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c72ffd640 1 -- 172.21.15.31:0/4167334877 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7c6c00fb20 con 0x7f7c68004d00 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c09ec80 con 0x7f7c68004d00 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c72ffd640 1 -- 172.21.15.31:0/4167334877 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0133f0 con 0x7f7c68004d00 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.370+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c0beba0 con 0x7f7c68004d00 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.371+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c09acd0 con 0x7f7c68004d00 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.372+0000 7f7c72ffd640 1 -- 172.21.15.31:0/4167334877 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c6c013550 con 0x7f7c68004d00 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.372+0000 7f7c72ffd640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7c5c06a430 0x7f7c5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-22T08:42:46.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.372+0000 7f7c72ffd640 1 -- 172.21.15.31:0/4167334877 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c6c088b00 con 0x7f7c68004d00 2023-12-22T08:42:46.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.373+0000 7f7c73fff640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7c5c06a430 0x7f7c5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-22T08:42:46.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.373+0000 7f7c73fff640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7c5c06a430 0x7f7c5c06c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0befb0 tx=0x7f7c64009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T08:42:46.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.377+0000 7f7c72ffd640 1 -- 172.21.15.31:0/4167334877 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7c7c09acd0 con 0x7f7c68004d00 2023-12-22T08:42:46.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:46.393 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:46.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:46.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.590+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c7c09acd0 con 0x7f7c68004d00 2023-12-22T08:42:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.591+0000 7f7c72ffd640 1 -- 172.21.15.31:0/4167334877 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3888 (secure 0 0 0) 0x7f7c7c09acd0 con 0x7f7c68004d00 2023-12-22T08:42:46.593 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-12-22T08:42:46.593 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/173415810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":173415810},{"type":"v1","addr":"172.21.15.31:6835","nonce":173415810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/3869821333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3869821333},{"type":"v1","addr":"172.21.15.69:6835","nonce":3869821333}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T08:41:27.101993+0000","modified":"2023-12-22T08:41:29.116339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/3038519921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3038519921},{"type":"v1","addr":"172.21.15.31:6834","nonce":3038519921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-22T08:42:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 13 2023-12-22T08:42:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7c5c06a430 msgr2=0x7f7c5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7c5c06a430 0x7f7c5c06c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0befb0 tx=0x7f7c64009190 comp rx=0 tx=0).stop 2023-12-22T08:42:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 msgr2=0x7f7c7c0a56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T08:42:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c7c0a56e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c007340 tx=0x7f7c6c007800 comp rx=0 tx=0).stop 2023-12-22T08:42:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 shutdown_connections 2023-12-22T08:42:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:6832/119711,v1:172.21.15.69:6833/119711] conn(0x7f7c5c06a430 0x7f7c5c06c8f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c7c09d970 0x7f7c7c09b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7c7c09d510 0x7f7c7c09afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 --2- 172.21.15.31:0/4167334877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c68004d00 0x7f7c7c0a56e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-22T08:42:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 >> 172.21.15.31:0/4167334877 conn(0x7f7c7c0c0350 msgr2=0x7f7c7c0a0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T08:42:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 shutdown_connections 2023-12-22T08:42:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-12-22T08:42:46.593+0000 7f7c80a96640 1 -- 172.21.15.31:0/4167334877 wait complete. 2023-12-22T08:42:46.605 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-22T08:42:46.605 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-22T08:42:46.606 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T08:42:46.606 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:46.616 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T08:42:46.617 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T08:42:46.617 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:46.665 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T08:42:46.665 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T08:42:46.666 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:46.678 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T08:42:46.678 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-22T08:42:46.678 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-22T08:42:46.678 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:46.737 INFO:tasks.ceph.osd.0:Stopped 2023-12-22T08:42:46.737 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-22T08:42:46.737 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:46.800 INFO:tasks.ceph.osd.1:Stopped 2023-12-22T08:42:46.801 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-22T08:42:46.801 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:46.869 INFO:tasks.ceph.osd.2:Stopped 2023-12-22T08:42:46.869 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-22T08:42:46.869 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:46.932 INFO:tasks.ceph.osd.3:Stopped 2023-12-22T08:42:46.933 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-22T08:42:46.933 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:46.969 INFO:tasks.ceph.osd.4:Stopped 2023-12-22T08:42:46.970 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-22T08:42:46.970 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:47.035 INFO:tasks.ceph.osd.5:Stopped 2023-12-22T08:42:47.036 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-22T08:42:47.036 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:47.107 INFO:tasks.ceph.osd.6:Stopped 2023-12-22T08:42:47.108 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-22T08:42:47.108 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:47.178 INFO:tasks.ceph.osd.7:Stopped 2023-12-22T08:42:47.178 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-22T08:42:47.178 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-22T08:42:47.178 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:47.201 INFO:tasks.ceph.mgr.y:Stopped 2023-12-22T08:42:47.202 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-22T08:42:47.202 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:47.246 INFO:tasks.ceph.mgr.x:Stopped 2023-12-22T08:42:47.246 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-22T08:42:47.247 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-22T08:42:47.247 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:47.259 INFO:tasks.ceph.mon.a:Stopped 2023-12-22T08:42:47.259 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-22T08:42:47.259 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:47.298 INFO:tasks.ceph.mon.b:Stopped 2023-12-22T08:42:47.299 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-22T08:42:47.299 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T08:42:47.351 INFO:tasks.ceph.mon.c:Stopped 2023-12-22T08:42:47.351 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-22T08:42:47.351 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-22T08:42:47.387 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:42:47.388 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-22T08:42:47.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:42:47.600 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-22T08:42:47.672 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:42:47.673 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-22T08:42:47.729 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:42:47.860 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-22T08:42:47.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:42:47.926 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-22T08:42:48.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:42:48.077 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-22T08:42:48.150 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:42:48.150 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-22T08:42:48.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:42:48.207 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-22T08:42:48.280 INFO:tasks.ceph:Archiving mon data... 2023-12-22T08:42:48.281 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/data/mon.a.tgz 2023-12-22T08:42:48.281 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-12-22T08:42:48.299 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.tksEAZjqxA 2023-12-22T08:42:48.299 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tksEAZjqxA 2023-12-22T08:42:48.437 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.tksEAZjqxA 2023-12-22T08:42:48.530 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.tksEAZjqxA is 276KB 2023-12-22T08:42:48.628 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.tksEAZjqxA 2023-12-22T08:42:48.645 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/data/mon.b.tgz 2023-12-22T08:42:48.645 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-12-22T08:42:48.662 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.8rW8GaN7yF 2023-12-22T08:42:48.663 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8rW8GaN7yF 2023-12-22T08:42:48.814 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.8rW8GaN7yF 2023-12-22T08:42:48.900 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.8rW8GaN7yF is 368KB 2023-12-22T08:42:48.998 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.8rW8GaN7yF 2023-12-22T08:42:49.012 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/data/mon.c.tgz 2023-12-22T08:42:49.013 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-12-22T08:42:49.066 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.rOv840kdk1 2023-12-22T08:42:49.066 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.rOv840kdk1 2023-12-22T08:42:49.196 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.rOv840kdk1 2023-12-22T08:42:49.280 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.rOv840kdk1 is 368KB 2023-12-22T08:42:49.349 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.rOv840kdk1 2023-12-22T08:42:49.363 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-22T08:42:49.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-22T08:42:49.366 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-22T08:42:49.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-22T08:42:49.511 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-22T08:42:49.512 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-22T08:42:49.514 DEBUG:teuthology.orchestra.run.smithi069:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-22T08:42:49.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-22T08:42:49.543 INFO:teuthology.orchestra.run.smithi069.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-22T08:42:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-22T08:42:49.625 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-22T08:42:49.637 INFO:tasks.ceph:Archiving crash dumps... 2023-12-22T08:42:49.638 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi031/crash 2023-12-22T08:42:49.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-22T08:42:49.673 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi069/crash 2023-12-22T08:42:49.674 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-22T08:42:49.701 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi081/crash 2023-12-22T08:42:49.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-22T08:42:49.835 INFO:tasks.ceph:Shutting down logrotate 2023-12-22T08:42:49.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:49.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:49.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:49.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:50.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:50.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-22T08:42:50.136 INFO:tasks.ceph:Compressing logs... 2023-12-22T08:42:50.136 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:42:50.139 DEBUG:teuthology.orchestra.run.smithi069:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:42:50.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:42:50.911 INFO:tasks.ceph:Archiving logs... 2023-12-22T08:42:50.912 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi031/log 2023-12-22T08:42:50.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-22T08:42:51.171 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi069/log 2023-12-22T08:42:51.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-22T08:42:51.292 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi081/log 2023-12-22T08:42:51.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-22T08:42:51.398 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-22T08:42:51.414 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-22T08:42:51.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-22T08:42:51.418 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-22T08:42:51.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-22T08:42:51.580 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-22T08:42:51.590 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-22T08:42:51.590 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:42:51.593 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:42:51.595 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T08:42:51.605 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:42:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:42:51.609 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:42:51.610 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2023-12-22T08:42:51.610 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +565us[ +558us] +/- 71ms 2023-12-22T08:42:51.610 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv02.front.sepia.ceph.com 3 6 377 42 +111us[ +105us] +/- 62ms 2023-12-22T08:42:51.610 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -703us[ -709us] +/- 74ms 2023-12-22T08:42:51.610 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:42:51.612 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:42:51.612 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-12-22T08:42:51.612 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +577us[ +566us] +/- 71ms 2023-12-22T08:42:51.612 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 +110us[ +99us] +/- 62ms 2023-12-22T08:42:51.612 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -695us[ -695us] +/- 74ms 2023-12-22T08:42:51.612 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:42:51.652 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2023-12-22T08:42:51.661 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-22T08:42:51.662 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-12-22T08:42:51.662 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 42 +558us[ +558us] +/- 72ms 2023-12-22T08:42:51.662 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 +94us[ +103us] +/- 62ms 2023-12-22T08:42:51.662 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -704us[ -694us] +/- 74ms 2023-12-22T08:42:51.662 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-22T08:42:51.664 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-22T08:42:51.674 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-22T08:42:51.674 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-22T08:42:51.689 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-22T08:42:51.797 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-22T08:42:51.888 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-22T08:42:52.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:42:52.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:42:52.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:42:52.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:42:52.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-22T08:42:52.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:42:52.331 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-22T08:42:52.342 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-22T08:42:52.352 INFO:teuthology.task.internal:Duration was 981.770727 seconds 2023-12-22T08:42:52.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-22T08:42:52.365 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-22T08:42:52.366 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-22T08:42:52.369 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-22T08:42:52.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-22T08:42:52.412 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:42:52.422 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:42:52.544 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-22T08:42:52.778 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-22T08:42:52.779 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2023-12-22T08:42:52.779 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-22T08:42:52.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2023-12-22T08:42:52.802 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-22T08:42:52.826 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-12-22T08:42:52.826 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-22T08:42:52.900 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-22T08:42:52.901 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:42:52.903 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:42:52.906 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T08:42:52.990 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-22T08:42:52.990 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-22T08:42:52.993 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-22T08:42:52.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-22T08:42:53.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-22T08:42:53.181 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-22T08:42:53.182 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-22T08:42:53.213 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-22T08:42:53.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-22T08:42:53.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-22T08:42:53.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:42:53.357 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:42:53.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:42:53.382 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2023-12-22T08:42:53.384 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2023-12-22T08:42:53.468 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-12-22T08:42:53.521 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:42:53.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:42:53.535 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:42:53.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:42:53.549 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-22T08:42:53.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T08:42:53.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-22T08:42:53.613 INFO:teuthology.task.internal:Transferring archived files... 2023-12-22T08:42:53.614 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi031 2023-12-22T08:42:53.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-22T08:42:53.655 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi069 2023-12-22T08:42:53.655 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-22T08:42:53.691 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264/remote/smithi081 2023-12-22T08:42:53.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-22T08:42:53.801 INFO:teuthology.task.internal:Removing archive directory... 2023-12-22T08:42:53.801 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-22T08:42:53.804 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-22T08:42:53.807 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-22T08:42:53.863 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-22T08:42:53.875 INFO:teuthology.task.internal:Not uploading archives. 2023-12-22T08:42:53.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-22T08:42:53.891 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-22T08:42:53.892 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-22T08:42:53.894 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-22T08:42:53.897 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-22T08:42:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 22 08:42 /home/ubuntu/cephtest 2023-12-22T08:42:53.908 INFO:teuthology.orchestra.run.smithi069.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 22 08:42 /home/ubuntu/cephtest 2023-12-22T08:42:53.958 INFO:teuthology.orchestra.run.smithi081.stdout: 393942 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 22 08:42 /home/ubuntu/cephtest 2023-12-22T08:42:53.961 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-22T08:42:53.972 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-22T08:42:54.004 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T08:42:54.030 DEBUG:teuthology.nuke:shortname: smithi031 2023-12-22T08:42:54.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:42:54.050 DEBUG:teuthology.nuke:shortname: smithi069 2023-12-22T08:42:54.051 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:42:54.056 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:11:51.811663', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB23JivX3NN0kJikQtmzVqu4rvaSH8xkeY/nxCbPif/BHykgD6P54hx0/ntSHiaNnM1xvcQbPT1AgynzyFQZM2g='} 2023-12-22T08:42:54.072 DEBUG:teuthology.nuke:shortname: smithi081 2023-12-22T08:42:54.072 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T08:42:54.079 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:11:51.812826', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDAGJtlX1Wvr3Kk+bOb1TYcJrJLgT/Na2DrTcmUsGZS0WPS8rezYiW4P3EiEfDoftsSYKciV8cbqlGUemwH6lMY='} 2023-12-22T08:42:54.096 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:10:43-fs-rishabh-mdscap-reef-testing-default-smithi/7499264', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 08:11:51.813780', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmDN9xvpP3Iefh6BILfTx8zURGBu3p8av5TiH2xj2l+f7+ahFpQEltHPDJtBjzBJ2aXLXJZyGgu9vvzKxJ5Eg0='} 2023-12-22T08:42:54.108 INFO:teuthology.orchestra.console.smithi031:Power off 2023-12-22T08:42:54.108 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:42:54.132 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-12-22T08:42:54.132 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:42:54.150 INFO:teuthology.orchestra.console.smithi069:Power off 2023-12-22T08:42:54.151 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:42:54.167 INFO:teuthology.orchestra.console.smithi081:Power off 2023-12-22T08:42:54.167 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T08:42:54.177 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-22T08:42:54.178 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-12-22T08:42:54.178 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:42:54.194 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-12-22T08:42:54.194 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:42:54.204 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-22T08:42:54.220 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-22T08:42:58.179 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:42:58.206 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:42:58.222 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:42:58.291 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-22T08:42:58.317 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-22T08:42:58.332 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-22T08:43:02.293 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:43:02.318 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:43:02.333 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:43:02.406 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-22T08:43:02.429 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-22T08:43:02.443 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-22T08:43:02.530 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-12-22T08:43:06.409 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:43:06.443 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T08:43:06.520 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-12-22T08:43:06.555 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-12-22T08:43:06.622 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-12-22T08:43:06.656 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-12-22T08:43:06.761 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} duration: 981.7707271575928 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1893386c348a4d6eabd364402b51184a status: fail success: false 2023-12-22T08:43:06.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T08:43:06.837 INFO:teuthology.run:FAIL